| openstackgerrit | Vu Cong Tuan proposed openstack/sahara-dashboard master: Switch to stestr https://review.openstack.org/580255 | 02:58 |
|---|---|---|
| openstackgerrit | Nguyen Hung Phuong proposed openstack/openstack-ansible-os_sahara master: fix tox python3 overrides https://review.openstack.org/580064 | 04:12 |
| *** Bhujay has joined #openstack-sahara | 04:21 | |
| *** Bhujay has quit IRC | 07:31 | |
| *** tosky has joined #openstack-sahara | 07:32 | |
| *** rcernin has quit IRC | 07:54 | |
| *** Bhujay has joined #openstack-sahara | 08:15 | |
| *** Bhujay has quit IRC | 10:19 | |
| *** Bhujay has joined #openstack-sahara | 10:55 | |
| tellesnobrega | hi folks, I'm wondering if we have quorum for today's meeting | 13:30 |
| * tosky here | 13:32 | |
| *** jeremyfreudberg has joined #openstack-sahara | 13:54 | |
| *** Bhujay has quit IRC | 14:09 | |
| jeremyfreudberg | tosky, with the whole hive_enable_db_notification bug on cdh 5.13.0, do i just need to manipulate that config, or do i need to manipulate this heapsize thing too (in reference to your sahara-tests patch) | 14:26 |
| tosky | jeremyfreudberg: I think that the heapsize thing is "big" only for a CI deployment, not for a real deployment | 14:27 |
| jeremyfreudberg | tosky: ok, makes sense | 14:27 |
| jeremyfreudberg | tosky - do you know what file on the instance that hive_enable_db_notification ends up in? | 14:58 |
| jeremyfreudberg | the json file is something that gets ingested by cloudera manager, i think, but then i'm assuming that ends up somewhere else | 14:59 |
| tosky | yes, cloudera manager, and no, I don't know were it ends | 14:59 |
| tosky | where*, argh | 14:59 |
| jeremyfreudberg | the cloudera docs hide the info too: https://www.cloudera.com/documentation/enterprise/properties/5-12-x/topics/cm_props_cdh5110_hive.html#concept_5.12.x_hivemetastoreserver_props__section_other_props (the big empty box that says "Related Name", if it were not empty, would have the answer) | 15:02 |
| tosky | the complicated part is that I'm not sure how it gets ingested by cloudera manager; if it's ingested, then I don't really care if cloudera manager uses magic or technology to fix it | 15:52 |
| tosky | oh, please notice the trio of commits which fixes coverage test targets (one of them also removes testr): https://review.openstack.org/#/c/578222/ https://review.openstack.org/#/c/579114/ https://review.openstack.org/#/c/579108/ | 16:01 |
| tellesnobrega | tosky, jeremyfreudberg good news on ambari 2.6, after a tweak for mysql-connector-java.jar I was able to spawn a cluster with Hive | 16:10 |
| tellesnobrega | the whole package | 16:10 |
| jeremyfreudberg | awesome! | 16:11 |
| tellesnobrega | writing a patch to add this tweak | 16:11 |
| tosky | yay | 16:11 |
| *** jeremyfreudberg has quit IRC | 16:36 | |
| openstackgerrit | Jeremy Freudberg proposed openstack/sahara master: Switch hive_enable_db_notification's default value https://review.openstack.org/580452 | 16:56 |
| tellesnobrega | tosky, are you still around? | 18:54 |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara master: Adding Ambari 2.6 to image pack https://review.openstack.org/579024 | 18:57 |
| tosky | tellesnobrega: more or less, yes | 19:20 |
| tellesnobrega | just a quick update | 19:21 |
| tellesnobrega | ambari 2.6 cluster working without manual changes | 19:21 |
| tellesnobrega | didn't run scenarios tests on it tho | 19:21 |
| tellesnobrega | tomorrow I will try to run scenarios on it and previous images | 19:21 |
| tosky | but if you can spawn a cluster, it's already a good news | 19:22 |
| tosky | I'm checking Jeremy's patch for CDH 5.13, I will check Ambari 2.6 when that's done | 19:23 |
| tellesnobrega | cool | 19:23 |
| tellesnobrega | thanks | 19:23 |
| tellesnobrega | tosky, do you know why we download spark using cache instead of a direct wget? | 19:46 |
| tellesnobrega | https://github.com/openstack/sahara-image-elements/blob/master/elements/spark/root.d/50-download-spark#L36-L41 | 19:47 |
| tosky | tellesnobrega: reverting the question: why shouldn't we use the cache? | 19:49 |
| tellesnobrega | no reason, just wondering... I'm migrating the scripts to sahara-image-pack | 19:50 |
| tellesnobrega | so I hit this $TMP_HOOKS_PATH/bin/cache-url $SPARK_DOWNLOAD_URL $cached_tar | 19:50 |
| tosky | multiple execution of sie == less download | 19:50 |
| tellesnobrega | on sahara-image-pack we could skip since it is incremental or not? | 19:51 |
| tosky | tellesnobrega: https://review.openstack.org/#/c/168394/ | 19:51 |
| tosky | iirc it reduced the time on the gates | 19:53 |
| tellesnobrega | got it | 19:54 |
| tosky | especially when they were generating the same image over and over | 19:54 |
| tellesnobrega | will that work with sahara-image-pack? | 19:54 |
| tosky | I think not right now, that was provided by a special element | 19:54 |
| tosky | we can implement something similar in sahara-image-pack, a default place for download, but it may require a new type of validator just to download stuff | 19:55 |
| tellesnobrega | sure | 19:55 |
| tellesnobrega | not right now :) | 19:55 |
| *** rcernin has joined #openstack-sahara | 22:00 | |
| *** rcernin has quit IRC | 22:58 | |
| *** rcernin has joined #openstack-sahara | 23:01 | |
| *** tosky has quit IRC | 23:01 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!