| *** hdd has quit IRC | 00:05 | |
| *** witlessb has quit IRC | 00:19 | |
| *** Longgeek has quit IRC | 00:30 | |
| *** hdd has joined #openstack-sahara | 00:39 | |
| *** tmckay has joined #openstack-sahara | 00:39 | |
| *** amcrn has quit IRC | 01:05 | |
| openstackgerrit | Merged openstack/sahara: [Vanilla2] Open ports for hive https://review.openstack.org/154843 | 01:27 |
|---|---|---|
| *** tmckay has quit IRC | 01:34 | |
| *** ViswaV has quit IRC | 01:37 | |
| openstackgerrit | Andrew Lazarev proposed openstack/python-saharaclient: Removed cluster validation on client side https://review.openstack.org/155092 | 01:37 |
| *** saurabhs has left #openstack-sahara | 01:51 | |
| *** macjack has joined #openstack-sahara | 01:59 | |
| *** Longgeek has joined #openstack-sahara | 02:15 | |
| *** hdd has quit IRC | 02:42 | |
| *** Longgeek has quit IRC | 02:48 | |
| *** shakamunyi has joined #openstack-sahara | 02:49 | |
| *** rodrigod` has joined #openstack-sahara | 02:51 | |
| *** vgridnev has quit IRC | 02:52 | |
| *** rodrigods has quit IRC | 02:52 | |
| *** Longgeek has joined #openstack-sahara | 02:55 | |
| *** vgridnev has joined #openstack-sahara | 02:56 | |
| openstackgerrit | Ken Chen proposed openstack/sahara: Add CM API lib into CDH plugin codes https://review.openstack.org/153806 | 03:48 |
| *** Longgeek has quit IRC | 04:10 | |
| *** Longgeek has joined #openstack-sahara | 04:25 | |
| *** Longgeek has quit IRC | 04:26 | |
| *** Nikolay_St has joined #openstack-sahara | 04:34 | |
| *** barra204 has joined #openstack-sahara | 04:35 | |
| *** shakamunyi has quit IRC | 04:39 | |
| *** barra204 has quit IRC | 04:53 | |
| *** hdd has joined #openstack-sahara | 04:54 | |
| *** ViswaV has joined #openstack-sahara | 05:07 | |
| *** barra204 has joined #openstack-sahara | 05:07 | |
| *** coolsvap has joined #openstack-sahara | 05:19 | |
| *** coolsvap has quit IRC | 05:21 | |
| *** coolsvap_ has joined #openstack-sahara | 05:22 | |
| *** coolsvap_ is now known as coolsvap | 05:22 | |
| *** akuznetsov has joined #openstack-sahara | 05:25 | |
| *** akuznetsov has quit IRC | 05:42 | |
| *** Nikolay_St has quit IRC | 05:45 | |
| *** Longgeek has joined #openstack-sahara | 06:07 | |
| *** ViswaV has quit IRC | 06:09 | |
| *** hdd has quit IRC | 06:19 | |
| *** barra204 has quit IRC | 06:36 | |
| *** sgotliv has joined #openstack-sahara | 06:44 | |
| *** _mattf has quit IRC | 07:42 | |
| *** _mattf has joined #openstack-sahara | 07:42 | |
| *** coolsvap has quit IRC | 07:48 | |
| *** coolsvap has joined #openstack-sahara | 07:48 | |
| *** Longgeek has quit IRC | 07:53 | |
| *** Longgeek has joined #openstack-sahara | 07:53 | |
| *** Longgeek has quit IRC | 07:53 | |
| *** witlessb has joined #openstack-sahara | 08:13 | |
| *** openstackgerrit has quit IRC | 08:21 | |
| *** openstackgerrit has joined #openstack-sahara | 08:21 | |
| *** Nikolay_St has joined #openstack-sahara | 08:23 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Make status description field more useful https://review.openstack.org/154014 | 08:40 |
| *** chlong has quit IRC | 08:42 | |
| *** Longgeek has joined #openstack-sahara | 08:54 | |
| *** sgotliv_ has joined #openstack-sahara | 09:01 | |
| *** sgotliv has quit IRC | 09:04 | |
| *** Longgeek has quit IRC | 09:07 | |
| *** sgotliv__ has joined #openstack-sahara | 09:10 | |
| *** sgotliv_ has quit IRC | 09:13 | |
| *** juice has quit IRC | 09:22 | |
| *** jodah has quit IRC | 09:22 | |
| *** jodah has joined #openstack-sahara | 09:24 | |
| *** juice has joined #openstack-sahara | 09:24 | |
| *** IvanBerezovskiy has joined #openstack-sahara | 09:56 | |
| *** skolekonov has joined #openstack-sahara | 09:57 | |
| *** Longgeek has joined #openstack-sahara | 10:04 | |
| *** tosky has joined #openstack-sahara | 10:16 | |
| *** akuznetsov has joined #openstack-sahara | 10:27 | |
| openstackgerrit | Merged openstack/sahara-image-elements: Fix executing hadoop command with hadoop user instead of root user https://review.openstack.org/153495 | 10:27 |
| *** akuznetsov has quit IRC | 10:37 | |
| *** Longgeek has quit IRC | 10:38 | |
| *** Longgeek has joined #openstack-sahara | 10:44 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Make status description field more useful https://review.openstack.org/154014 | 10:54 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add ability to get cluster_id directly from instance https://review.openstack.org/155250 | 10:56 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Use random output path for Hive EDP job in IT https://review.openstack.org/155252 | 11:00 |
| *** akuznetsov has joined #openstack-sahara | 11:05 | |
| *** akuznetsov has quit IRC | 11:08 | |
| *** tosky is now known as tosky_ | 11:11 | |
| *** tosky_ is now known as tosky | 11:12 | |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - base functional https://review.openstack.org/148491 | 11:29 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - base functional https://review.openstack.org/148491 | 11:34 |
| *** rodrigod` is now known as rodrigods | 11:49 | |
| tellesnobrega | elmiko, ping | 11:50 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - scaling https://review.openstack.org/148935 | 11:59 |
| *** tellesnobrega_ has joined #openstack-sahara | 12:36 | |
| *** tmckay has joined #openstack-sahara | 12:57 | |
| *** tellesnobrega_ has quit IRC | 12:58 | |
| *** tmckay has left #openstack-sahara | 12:58 | |
| *** tmckay has joined #openstack-sahara | 12:59 | |
| openstackgerrit | Merged openstack/python-saharaclient: Add how to participate doc https://review.openstack.org/123898 | 13:04 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - EDP https://review.openstack.org/150042 | 13:07 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - EDP https://review.openstack.org/150042 | 13:09 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Add validation in new integration tests https://review.openstack.org/151680 | 13:10 |
| *** tellesnobrega has quit IRC | 13:11 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Add unit-tests for new integration tests https://review.openstack.org/155298 | 13:26 |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Migrate jobs to new integrations tests config https://review.openstack.org/155301 | 13:28 |
| *** tellesnobrega has joined #openstack-sahara | 13:37 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara-specs: Implement timeouts for polling process https://review.openstack.org/155312 | 13:46 |
| tellesnobrega | elmiko, ping | 13:47 |
| elmiko | tellesnobrega: yo | 13:52 |
| *** weiting has joined #openstack-sahara | 13:52 | |
| tellesnobrega | elmiko, what is the problema that you see in making the folder name zookeeper? | 13:52 |
| *** zhidong has joined #openstack-sahara | 13:53 | |
| elmiko | tellesnobrega: no problem specifically, i just thought creating a symlink would support the behavior of the storm plugin while still maintaining the original zk directory. | 13:53 |
| elmiko | tellesnobrega: i was following on tmckay's comment | 13:54 |
| *** _mattf is now known as mattf | 13:54 | |
| openstackgerrit | Merged openstack/sahara: Improve messages for validation https://review.openstack.org/154483 | 13:55 |
| elmiko | tellesnobrega: does that make sense? | 13:56 |
| tellesnobrega | elmiko, I see. So just leave the folder as it is and link zookeeper -> zookeeper-3.4.6 | 13:56 |
| tellesnobrega | elmiko, sounds great | 13:56 |
| tellesnobrega | will do in a bit | 13:56 |
| elmiko | tellesnobrega: right, instead of doing the tar into a zk dir, just extract the tar and then make a zookeeper symlink. i think the new storm change will work, and we can keep backward compat(if it's even an issue). | 13:59 |
| SergeyLukjanov | meeting in a minute | 13:59 |
| *** egafford has joined #openstack-sahara | 13:59 | |
| tellesnobrega | elmiko, great | 14:00 |
| *** _crobertsrh is now known as crobertsrh | 14:03 | |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara-image-elements: Creating Zookeeper symlink folder name to not use version https://review.openstack.org/154889 | 14:13 |
| *** miqui_ has joined #openstack-sahara | 14:13 | |
| *** tmckay has quit IRC | 14:22 | |
| egafford | SergeyLukjanov: To clarify my role, by the way (as it came up in the meeting): I am full-time on Sahara, but since I started in November I've been tasked pretty heavily with internal RH tasks around launch of our first fully supported version of Sahara. That launched (quite) recently, though, so I'm now committed to Sahara fully (though I may do integrations as well from time to time, as with TripleO.) But yes, the basic me | 14:40 |
| SergeyLukjanov | egafford, cool, thx for the clarification! | 14:41 |
| tosky | egafford: "the basic me" and... (truncated? :) | 14:41 |
| SergeyLukjanov | tosky, yeah, looks like cut or network split :) | 14:41 |
| tosky | IRC client I bet | 14:41 |
| egafford | tosky: But yes, the basic message is that I am full-time Sahara, and happy to be here. It's a great community, and the codebase is lovely. | 14:42 |
| egafford | tosky: Yeah, I use a graphical client (Pidgin), and sometimes I go long and it doesn't work for some receivers. Thanks for the check. "The basic me" would be an odd way to end that. | 14:43 |
| elmiko | yea, looked a little odd | 14:43 |
| openstackgerrit | Merged openstack/sahara-specs: Add spec for Delete by multiple names or ids in CLI https://review.openstack.org/152115 | 14:47 |
| openstackgerrit | Merged openstack/sahara-specs: Implement a CM API libary in CDH plugin https://review.openstack.org/151978 | 14:48 |
| *** tellesnobrega has quit IRC | 14:51 | |
| *** tellesnobrega has joined #openstack-sahara | 14:54 | |
| *** tellesnobrega_ has joined #openstack-sahara | 14:54 | |
| tellesnobrega_ | hey, has anyone taught about google summer of code? including sahara this year? we could get some nice work done in the three months cycle | 14:55 |
| *** tellesnobrega_ has quit IRC | 14:55 | |
| *** weiting has quit IRC | 15:01 | |
| *** tmckay has joined #openstack-sahara | 15:04 | |
| *** tmckay has quit IRC | 15:05 | |
| *** tmckay has joined #openstack-sahara | 15:05 | |
| *** zhidong has quit IRC | 15:09 | |
| openstackgerrit | Michael McCune proposed openstack/sahara-image-elements: Adding new update option to diskimage-create.sh https://review.openstack.org/151099 | 15:12 |
| openstackgerrit | Nikolay Starodubtsev proposed openstack/sahara-image-elements: Add update script for yum based images https://review.openstack.org/155347 | 15:13 |
| *** mattf is now known as _mattf | 15:33 | |
| *** hdd has joined #openstack-sahara | 15:36 | |
| *** Networkn3rd has joined #openstack-sahara | 15:42 | |
| *** hdd has quit IRC | 15:52 | |
| *** skolekonov has quit IRC | 16:01 | |
| *** Nikolay_St has quit IRC | 16:01 | |
| *** tmckay has quit IRC | 16:11 | |
| openstackgerrit | Merged openstack/python-saharaclient: Added --bypass-url support for keystone 3 https://review.openstack.org/154716 | 16:14 |
| openstackgerrit | Merged openstack/python-saharaclient: Removed cluster validation on client side https://review.openstack.org/155092 | 16:15 |
| openstackgerrit | Merged openstack/sahara: Fixed bug with spark scaling https://review.openstack.org/153993 | 16:32 |
| openstackgerrit | Merged openstack/sahara: Add impala shell solr package in the cdh plugin https://review.openstack.org/154785 | 16:32 |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara-image-elements: Creating Zookeeper symlink folder name to not use version https://review.openstack.org/154889 | 16:37 |
| *** tellesnobrega_ has joined #openstack-sahara | 16:39 | |
| *** tellesnobrega_ has quit IRC | 16:39 | |
| *** tmckay has joined #openstack-sahara | 16:50 | |
| *** tellesnobrega_ has joined #openstack-sahara | 16:52 | |
| *** tmckay has quit IRC | 16:56 | |
| *** hdd has joined #openstack-sahara | 17:00 | |
| *** Nikolay_St has joined #openstack-sahara | 17:06 | |
| *** coolsvap is now known as coolsvap_ | 17:12 | |
| *** ViswaV has joined #openstack-sahara | 17:14 | |
| *** hdd has quit IRC | 17:18 | |
| *** tmckay has joined #openstack-sahara | 17:21 | |
| *** hdd has joined #openstack-sahara | 17:21 | |
| *** Nikolay_St has quit IRC | 17:26 | |
| *** IvanBerezovskiy has left #openstack-sahara | 17:43 | |
| *** Nikolay_St has joined #openstack-sahara | 17:48 | |
| *** tellesnobrega_ has quit IRC | 17:53 | |
| *** Nikolay_St has quit IRC | 17:55 | |
| *** coolsvap_ is now known as coolsvap | 17:55 | |
| *** Nikolay_St has joined #openstack-sahara | 17:56 | |
| *** tellesnobrega_ has joined #openstack-sahara | 17:58 | |
| *** ViswaV has quit IRC | 18:00 | |
| *** Nikolay_St has quit IRC | 18:06 | |
| *** Nikolay_St has joined #openstack-sahara | 18:07 | |
| *** sgotliv__ has quit IRC | 18:10 | |
| *** Nikolay_St has quit IRC | 18:18 | |
| *** Nikolay_St has joined #openstack-sahara | 18:19 | |
| *** DenisEgorenko has left #openstack-sahara | 18:24 | |
| *** Nikolay_St has quit IRC | 18:26 | |
| *** Nikolay_St has joined #openstack-sahara | 18:26 | |
| *** ViswaV has joined #openstack-sahara | 18:28 | |
| *** tellesnobrega_ has quit IRC | 18:31 | |
| *** ViswaV has quit IRC | 18:33 | |
| *** tellesnobrega_ has joined #openstack-sahara | 18:35 | |
| *** ViswaV has joined #openstack-sahara | 18:36 | |
| *** Nikolay_St has quit IRC | 18:40 | |
| *** Nikolay_St has joined #openstack-sahara | 18:41 | |
| *** Longgeek has quit IRC | 18:51 | |
| *** Longgeek has joined #openstack-sahara | 18:52 | |
| egafford | Have we ever talked about having an automatic, small number of rechecks on individual failing CI jobs? I understand that the goal absolutely should be to improve reliability of the tests, but at present it seems like we very frequently recheck multiple times until the whole set happens to work at once. | 18:53 |
| egafford | I can't imagine the cluster is too happy about all the extra workload. | 18:54 |
| *** Longgeek has quit IRC | 18:56 | |
| *** coolsvap is now known as coolsvap_ | 18:57 | |
| *** tosky has quit IRC | 19:14 | |
| *** vgridnev_ has joined #openstack-sahara | 19:15 | |
| *** macjack has quit IRC | 19:15 | |
| *** ViswaV has quit IRC | 19:20 | |
| *** ViswaV has joined #openstack-sahara | 19:25 | |
| *** hdd has quit IRC | 19:35 | |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Make status description field more useful https://review.openstack.org/154014 | 19:43 |
| *** Longgeek has joined #openstack-sahara | 19:53 | |
| elmiko | egafford: not sure if we've talked about it, but we have talked about the issue of "recheck...recheck...recheck...RECHECK!!!!" | 19:53 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add provision steps to Spark Plugin https://review.openstack.org/152132 | 19:55 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add provisioning steps to Storm plugin https://review.openstack.org/152143 | 19:57 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Apply event-log feature for Vanilla plugins https://review.openstack.org/149972 | 19:57 |
| vgridnev_ | Which issues with rechecks? | 20:02 |
| *** Longgeek has quit IRC | 20:02 | |
| egafford | vgridnev_: We very often recheck CI jobs multiple times on a commit. This uses a lot of CI cluster time, and generally slows us down. One solution people sometimes use in situations like this is to recursively gather the failing scenarios in the last run and recheck only them, for a fixed number of recursions. | 20:03 |
| egafford | vgridnev_: It's risky, because it allows random test or prod code error to go unseen sometimes, but if we're manually hitting sahara-ci-recheck several times until the whole set of tests works at once anyway, we're not doing ourselves any real favors. | 20:04 |
| egafford | elmiko: I'll bring up the possibility at the next weekly. Playing the CI slot machine game wastes enough cluster and dev time that it's worth at least talking about the option. | 20:08 |
| *** zhiyan has quit IRC | 20:08 | |
| elmiko | egafford: agreed, my impression is that fixing the weird issues (like clusters coming up in error state) is a deep well | 20:09 |
| egafford | elmiko: Sure; any system with this much complexity and asynchronicity is going to be very hard to write reliable CI for, always. | 20:10 |
| vgridnev_ | In general, I think current recheck-strategy have same risk of passing "random" code | 20:11 |
| *** hdd has joined #openstack-sahara | 20:11 | |
| elmiko | egafford: imo, much of it comes from the non-deterministic nature of spawning this many clusters for testing. there are bound to be hiccups. doesn't mean we shouldn't strive to make it better though. | 20:11 |
| egafford | vgridnev_: Exactly. | 20:11 |
| egafford | elmiko: I agree; we should strive to make it better. I'm just suggesting that we automate around the current pain points. (This message brought to you by the one-line manifest commit in stable/juno, which after passing CI several times, failed CI twice after the stable/Juno Jenkins issue was resolved.) | 20:13 |
| egafford | elmiko: (On different tests each time.) | 20:14 |
| *** zhiyan has joined #openstack-sahara | 20:18 | |
| elmiko | egafford: +1, i don't have any issue with adding some level of auto-recheck | 20:20 |
| elmiko | i thought some of that was in there already, but i don't know all the internals of the testing infra | 20:21 |
| elmiko | egafford: has you looked into zuul and gate process? | 20:21 |
| egafford | elmiko: I haven't; I assumed that we were not auto-rechecking, given the number of random failures I'm seeing. I guess I should rephrase: if we are auto-rechecking, I am concerned. | 20:24 |
| elmiko | egafford: yea, i'm not sure | 20:24 |
| egafford | elmiko: (In a different direction.) | 20:24 |
| elmiko | zuul is kinda cool though, it does this massive testing dance with all the patches that are being submitted across all tagged projects. then attempts to pipeline various combinations of commits, really cool stuff imo. | 20:25 |
| elmiko | (also causes some headaches, but....) | 20:25 |
| *** tellesnobrega_ has quit IRC | 20:41 | |
| *** sgotliv__ has joined #openstack-sahara | 20:55 | |
| *** amcrn has joined #openstack-sahara | 20:57 | |
| *** sgotliv__ has quit IRC | 21:00 | |
| openstackgerrit | lu huichun proposed openstack/sahara: Add Flume service test in cdh plugin integration test https://review.openstack.org/151935 | 21:02 |
| *** vgridnev_ has quit IRC | 21:17 | |
| *** sgotliv__ has joined #openstack-sahara | 21:30 | |
| *** egafford has quit IRC | 21:34 | |
| openstackgerrit | lu huichun proposed openstack/sahara: Add Sqoop service test in cdh plugin integration test https://review.openstack.org/154491 | 21:35 |
| openstackgerrit | lu huichun proposed openstack/sahara: Add Sqoop service test in cdh plugin integration test https://review.openstack.org/154491 | 21:38 |
| *** ViswaV has quit IRC | 21:40 | |
| *** ViswaV has joined #openstack-sahara | 21:45 | |
| *** Longgeek has joined #openstack-sahara | 21:47 | |
| tmckay | sreshetnyak, ping | 21:58 |
| *** crobertsrh is now known as _crobertsrh | 22:02 | |
| *** sgotliv__ has quit IRC | 22:08 | |
| *** vgridnev_ has joined #openstack-sahara | 22:12 | |
| *** hdd has quit IRC | 22:15 | |
| *** Longgeek has quit IRC | 22:19 | |
| *** ViswaV has quit IRC | 22:21 | |
| *** ViswaV has joined #openstack-sahara | 22:33 | |
| *** vgridnev_ has quit IRC | 22:35 | |
| *** tellesnobrega_ has joined #openstack-sahara | 22:39 | |
| *** Networkn3rd has quit IRC | 22:47 | |
| *** vgridnev_ has joined #openstack-sahara | 22:54 | |
| *** ViswaV has quit IRC | 22:55 | |
| *** witlessb has quit IRC | 23:05 | |
| *** ViswaV has joined #openstack-sahara | 23:15 | |
| *** chlong has joined #openstack-sahara | 23:17 | |
| *** ViswaV has quit IRC | 23:20 | |
| *** ViswaV has joined #openstack-sahara | 23:20 | |
| *** tellesnobrega_ has quit IRC | 23:39 | |
| *** openstack has joined #openstack-sahara | 23:40 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!