| *** russellb has joined #openstack-sahara | 00:04 | |
| *** hdd has quit IRC | 00:15 | |
| openstackgerrit | Jamie Lennox proposed openstack/sahara: Don't provide CONF to the AuthProtocol middleware https://review.openstack.org/138211 | 00:25 |
|---|---|---|
| *** tellesnobrega__ has quit IRC | 00:47 | |
| *** tellesnobrega__ has joined #openstack-sahara | 00:54 | |
| *** hdd has joined #openstack-sahara | 01:16 | |
| *** hdd has quit IRC | 01:36 | |
| *** tellesnobrega__ has quit IRC | 01:42 | |
| *** tellesnobrega__ has joined #openstack-sahara | 01:44 | |
| *** chandankumar has joined #openstack-sahara | 02:04 | |
| *** tellesnobrega__ has quit IRC | 02:09 | |
| *** tellesnobrega__ has joined #openstack-sahara | 02:16 | |
| openstackgerrit | Ken Chen proposed openstack/sahara: Add CDH plugin documents https://review.openstack.org/136697 | 02:24 |
| *** chandankumar has quit IRC | 03:21 | |
| *** chandankumar has joined #openstack-sahara | 03:29 | |
| *** hdd has joined #openstack-sahara | 03:33 | |
| *** hdd has quit IRC | 03:48 | |
| *** tellesnobrega__ has quit IRC | 04:29 | |
| *** chandankumar has quit IRC | 04:48 | |
| *** Poornima_ has joined #openstack-sahara | 04:54 | |
| *** hdd has joined #openstack-sahara | 05:15 | |
| *** chandankumar has joined #openstack-sahara | 05:31 | |
| *** Networkn3rd has quit IRC | 06:00 | |
| *** chandankumar has quit IRC | 06:09 | |
| *** hdd has quit IRC | 06:15 | |
| *** chandankumar has joined #openstack-sahara | 06:23 | |
| *** chandankumar has quit IRC | 06:27 | |
| *** chandankumar has joined #openstack-sahara | 06:44 | |
| *** k4n0 has joined #openstack-sahara | 07:21 | |
| *** skolekonov has joined #openstack-sahara | 08:11 | |
| *** juice has quit IRC | 08:11 | |
| *** juice has joined #openstack-sahara | 08:18 | |
| *** juice has quit IRC | 08:26 | |
| *** stannie has joined #openstack-sahara | 08:28 | |
| *** juice has joined #openstack-sahara | 08:31 | |
| *** tmckay1 has joined #openstack-sahara | 08:32 | |
| *** tmckay has quit IRC | 08:33 | |
| *** witlessb has joined #openstack-sahara | 08:38 | |
| *** amarouni has joined #openstack-sahara | 08:55 | |
| amarouni | Hello guys. I'm trying to check what's wrong with the CI checks of my patch : https://review.openstack.org/#/c/132051/ | 08:57 |
| *** RockKuo_Office has joined #openstack-sahara | 09:15 | |
| *** tosky has joined #openstack-sahara | 09:16 | |
| SergeyLukjanov | amarouni, hey, it looks like it's not related to your patch, unfortunately we have a big percent of false negative job results | 09:36 |
| amarouni | Ah, Ok I thought so. | 09:38 |
| amarouni | Thanks. | 09:38 |
| amarouni | So what should I do next ? I think I'm done with fixing the bugs and comments. | 09:39 |
| SergeyLukjanov | amarouni, wait a bit for reviews :) | 09:46 |
| amarouni | Ok :) | 09:48 |
| SergeyLukjanov | tellesnobrega, crobertsrh, tmckay, I've released 0.7.6 client with filtering and d-p endpoint type | 09:56 |
| SergeyLukjanov | tellesnobrega, crobertsrh, tmckay, time to recheck on yout patches | 09:56 |
| *** RockKuo_Office has quit IRC | 10:14 | |
| openstackgerrit | Merged stackforge/sahara-ci-config: Add extra-index-url for PYPI https://review.openstack.org/138016 | 10:17 |
| openstackgerrit | Merged openstack/sahara-specs: Updating query filtering support for Sahara https://review.openstack.org/136865 | 10:32 |
| *** tellesnobrega has joined #openstack-sahara | 10:37 | |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Remove Horizon job https://review.openstack.org/138312 | 10:37 |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Remove Horizon job https://review.openstack.org/138312 | 10:43 |
| *** tellesnobrega has quit IRC | 10:46 | |
| *** tellesnobrega has joined #openstack-sahara | 10:53 | |
| *** amarouni has quit IRC | 10:54 | |
| openstackgerrit | Merged openstack/python-saharaclient: Added unit tests for python bindings https://review.openstack.org/134167 | 11:00 |
| *** tellesnobrega has quit IRC | 11:03 | |
| openstackgerrit | Kazuki OIKAWA proposed openstack/sahara-image-elements: Add hadoop-openstack.jar build script and vanilla2 hive support https://review.openstack.org/137027 | 11:21 |
| *** chandankumar has quit IRC | 11:28 | |
| *** chandankumar has joined #openstack-sahara | 11:28 | |
| openstackgerrit | Merged openstack/sahara: Open all ports for private network for auto SG https://review.openstack.org/136083 | 11:34 |
| openstackgerrit | Merged openstack/sahara: Add list of open ports for Spark plugin https://review.openstack.org/134927 | 11:34 |
| *** tellesnobrega_ is now known as tellesnobrega | 11:47 | |
| tellesnobrega | SergeyLukjanov, will do | 11:47 |
| openstackgerrit | Sergey Lukjanov proposed openstack/python-saharaclient: Set default service_type to "data-processing" in client https://review.openstack.org/138332 | 12:07 |
| SergeyLukjanov | tellesnobrega, I have a feeling that we need to override the default value in client too - https://github.com/openstack/python-saharaclient/blob/f09c4c8d3de632dc7b7b3b3a1c4eb32d7ccd3652/saharaclient/api/client.py#L36 | 12:07 |
| SergeyLukjanov | tellesnobrega, https://review.openstack.org/138332 | 12:07 |
| SergeyLukjanov | tmckay1, ^^ | 12:08 |
| tellesnobrega | someone told that i should leave this for backward compatibility | 12:09 |
| tellesnobrega | cant remember who | 12:09 |
| openstackgerrit | Sergey Lukjanov proposed openstack/python-saharaclient: Set default service_type to "data-processing" in client https://review.openstack.org/138332 | 12:09 |
| tellesnobrega | SergeyLukjanov, alazarev was the one who told me that we should keep this as it was for compatibility porpose | 12:12 |
| tellesnobrega | purpos | 12:13 |
| openstackgerrit | Merged openstack/sahara: Added get_open_ports description to plugin SPI https://review.openstack.org/138203 | 12:19 |
| *** tellesnobrega_ has joined #openstack-sahara | 12:20 | |
| *** k4n0 has quit IRC | 12:28 | |
| openstackgerrit | Abbass Marouni proposed openstack/sahara: Enable HDFS NameNode High Availability with HDP 2.0.6 plugin https://review.openstack.org/132051 | 12:35 |
| SergeyLukjanov | tellesnobrega, the issue now is that we need it to make CLI tests in Tempest passing ;) | 13:00 |
| *** hdd has joined #openstack-sahara | 13:04 | |
| tmckay1 | SergeyLukjanov, I'll take a look. back in a minute | 13:23 |
| *** tmckay1 has quit IRC | 13:23 | |
| openstackgerrit | Andrey Pavlov proposed openstack/python-saharaclient: Saharaclient tests for tempest https://review.openstack.org/130767 | 13:23 |
| *** tmckay has joined #openstack-sahara | 13:24 | |
| tmckay | SergeyLukjanov, thanks for approving https://review.openstack.org/#/c/136843/ I was going to do the same thing this morning if it had not passed | 13:26 |
| *** tellesnobrega_ has quit IRC | 13:26 | |
| tmckay | Do we have anyone investigating ways to make CI more reliable? | 13:26 |
| tmckay | I've talked to elmiko and egafford about it a little bit, but we don't have a lab to use for that purpose | 13:27 |
| openstackgerrit | Merged openstack/sahara: Support searching job executions by cluster name and job name https://review.openstack.org/136843 | 13:28 |
| *** tnovacik has joined #openstack-sahara | 13:32 | |
| *** miqui has joined #openstack-sahara | 13:37 | |
| *** Networkn3rd has joined #openstack-sahara | 13:37 | |
| *** tellesnobrega_ has joined #openstack-sahara | 13:40 | |
| *** Networkn3rd has quit IRC | 13:42 | |
| openstackgerrit | Abbass Marouni proposed openstack/sahara: Enable HDFS NameNode High Availability with HDP 2.0.6 plugin https://review.openstack.org/132051 | 13:42 |
| *** chandankumar has quit IRC | 13:51 | |
| openstackgerrit | Ken Chen proposed openstack/sahara: Specify CDH version https://review.openstack.org/137879 | 13:59 |
| openstackgerrit | Abbass Marouni proposed openstack/sahara: Enable HDFS NameNode High Availability with HDP 2.0.6 plugin https://review.openstack.org/132051 | 14:04 |
| *** _crobertsrh is now known as crobertsrh | 14:04 | |
| tellesnobrega_ | SergeyLukjanov, i see | 14:06 |
| tellesnobrega_ | SergeyLukjanov, but the tempests are failing on your patch | 14:06 |
| SergeyLukjanov | tellesnobrega_, it's failing because of the CLI tests | 14:07 |
| tellesnobrega_ | hum, ok | 14:07 |
| SergeyLukjanov | tellesnobrega_, I'm trying to debug why it's happening | 14:07 |
| tellesnobrega_ | SergeyLukjanov, let me know if you need help | 14:07 |
| SergeyLukjanov | tellesnobrega_, thx | 14:08 |
| *** Longgeek has joined #openstack-sahara | 14:11 | |
| tmckay | SergeyLukjanov, hmm, looks like all the list operations failed | 14:14 |
| SergeyLukjanov | tmckay, oh, I've been talking about the devstack change | 14:14 |
| SergeyLukjanov | tmckay, re ci stability - unfortunately there are too many ways to fail when testing such complex scenarios on openstack master | 14:15 |
| SergeyLukjanov | tmckay, last failures were because of broken release of some dependency of dependency :) | 14:15 |
| tmckay | I was looking at these tempest logs http://logs.openstack.org/32/138332/2/check/gate-tempest-dsvm-src-python-saharaclient/8857ced/console.html | 14:16 |
| tmckay | A bunch of sahara list operation failures | 14:16 |
| *** hdd has quit IRC | 14:16 | |
| *** Longgeek has quit IRC | 14:17 | |
| tmckay | curious, since we recently added optional search params to list ops ... | 14:17 |
| tmckay | oh, okay, it's just the data-processing thing | 14:21 |
| tmckay | scared me for a second :) | 14:21 |
| openstackgerrit | Michael McCune proposed openstack/sahara-specs: Specification Repository Backlog Refactor https://review.openstack.org/137211 | 14:27 |
| tellesnobrega_ | tmckay, yes, its the - vs _ problem | 14:34 |
| tellesnobrega_ | its registered with _ so it can't find the requested - | 14:34 |
| *** egafford has joined #openstack-sahara | 14:37 | |
| tmckay | ack, I've followed through the history now :) I was worried because we changed list() operations recently (but I couldn | 14:38 |
| tmckay | I couldn't think of how it would break :) | 14:38 |
| tmckay | crobertsrh, should we tweak the spec again for filtering job execution on status? Or just roll with it? | 14:43 |
| tmckay | I have a new patch ready | 14:43 |
| crobertsrh | I can tweak it | 14:43 |
| *** Longgeek has joined #openstack-sahara | 14:43 | |
| *** hdd has joined #openstack-sahara | 14:44 | |
| *** Poornima_ has quit IRC | 14:53 | |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara-image-elements: Adding ability to build images for Hadoop 2.6.0 https://review.openstack.org/138391 | 15:12 |
| openstackgerrit | Merged openstack/sahara: Refactoring integration tests for Vanilla 1 plugin https://review.openstack.org/131155 | 15:18 |
| openstackgerrit | Trevor McKay proposed openstack/sahara: Support searching job executions by job status https://review.openstack.org/138396 | 15:20 |
| *** chandankumar has joined #openstack-sahara | 15:32 | |
| alazarev | tellesnobrega, I proposed '-'->'_' change, so default value with '-' is logical for that replace | 15:36 |
| tmckay | crobertsrh, thinking about data sources as arguments. Two basic approaches I can see -- one is UI magic, where the UI has a way to select a data source and extract the path and credentials to set as configs for the total win | 16:07 |
| tmckay | So nothing changes except for "glue" in the UI | 16:07 |
| tmckay | The other way is some method to pass down data source ids to Sahara, and an indicator in the arg list (or somewhere else in the job exec) of where to pass those | 16:08 |
| openstackgerrit | Adrien Vergé proposed openstack/sahara: Inherit Context from oslo https://review.openstack.org/137458 | 16:09 |
| openstackgerrit | Adrien Vergé proposed openstack/sahara: Sync latest context module from oslo-incubator https://review.openstack.org/138417 | 16:09 |
| tmckay | Seems much cleaner to me to have select-and-extract in the UI, but I don't know how hard/viable that might be | 16:09 |
| crobertsrh | UI magic is fine, but it doesn't really help users of the cli/api. Right? | 16:09 |
| tmckay | crobertsrh, correct. That is the other thought I had. | 16:09 |
| crobertsrh | also...the horizon meeting has changed days/times, so I'm no longer busy with that :) | 16:10 |
| tmckay | crobertsrh, so just as a data point, UI magic is viable iyho? | 16:10 |
| crobertsrh | Yes, I do think UI magic is workable. | 16:11 |
| tmckay | I'll take a look at the job submissions stuff and see if there is an obvious way to indicate data sources as args without breaking compatibility | 16:11 |
| tmckay | Then I can draft a blueprint with alternatives | 16:12 |
| crobertsrh | Ok, that sounds like a good start | 16:14 |
| tellesnobrega | alazarev, ok. i think i misunderstood | 16:22 |
| tmckay | crobertsrh, hmm, we could use a script-like substitution mechanism in the arg list, such as $(instance_id) $(output_id) | 16:27 |
| tmckay | I meant input_id | 16:28 |
| crobertsrh | Whatever you think is the most intuitive syntax. script-style might make the most sense. | 16:28 |
| *** tellesnobrega_ has quit IRC | 16:36 | |
| *** tellesnobrega_ has joined #openstack-sahara | 16:38 | |
| openstackgerrit | Merged stackforge/sahara-ci-config: Remove Horizon job https://review.openstack.org/138312 | 16:40 |
| SergeyLukjanov | folks, does anyone want to sync oslo? | 16:44 |
| SergeyLukjanov | we have at least one issue - https://bugs.launchpad.net/sahara/+bug/1391694 | 16:44 |
| uvirtbot | Launchpad bug 1391694 in sahara "Warning message about missing policy.d folder during Sahara start" [Low,Confirmed] | 16:44 |
| SergeyLukjanov | that could be fixed by it | 16:44 |
| SergeyLukjanov | mattf, oslo sync? | 16:44 |
| SergeyLukjanov | mattf, hey | 16:44 |
| *** tellesnobrega_ has quit IRC | 16:47 | |
| elmiko | SergeyLukjanov: i can give it a try if mattf can't get to it today. what's involved with olso sync? | 16:47 |
| SergeyLukjanov | elmiko, mattf has a script to make a sync | 16:49 |
| SergeyLukjanov | elmiko, thanks for volunteering :) | 16:49 |
| SergeyLukjanov | elmiko, in fact it's really very important to make a sync this week - before the Kilo-1 | 16:50 |
| elmiko | SergeyLukjanov: ok, we'll see what's up with mattf. maybe he will share the script ;) | 16:50 |
| SergeyLukjanov | elmiko, or make the sync :) | 16:50 |
| SergeyLukjanov | elmiko, mattf, folks please do it by the end of this week | 16:50 |
| elmiko | preferably =) | 16:51 |
| *** egafford has quit IRC | 17:06 | |
| *** skolekonov has quit IRC | 17:07 | |
| *** witlessb_ has joined #openstack-sahara | 17:09 | |
| *** witlessb has quit IRC | 17:10 | |
| *** witlessb_ is now known as witlessb | 17:10 | |
| tmckay | crobertsrh, one more ping. So data source names are constrained by be unique, it turns out. We can just use name, with some symbol, like *my_input Too C like? | 17:19 |
| *** egafford has joined #openstack-sahara | 17:19 | |
| tmckay | I like it. | 17:19 |
| tmckay | that's easy, and it doesn't require any UI magic | 17:20 |
| * tmckay makes blueprint for people to take shots at | 17:21 | |
| * elmiko loads shot into blueprint blunderbus | 17:33 | |
| crobertsrh | tmckay: I'm ok with that. C-like, but the user won't ever really "c" it :) | 17:41 |
| *** tosky has quit IRC | 17:42 | |
| elmiko | crobertsrh: groan... ;) | 17:42 |
| crobertsrh | I will do better next time | 17:42 |
| *** Longgeek has quit IRC | 17:43 | |
| elmiko | you'll do {...} while(!not_better); next time? | 17:43 |
| elmiko | well, i guess !better would suffice lol | 17:44 |
| crobertsrh | Well, better than that :) | 17:45 |
| elmiko | lol, for sure =) | 17:45 |
| *** Longgeek has joined #openstack-sahara | 17:48 | |
| *** crobertsrh has quit IRC | 17:49 | |
| *** Longgeek_ has joined #openstack-sahara | 17:53 | |
| *** Networkn3rd has joined #openstack-sahara | 17:55 | |
| *** Longgeek has quit IRC | 17:56 | |
| *** Longgeek has joined #openstack-sahara | 17:58 | |
| *** Longgeek_ has quit IRC | 18:01 | |
| *** chandankumar has quit IRC | 18:07 | |
| *** tosky has joined #openstack-sahara | 18:13 | |
| *** tellesnobrega_ has joined #openstack-sahara | 18:26 | |
| *** tmckay is now known as _tmckay | 18:45 | |
| *** tosky has quit IRC | 18:51 | |
| *** crobertsrh has joined #openstack-sahara | 18:52 | |
| *** Longgeek has quit IRC | 18:58 | |
| *** tnovacik has quit IRC | 19:08 | |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara: Storm integration https://review.openstack.org/137699 | 19:17 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Add integration test for Hive EDP job https://review.openstack.org/138495 | 19:21 |
| *** tnovacik has joined #openstack-sahara | 19:28 | |
| *** tellesnobrega_ has quit IRC | 19:34 | |
| openstackgerrit | Chad Roberts proposed openstack/sahara-specs: Updating query filtering support for Sahara https://review.openstack.org/138509 | 19:57 |
| *** Longgeek has joined #openstack-sahara | 19:58 | |
| openstackgerrit | Jamie Lennox proposed openstack/sahara: Don't provide CONF to the AuthProtocol middleware https://review.openstack.org/138211 | 20:03 |
| *** Longgeek has quit IRC | 20:03 | |
| *** tellesnobrega_ has joined #openstack-sahara | 20:19 | |
| *** samuelms-away has quit IRC | 20:29 | |
| *** tellesnobrega_ has quit IRC | 20:30 | |
| *** tellesnobrega has quit IRC | 20:30 | |
| *** samuelms-away has joined #openstack-sahara | 20:42 | |
| *** tellesnobrega has joined #openstack-sahara | 20:42 | |
| *** _tmckay is now known as tmckay | 20:57 | |
| *** stannie has quit IRC | 21:10 | |
| *** openstackgerrit has quit IRC | 21:34 | |
| *** openstackgerrit has joined #openstack-sahara | 21:34 | |
| *** Longgeek has joined #openstack-sahara | 21:48 | |
| *** Longgeek has quit IRC | 21:52 | |
| *** rharwood has joined #openstack-sahara | 21:54 | |
| *** crobertsrh has quit IRC | 22:05 | |
| openstackgerrit | Trevor McKay proposed openstack/sahara: Support searching job executions by job status https://review.openstack.org/138396 | 22:13 |
| *** Networkn3rd has quit IRC | 22:38 | |
| *** tellesnobrega_ has joined #openstack-sahara | 22:47 | |
| *** tellesnobrega_ has quit IRC | 22:57 | |
| *** tellesnobrega_ has joined #openstack-sahara | 23:01 | |
| *** ylobankov has quit IRC | 23:02 | |
| *** ylobankov has joined #openstack-sahara | 23:02 | |
| openstackgerrit | Andrew Lazarev proposed openstack/sahara: Fixed auto security group for nova network https://review.openstack.org/137201 | 23:05 |
| *** egafford has quit IRC | 23:51 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!