| *** jeremyfreudberg has quit IRC | 00:24 | |
| *** dave-mccowan has joined #openstack-sahara | 00:36 | |
| openstackgerrit | Merged openstack/python-saharaclient master: [ut] replace .testr.conf with .stestr.conf https://review.openstack.org/503609 | 00:37 |
|---|---|---|
| openstackgerrit | Merged openstack/sahara master: [ut] replace .testr.conf with .stestr.conf https://review.openstack.org/503603 | 00:37 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-saharaclient master: Updated from global requirements https://review.openstack.org/503492 | 00:42 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara master: Updated from global requirements https://review.openstack.org/502755 | 00:43 |
| *** shuyingya has joined #openstack-sahara | 00:44 | |
| *** shuyingya has quit IRC | 00:48 | |
| *** shuyingya has joined #openstack-sahara | 01:01 | |
| *** shuyingya has quit IRC | 01:04 | |
| *** caowei has joined #openstack-sahara | 01:22 | |
| *** shuyingya has joined #openstack-sahara | 01:28 | |
| openstackgerrit | chao liu proposed openstack/sahara master: Fix a typo in hive-default.xml https://review.openstack.org/503887 | 01:31 |
| openstackgerrit | chao liu proposed openstack/sahara master: Fix a typo in hive-default.xml https://review.openstack.org/503887 | 01:46 |
| *** jeremyfreudberg has joined #openstack-sahara | 03:14 | |
| *** jeremyfreudberg has quit IRC | 03:15 | |
| *** dave-mccowan has quit IRC | 03:39 | |
| openstackgerrit | Merged openstack/sahara master: fix duplicated ntp configuration https://review.openstack.org/502409 | 03:40 |
| *** tosky has joined #openstack-sahara | 03:46 | |
| openstackgerrit | zhongshengping proposed openstack/puppet-sahara master: Deprecate revocation_cache_time option https://review.openstack.org/503930 | 03:53 |
| *** links has joined #openstack-sahara | 04:19 | |
| openstackgerrit | Luigi Toscano proposed openstack/sahara master: Re-add .testr.conf, required by the cover test https://review.openstack.org/503946 | 04:41 |
| *** caowei has quit IRC | 04:44 | |
| *** afazekas has quit IRC | 04:48 | |
| *** afazekas has joined #openstack-sahara | 04:52 | |
| *** tosky has quit IRC | 05:07 | |
| openstackgerrit | Merged openstack/python-saharaclient master: Updated from global requirements https://review.openstack.org/503492 | 05:14 |
| *** pgadiya has joined #openstack-sahara | 05:22 | |
| *** pgadiya has quit IRC | 05:22 | |
| *** openstack has joined #openstack-sahara | 05:31 | |
| *** caowei has joined #openstack-sahara | 05:34 | |
| *** rcernin has joined #openstack-sahara | 05:42 | |
| *** hoonetorg has quit IRC | 05:46 | |
| *** shuyingya has quit IRC | 05:59 | |
| *** shuyingya has joined #openstack-sahara | 06:01 | |
| *** hoonetorg has joined #openstack-sahara | 06:03 | |
| *** shuyingya has quit IRC | 06:17 | |
| *** shuyingya has joined #openstack-sahara | 06:18 | |
| *** anshulbehl has joined #openstack-sahara | 06:24 | |
| *** pcaruana has joined #openstack-sahara | 06:43 | |
| *** pcaruana has quit IRC | 06:46 | |
| *** pcaruana has joined #openstack-sahara | 06:46 | |
| *** rcernin has quit IRC | 06:48 | |
| *** rcernin has joined #openstack-sahara | 06:48 | |
| *** pcaruana has quit IRC | 06:48 | |
| *** pcaruana has joined #openstack-sahara | 06:49 | |
| *** pcaruana has quit IRC | 06:49 | |
| *** pcaruana has joined #openstack-sahara | 06:57 | |
| *** tesseract has joined #openstack-sahara | 07:09 | |
| *** caowei has quit IRC | 08:06 | |
| *** caowei has joined #openstack-sahara | 08:10 | |
| *** anshulbehl has quit IRC | 09:33 | |
| *** anshulbehl has joined #openstack-sahara | 09:49 | |
| *** links has quit IRC | 10:24 | |
| *** anshulbehl has quit IRC | 10:27 | |
| *** anshulbehl has joined #openstack-sahara | 10:35 | |
| *** links has joined #openstack-sahara | 10:41 | |
| *** anshulbehl has quit IRC | 11:05 | |
| *** anshulbehl has joined #openstack-sahara | 11:18 | |
| *** links has quit IRC | 11:39 | |
| *** links has joined #openstack-sahara | 11:52 | |
| *** links has quit IRC | 12:20 | |
| *** chlong__ has quit IRC | 12:25 | |
| *** shuyingya has quit IRC | 12:35 | |
| *** shuyingya has joined #openstack-sahara | 12:59 | |
| *** lucasxu has joined #openstack-sahara | 13:03 | |
| *** shuyingya has quit IRC | 13:03 | |
| *** dave-mccowan has joined #openstack-sahara | 13:05 | |
| *** links has joined #openstack-sahara | 13:13 | |
| *** shuyingya has joined #openstack-sahara | 13:18 | |
| *** shuyingy_ has joined #openstack-sahara | 13:21 | |
| *** shuyingya has quit IRC | 13:22 | |
| *** shuyingy_ has left #openstack-sahara | 13:29 | |
| *** shuyingya has joined #openstack-sahara | 13:30 | |
| *** pcaruana has quit IRC | 13:31 | |
| *** pcaruana has joined #openstack-sahara | 13:34 | |
| *** dave-mccowan has quit IRC | 13:37 | |
| *** anshul has joined #openstack-sahara | 14:01 | |
| *** anshulbehl has quit IRC | 14:02 | |
| *** dave-mccowan has joined #openstack-sahara | 14:08 | |
| *** links has quit IRC | 14:44 | |
| *** tellesnobrega has joined #openstack-sahara | 14:49 | |
| *** anshul has quit IRC | 14:53 | |
| *** shuyingy_ has joined #openstack-sahara | 14:58 | |
| *** shuyingy_ is now known as shuyingya_ | 14:58 | |
| *** shuyingya_ has left #openstack-sahara | 14:58 | |
| *** shuyingya_ has joined #openstack-sahara | 14:58 | |
| *** tosky has joined #openstack-sahara | 14:59 | |
| *** jeremyfreudberg has joined #openstack-sahara | 14:59 | |
| tellesnobrega | shuyingya, are you around? | 15:00 |
| shuyingya_ | Hi online~ | 15:00 |
| shuyingya_ | :) | 15:00 |
| tellesnobrega | we are going to start today with the vanilla plugin with lots of services topic | 15:00 |
| tellesnobrega | if you want to jump in, just ping us here or on the etherpad | 15:01 |
| *** shuyingya has quit IRC | 15:01 | |
| shuyingya_ | ok | 15:01 |
| *** shuyingya_ is now known as shuyingya | 15:02 | |
| *** anshul has joined #openstack-sahara | 15:05 | |
| tellesnobrega | shuyingya, how is the work with hbase going? | 15:06 |
| *** zemuvier has joined #openstack-sahara | 15:06 | |
| shuyingya | I have already finished the work in downstream and works fine until now. | 15:07 |
| shuyingya | But I have to write a specs to get your ideas to make it better. | 15:07 |
| shuyingya | before I post it to upstream | 15:07 |
| tellesnobrega | shuyingya, awesome | 15:07 |
| jeremyfreudberg | AWESOME | 15:08 |
| tellesnobrega | shuyingya, please write that when you can :) | 15:08 |
| shuyingya | the pain point is the scale issue. nodes have zookeeper service should keep in odd number | 15:08 |
| jeremyfreudberg | how are we scaling that on CDH? do we just ignore the rules? | 15:09 |
| shuyingya | CDH only support scale nodes with datanode and nodemanager | 15:10 |
| jeremyfreudberg | shuyingya, ah, right | 15:10 |
| shuyingya | but it loses the flexibility | 15:10 |
| openstackgerrit | Alina Nesterova proposed openstack/sahara-ci-config master: [wip] testcommit https://review.openstack.org/503859 | 15:12 |
| jeremyfreudberg | https://slider.incubator.apache.org/ | 15:15 |
| jeremyfreudberg | ^tosky | 15:15 |
| *** pcaruana has quit IRC | 15:19 | |
| jeremyfreudberg | shuyingya, for zookeeper - you can force the user in the validations, that gets run when cluster first launched and when scaling | 15:28 |
| jeremyfreudberg | and of course good warning and docs and good error message | 15:28 |
| shuyingya | yes, in my downstream product dashboard, I have add a rule to check the number of zookeeper nodes | 15:29 |
| jeremyfreudberg | shuyingya, we're talking about the api for download management private key now | 15:29 |
| jeremyfreudberg | feel free to jump in | 15:29 |
| shuyingya | thanks jeremyfreudberg | 15:30 |
| tellesnobrega | shuyingya, can you explain the issue you have with the management key | 15:32 |
| jeremyfreudberg | or, why you need this feature | 15:32 |
| tellesnobrega | and/or | 15:32 |
| shuyingya | because the keypair if we created from nova didn't save. the cluster will not be able to login.(we don't have password by default) | 15:34 |
| jeremyfreudberg | shuyingya, well, both kinds of keypairs depend on cloud-init | 15:34 |
| tellesnobrega | so, you create a cluster without keypair and you copy that from key from somewhere else? | 15:35 |
| shuyingya | yep, I just don't understand why do we need two keypairs. If we provide the management keypair created by nova and store in sahara.clusters schema, that 's enough | 15:35 |
| shuyingya | otherwise when scale up a cluster, and before that operation, the keypair has been deleted from nova side | 15:36 |
| shuyingya | the processes will fail and cluster will go to Error | 15:36 |
| jeremyfreudberg | well, some people say it's bad practice to be moving around the private key file, usually public key is distributed. but ok, i understand your point about deleted user keypair | 15:37 |
| shuyingya | sorry for the bad English | 15:37 |
| shuyingya | :( | 15:37 |
| jeremyfreudberg | shuyingya, no problem, we understand it well | 15:37 |
| shuyingya | yep. the main problem is that nova doesn't protect the keypair which sahara used | 15:38 |
| tellesnobrega | shuyingya, what if instead of making the management key available for download we do a better error handling, we notify rollback the scale and tell the user that we can't scale that cluster because the private key is no existing | 15:40 |
| shuyingya | But if user loses the private keypair, what should they do? | 15:42 |
| shuyingya | not sure, your idea make sense. or maybe I worry too much | 15:42 |
| tellesnobrega | I'm not sure that it is our responsibility to protect the user on this. | 15:43 |
| tellesnobrega | if the key is on nova, can't he just donwload it again? | 15:43 |
| shuyingya | nope | 15:44 |
| shuyingya | the private key can only be downloaded when they created | 15:44 |
| tellesnobrega | I see | 15:44 |
| shuyingya | but as you say, it is not our responsibility to protect it | 15:45 |
| tellesnobrega | yeah, we are thinking of a simple solution | 15:47 |
| shuyingya | thanks | 15:48 |
| jeremyfreudberg | shuyingya, we are thinking about a separate new api call for "replace/update keypair", and that would be separate from scaling. we aren't sure yet though | 15:50 |
| *** anshul has quit IRC | 15:51 | |
| jeremyfreudberg | shuyingya, on that same note, do you know what other resources users might delete and cause problems? | 15:52 |
| *** zemuvier has quit IRC | 15:52 | |
| shuyingya | sounds good. use the management key to add the keypair to every instances? | 15:52 |
| shuyingya | right | 15:52 |
| *** zemuvier has joined #openstack-sahara | 15:52 | |
| shuyingya | flavor type also can be deleted | 15:54 |
| shuyingya | jeremyfreudberg | 15:54 |
| jeremyfreudberg | yes, we'll use the management key to update the authorized_keys, and we'll also update the cluster's info to use the new keypair when scaling | 15:54 |
| jeremyfreudberg | flavor deletion is something we cannot fix | 15:54 |
| tellesnobrega | that is completely out of our scope | 15:55 |
| shuyingya | but the cluster can still work | 15:55 |
| shuyingya | yes | 15:55 |
| jeremyfreudberg | luckily horizon got rid of flavor edit (which was flavor deletion disguised) so we hopefully see it less | 15:55 |
| shuyingya | the scale process will prompt: Internal server error | 15:55 |
| jeremyfreudberg | shuyingya, so we need to add some validation to fail gracefully for flavor then | 15:55 |
| shuyingya | I think it doesn't matter | 15:55 |
| shuyingya | true | 15:56 |
| jeremyfreudberg | https://github.com/openstack/sahara/blob/master/sahara/service/validations/base.py#L177 - does that not get called on scaling? | 15:56 |
| shuyingya | no | 15:58 |
| jeremyfreudberg | shuyingya, hmm that is a problem | 15:58 |
| shuyingya | it has called. but the 500 error is from nova side | 15:58 |
| shuyingya | let me try | 15:58 |
| jeremyfreudberg | ok, let us know when you can | 15:58 |
| jeremyfreudberg | https://review.openstack.org/#/c/385053/ | 16:00 |
| jeremyfreudberg | http://specs.openstack.org/openstack/sahara-specs/specs/ocata/boot-from-volume.html | 16:00 |
| openstackgerrit | Merged openstack/sahara master: Updated from global requirements https://review.openstack.org/502755 | 16:00 |
| jeremyfreudberg | reminds me of https://bugs.launchpad.net/sahara/+bug/1656835 | 16:02 |
| openstack | Launchpad bug 1656835 in Sahara "Sahara destroys boot code on images of some architectures using each unmounted partition for HDFS" [Undecided,New] | 16:02 |
| *** rcernin has quit IRC | 16:08 | |
| openstackgerrit | Merged openstack/sahara master: Re-add .testr.conf, required by the cover test https://review.openstack.org/503946 | 16:08 |
| tosky | (reference for a faaar future: http://blivet.readthedocs.io/en/latest/intro.html ) | 16:14 |
| jeremyfreudberg | https://www.openstack.org/assets/survey/April2017SurveyReport.pdf | 16:18 |
| *** tesseract has quit IRC | 16:26 | |
| tosky | source of inspiration: https://hortonworks.com/products/data-center/hdp/ | 16:37 |
| shuyingya | I am going to sleep and you guys have a good "vacation" :) thanks for accommodating \o/ | 16:43 |
| zemuvier | tosky: https://review.openstack.org/#/c/443504/ | 16:44 |
| zemuvier | https://github.com/mirantis/stepler | 16:44 |
| jeremyfreudberg | http://stepler.readthedocs.io/horizon.html | 16:45 |
| *** shuyingya has quit IRC | 16:47 | |
| *** shuyingya has joined #openstack-sahara | 16:47 | |
| *** shuyingya has quit IRC | 16:52 | |
| jeremyfreudberg | https://review.openstack.org/#/q/project:openstack/sahara-tests+status:open | 16:54 |
| jeremyfreudberg | https://bugs.launchpad.net/sahara-tests/+bug/1430252 | 16:56 |
| openstack | Launchpad bug 1430252 in OpenStack Data Processing ("Sahara") sahara-tests "Tempest client tests fails because register image failed" [Medium,Confirmed] | 16:56 |
| jeremyfreudberg | https://bugs.launchpad.net/sahara/+bug/1442545 https://bugs.launchpad.net/sahara/+bug/1439433 | 16:59 |
| openstack | Launchpad bug 1442545 in Sahara "[Mapr] error "must have at least 1 volume or ephemeral drive" when set ephemeral drive" [Undecided,Invalid] | 16:59 |
| openstack | Launchpad bug 1439433 in Sahara "[MAPR] Can't create cluster without volumes" [Medium,Fix released] - Assigned to Artem Osadchiy (aosadchiy) | 16:59 |
| *** rcernin has joined #openstack-sahara | 17:34 | |
| jeremyfreudberg | https://github.com/openstack/meteos/blob/master/meteos/cluster/binary/meteos-script-1.6.0.py#L648 https://github.com/openstack/meteos/blob/master/meteos/cluster/binary/meteos-script-1.6.0.py#L695 | 17:40 |
| *** abalutoiu has joined #openstack-sahara | 17:46 | |
| *** tosky has quit IRC | 17:47 | |
| *** jeremyfreudberg has quit IRC | 17:48 | |
| *** jeremyfreudberg has joined #openstack-sahara | 17:48 | |
| *** zemuvier has quit IRC | 17:48 | |
| *** tellesnobrega has quit IRC | 17:49 | |
| *** abalutoiu has quit IRC | 17:51 | |
| *** chlong has joined #openstack-sahara | 17:53 | |
| *** jeremyfreudberg has quit IRC | 17:56 | |
| *** dave-mccowan has quit IRC | 18:02 | |
| *** zemuvier has joined #openstack-sahara | 18:20 | |
| *** tellesnobrega has joined #openstack-sahara | 18:36 | |
| *** tellesnobrega has quit IRC | 18:41 | |
| *** zemuvier has quit IRC | 18:46 | |
| *** dave-mccowan has joined #openstack-sahara | 18:56 | |
| *** zemuvier has joined #openstack-sahara | 18:58 | |
| *** tellesnobrega has joined #openstack-sahara | 19:03 | |
| *** dave-mccowan has quit IRC | 19:07 | |
| *** dave-mccowan has joined #openstack-sahara | 19:08 | |
| *** tosky has joined #openstack-sahara | 19:39 | |
| *** tosky has quit IRC | 20:00 | |
| *** tellesnobrega has quit IRC | 20:04 | |
| *** zemuvier has quit IRC | 20:05 | |
| *** jeremyfreudberg has joined #openstack-sahara | 20:19 | |
| *** lucasxu has quit IRC | 21:13 | |
| *** jeremyfreudberg has quit IRC | 21:45 | |
| *** jeremyfreudberg has joined #openstack-sahara | 21:45 | |
| *** chlong has quit IRC | 22:01 | |
| *** jeremyfreudberg has quit IRC | 22:02 | |
| *** rcernin has quit IRC | 22:14 | |
| *** openstackstatus has joined #openstack-sahara | 23:11 | |
| *** ChanServ sets mode: +v openstackstatus | 23:11 | |
| *** hoonetorg has quit IRC | 23:13 | |
| *** dave-mccowan has quit IRC | 23:23 | |
| *** hoonetorg has joined #openstack-sahara | 23:27 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!