Thursday, 2018-06-14

*** ukaynar has joined #openstack-sahara02:27
*** ukaynar has quit IRC02:32
*** dave-mccowan has quit IRC03:45
*** links has joined #openstack-sahara05:00
*** pcaruana has quit IRC05:09
*** pcaruana has joined #openstack-sahara06:17
*** tesseract has joined #openstack-sahara07:16
*** mtsv_ has joined #openstack-sahara07:18
*** mtsv has quit IRC07:23
*** rcernin has quit IRC07:27
*** tosky has joined #openstack-sahara07:37
openstackgerritwangdequn proposed openstack/sahara master: add release notes to readme.rst  https://review.openstack.org/57535607:48
toskyzigo: hi, when you have some time, can you please address the comments on https://review.openstack.org/#/c/573179/? and thanks again for the fix08:22
zigotosky: Ok, doing that now.08:23
openstackgerritThomas Goirand proposed openstack/sahara master: Fix flask.request.content_length is None  https://review.openstack.org/57317908:25
zigotosky: There you go.08:25
toskyzigo: and what about unifying that if with the next one?08:25
zigotosky: I don't agree with it. It fails if you do.08:25
zigoBecause all of the if statement will be run.08:26
zigoThat's not C ... :P08:26
toskyuhm, not short-circuit evaluation? I remembered incorrectly08:26
zigoI don't think there's such thing in Python, is there?08:26
zigoI'm probably mistaking, not sure now that you say that ...08:27
zigoWhen I tried it failed ...08:27
toskyhttps://docs.python.org/2/library/stdtypes.html#boolean-operations-and-or-not08:27
*** mtsv_ is now known as mtsv08:39
mtsv@tosky I tried rebuilding images using both ubuntu and centos7 following this guide https://docs.openstack.org/sahara/latest/user/cdh-imagebuilder.html but I'm still getting this error https://hastebin.com/rugigoxaxo.sql Any more troubleshooting ideas?08:39
toskymtsv: same question as yesterday: can you share the parameters used to configure the node group templates and the cluster template?08:41
mtsvIs there a way to export these?08:42
toskyyes, there is; in the UI, when listing those templates, each element has a combo box on the right; one of the values is "Export Template"08:44
toskyof course it's enough you to remember which fields you changed08:44
mtsvHmm I don't see that option, I'm guessing it was implemented in a later version. I'll try to describe my templates manually.08:55
mtsvI have 3 node groups: ClouderaMasterNode cdh 5.11.0 running CLOUDERA_MANAGER; ClouderaSlaveNodecdh 5.11.0 running,  ZOOKEEPER_SERVER, YARN_RESOURCEMANAGER, YARN_NODEMANAGER, YARN_JOBHISTORY, YARN_STANDBYRM, HBASE_MASTER, HBASE_REGIONSERVER, HDFS_NAMENODE, HDFS_DATANODE, HDFS_SECONDARYNAMENODE and HDFS_JOURNALNODE; and HDFScdh 5.11.0 running HDFS_DATANODE and HDFS_JOURNALNODE;08:56
mtsvIn the cluster template I have cdh 5.11.0; 1 ClouderaMasterNode, 1 ClouderaSlaveNode and 2 HDFS nodes. Anti-affinity groups for YARN_RESOURCEMANAGER, YARN_STANDBYRM, HDFS_NAMENODE, and HDFS_SECONDARYNAMENODE.08:56
toskyand what about the network configuration? Did you use floating IPs on all nodes, or a proxy?08:59
toskythe configuration that I usually test is described in the sahara-tests repository, namely this file:09:00
toskyhttp://git.openstack.org/cgit/openstack/sahara-tests/tree/sahara_tests/scenario/defaults/pike/cdh-5.9.0.yaml.mako09:00
toskyif you have some time, can you please try to create a configuration like that one? I guess you don't need to saparate master and master-additional nodes09:01
mtsvI'm not assigning floating IPs and I don't have the proxy enabled either. Do I need either of those?09:01
toskysahara server needs to reach the nodes09:01
mtsvI'll give it a try09:01
toskyso either you do it through floating IPs (all nodes, or a proxy) or sahara-engine should be able to reach the private tenant network assigned to the nodes (management network)09:02
toskythat depends on your network configuration09:02
*** links has quit IRC09:33
*** links has joined #openstack-sahara09:33
openstackgerritLuigi Toscano proposed openstack/sahara-tests master: Basic template for CDH 5.13.0  https://review.openstack.org/57476910:19
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara-dashboard master: Boot from volume  https://review.openstack.org/57522712:09
*** dave-mccowan has joined #openstack-sahara13:00
*** dave-mccowan has quit IRC13:05
*** dave-mccowan has joined #openstack-sahara13:10
openstackgerritMerged openstack/sahara-image-elements master: Add support to build 3.0.1 image  https://review.openstack.org/57192313:19
*** mtsv has quit IRC13:32
*** zchkun has joined #openstack-sahara13:52
toskytellesnobrega: hi! Regarding https://storyboard.openstack.org/#!/story/2002183, I'm going to add a task for the tests under sahara-tests13:52
*** dave-mccowan has quit IRC13:52
toskyand I was wondering if I should add a task for sahara-image-elements too, or whether we want to support only the new way for that13:53
openstackgerritJeremy Freudberg proposed openstack/sahara-dashboard master: Fix _cls_registry type  https://review.openstack.org/57543713:55
openstackgerritLuigi Toscano proposed openstack/sahara-tests master: Basic template for CDH 5.13.0  https://review.openstack.org/57476913:56
*** jeremyfreudberg has joined #openstack-sahara13:56
tellesnobregatosky, we can discuss it at the meeting14:01
*** zchkun has quit IRC14:05
*** zchkun has joined #openstack-sahara14:05
*** mtsv has joined #openstack-sahara14:06
*** links has quit IRC14:15
*** jeremyfreudberg_ has joined #openstack-sahara14:15
*** jeremyfreudberg has quit IRC14:18
*** jeremyfreudberg_ is now known as jeremyfreudberg14:19
*** dave-mccowan has joined #openstack-sahara14:26
*** zchkun has quit IRC14:56
*** jeremyfreudberg has quit IRC14:57
openstackgerritLuigi Toscano proposed openstack/sahara master: Remove any reference to pre-built images  https://review.openstack.org/57546615:13
*** pcaruana has quit IRC15:24
*** vinaykns has joined #openstack-sahara15:53
openstackgerritMerged openstack/sahara master: add release notes to readme.rst  https://review.openstack.org/57535616:02
*** vinaykns has left #openstack-sahara16:03
*** vinaykns has joined #openstack-sahara16:09
*** vinaykns has left #openstack-sahara16:09
openstackgerritLuigi Toscano proposed openstack/sahara-tests master: WIP Switch sahara-scenario to stestr  https://review.openstack.org/57548916:25
tosky(this will fail for sure)16:25
*** tesseract has quit IRC17:30
*** dave-mccowan has quit IRC17:30
*** pcaruana has joined #openstack-sahara17:43
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Boot from volume  https://review.openstack.org/38505317:59
*** pcaruana has quit IRC18:01
*** pcaruana has joined #openstack-sahara18:06
*** jeremyfreudberg has joined #openstack-sahara18:45
jeremyfreudberghas anyone (tellesnobrega) launched a vanilla cluster on a current image recently? i'm having an issue with oozie18:47
tellesnobregaI have not18:47
tellesnobregawhat issue are you seeing?18:47
jeremyfreudberghttp://paste.openstack.org/raw/723498/18:48
tellesnobregahmm, no idea what that is about18:48
jeremyfreudberg(just to note,  the cluster still launches okay, because our "start oozie" step just does something like curl host:11000 but doesn't actually check to see if the response is good)18:49
jeremyfreudbergyeah, it's a weird error18:49
tellesnobregawe should double check that18:50
*** dave-mccowan has joined #openstack-sahara18:52
*** jeremyfreudberg has quit IRC18:52
zigotosky: ok, will fix my patch (just saw the meeting logs)20:47
toskythanks!20:47
tellesnobregatosky, since you are around20:53
tellesnobregado you know where in the python-saharaclient tests we mock the address to the update call?20:54
tellesnobregahttps://github.com/openstack/python-saharaclient/blob/master/saharaclient/api/node_group_templates.py#L12720:55
tellesnobregathis call here20:55
toskytellesnobrega: uhm, not sure; from a quick check, I think it's related to requests-mock and its usage here: http://git.openstack.org/cgit/openstack/python-saharaclient/tree/saharaclient/tests/unit/base.py21:06
tellesnobregahm21:07
tellesnobregabecause, on v2, we don't use _update, we use _patch and the test is complaining that path is not mocked21:08
toskyis the entry point of the URL different? (I know, I could check)21:11
tellesnobregaPATCH http://localhost:8386/node-group-templates/id that is the url21:11
tellesnobregamaybe requests_mock doesn't support patch yet?21:12
toskyIdon'tknow21:18
toskytellesnobrega: oh, see the code of that function21:19
tellesnobregaI tihnk i got it21:19
toskyself.responses.post is defined21:19
tellesnobregayes21:19
toskyself.responses.put is defined21:19
toskybut the .patch is not21:20
tellesnobregaI have to change to patch21:20
toskythe only thing I'm not sure is how to make that to work with v221:20
toskyI guess you are creating a copy of each file?21:20
tellesnobregaI created a new class for v221:20
toskyoki21:20
tellesnobregacopied only create and update method21:21
tellesnobregaI will send a patch once the tests are ok21:21
tellesnobregaclient side done21:26
tellesnobreganow I need to make CLI tests work with the correct version of the client21:26
tellesnobregathat is work for tomorrow I guess21:26
tellesnobregaor maybe later21:26
tellesnobregathanks tosky21:26
*** dave-mccowan has quit IRC21:45
*** rcernin has joined #openstack-sahara22:20
openstackgerritLuigi Toscano proposed openstack/sahara-tests master: Port away from ostestr/testr and use stestr  https://review.openstack.org/57548922:37
*** tosky has quit IRC22:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!