*** sacharya has joined #savanna | 00:02 | |
*** sacharya has quit IRC | 00:22 | |
*** NikitaKonovalov has joined #savanna | 00:30 | |
*** NikitaKonovalov has quit IRC | 00:35 | |
*** dina_belova has joined #savanna | 00:41 | |
*** dina_belova has quit IRC | 00:46 | |
*** sacharya has joined #savanna | 00:58 | |
*** NikitaKonovalov has joined #savanna | 01:31 | |
*** NikitaKonovalov has quit IRC | 01:36 | |
*** dina_belova has joined #savanna | 01:42 | |
*** _mattf is now known as mattf | 01:43 | |
*** dina_belova has quit IRC | 01:46 | |
*** NikitaKonovalov has joined #savanna | 02:31 | |
*** NikitaKonovalov has quit IRC | 02:36 | |
*** dina_belova has joined #savanna | 02:42 | |
*** dina_belova has quit IRC | 02:47 | |
*** NikitaKonovalov has joined #savanna | 03:32 | |
*** akuznetsov has joined #savanna | 03:33 | |
*** sacharya has quit IRC | 03:35 | |
*** NikitaKonovalov has quit IRC | 03:36 | |
*** dina_belova has joined #savanna | 03:43 | |
*** dina_belova has quit IRC | 03:48 | |
*** akuznetsov has quit IRC | 04:14 | |
*** NikitaKonovalov has joined #savanna | 04:33 | |
*** NikitaKonovalov has quit IRC | 04:38 | |
*** dina_belova has joined #savanna | 04:43 | |
*** dina_belova has quit IRC | 04:47 | |
*** akuznetsov has joined #savanna | 04:50 | |
*** SergeyLukjanov has joined #savanna | 05:16 | |
*** akuznetsov has quit IRC | 05:34 | |
*** akuznetsov has joined #savanna | 05:34 | |
*** akuznetsov has quit IRC | 05:41 | |
*** dina_belova has joined #savanna | 05:44 | |
*** dina_belova has quit IRC | 05:48 | |
*** dmitryme has joined #savanna | 06:17 | |
*** NikitaKonovalov has joined #savanna | 06:26 | |
*** dina_belova has joined #savanna | 06:44 | |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna: Neutron support https://review.openstack.org/44001 | 06:45 |
---|---|---|
*** dina_belova has quit IRC | 06:49 | |
*** dina_belova has joined #savanna | 07:01 | |
*** beginer has joined #savanna | 07:49 | |
*** akuznetsov has joined #savanna | 08:01 | |
*** ruhe has joined #savanna | 08:03 | |
*** akuznetsov has quit IRC | 08:06 | |
*** SergeyLukjanov has quit IRC | 08:24 | |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna: Neutron support https://review.openstack.org/44001 | 08:33 |
*** akuznetsov has joined #savanna | 08:45 | |
*** dina_belova has quit IRC | 08:45 | |
*** nprivalova has joined #savanna | 08:45 | |
*** dina_belova has joined #savanna | 08:46 | |
*** dina_belova has quit IRC | 08:50 | |
*** dina_belova has joined #savanna | 08:53 | |
*** NikitaKonovalov has quit IRC | 08:59 | |
*** SergeyLukjanov has joined #savanna | 09:04 | |
*** dina_belova has quit IRC | 09:12 | |
*** dina_belova has joined #savanna | 09:13 | |
*** dina_belova has quit IRC | 09:15 | |
*** dina_belova has joined #savanna | 09:15 | |
*** NikitaKonovalov has joined #savanna | 09:29 | |
*** dina_belova has quit IRC | 09:36 | |
*** dina_belova has joined #savanna | 09:36 | |
*** NikitaKonovalov has quit IRC | 09:37 | |
openstackgerrit | A change was merged to stackforge/savanna: Upgrade oslo and add periodic_task module https://review.openstack.org/43735 | 09:38 |
*** dina_belova has quit IRC | 09:40 | |
*** NikitaKonovalov has joined #savanna | 09:43 | |
*** SergeyLukjanov has quit IRC | 09:54 | |
*** SergeyLukjanov has joined #savanna | 09:59 | |
*** ruhe has quit IRC | 10:20 | |
*** nprivalova has quit IRC | 10:25 | |
openstackgerrit | Ivan Berezovskiy proposed a change to stackforge/savanna-extra: Add diskimage-creating script, elements for mirrors https://review.openstack.org/43916 | 10:35 |
openstackgerrit | Ivan Berezovskiy proposed a change to stackforge/savanna-extra: Add diskimage-creating script, elements for mirrors https://review.openstack.org/43916 | 10:36 |
*** ivan1 has joined #savanna | 10:40 | |
*** dina_belova has joined #savanna | 10:47 | |
*** dina_belova has quit IRC | 10:51 | |
*** nprivalova has joined #savanna | 10:53 | |
*** ruhe has joined #savanna | 11:00 | |
*** dina_belova has joined #savanna | 11:04 | |
openstackgerrit | Ivan Berezovskiy proposed a change to stackforge/savanna-extra: Add diskimage-creating script, elements for mirrors https://review.openstack.org/43916 | 11:07 |
*** NikitaKonovalov has quit IRC | 11:34 | |
*** NikitaKonovalov has joined #savanna | 11:37 | |
*** sacharya has joined #savanna | 11:41 | |
openstackgerrit | Alexander Kuznetsov proposed a change to stackforge/savanna: Added job execution after cluster start and operation for job execution https://review.openstack.org/43470 | 11:42 |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna: Neutron support https://review.openstack.org/44001 | 11:46 |
openstackgerrit | Ivan Berezovskiy proposed a change to stackforge/savanna-extra: Add diskimage-creating script, elements for mirrors https://review.openstack.org/43916 | 11:55 |
*** ruhe has quit IRC | 11:59 | |
*** NikitaKonovalov has quit IRC | 12:04 | |
openstackgerrit | Alexander Kuznetsov proposed a change to stackforge/python-savannaclient: Added support for Job Binaries and Job Executions API https://review.openstack.org/44038 | 12:05 |
*** nprivalova has quit IRC | 12:11 | |
*** NikitaKonovalov has joined #savanna | 12:14 | |
*** sacharya has quit IRC | 12:15 | |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Get rid of pycrypto dep https://review.openstack.org/44040 | 12:19 |
*** dmitryme has quit IRC | 12:19 | |
openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna: Added hive workflow creator https://review.openstack.org/44041 | 12:20 |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna: Neutron support https://review.openstack.org/44001 | 12:33 |
*** nprivalova has joined #savanna | 12:35 | |
*** beginer has quit IRC | 12:42 | |
*** ruhe has joined #savanna | 12:44 | |
openstackgerrit | Alexander Kuznetsov proposed a change to stackforge/savanna: Added job execution after cluster start and operation for job execution https://review.openstack.org/43470 | 12:45 |
*** dina_belova has quit IRC | 12:50 | |
*** dmitryme has joined #savanna | 12:51 | |
*** dina_belova has joined #savanna | 12:51 | |
*** dina_belova has quit IRC | 12:55 | |
*** SergeyLukjanov has quit IRC | 12:56 | |
*** SergeyLukjanov has joined #savanna | 13:02 | |
*** dina_belova has joined #savanna | 13:02 | |
*** tmckay has quit IRC | 13:03 | |
*** NikitaKonovalov has quit IRC | 13:18 | |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Install configs to share/savanna from etc/savanna https://review.openstack.org/44049 | 13:22 |
*** ruhe has quit IRC | 13:23 | |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Get rid of pycrypto dep https://review.openstack.org/44040 | 13:25 |
openstackgerrit | Yaroslav Lobankov proposed a change to stackforge/savanna: Integration test refactoring https://review.openstack.org/43925 | 13:26 |
openstackgerrit | Alexander Kuznetsov proposed a change to stackforge/savanna: Added job execution after cluster start and operation for job execution https://review.openstack.org/43470 | 13:34 |
openstackgerrit | Alexander Kuznetsov proposed a change to stackforge/python-savannaclient: Added support for Job Binaries and Job Executions API https://review.openstack.org/44038 | 13:34 |
openstackgerrit | Alexander Kuznetsov proposed a change to stackforge/savanna: Added job execution after cluster start and operation for job execution https://review.openstack.org/43470 | 13:39 |
openstackgerrit | Alexander Kuznetsov proposed a change to stackforge/python-savannaclient: Added support for Job Binaries and Job Executions API https://review.openstack.org/44038 | 13:44 |
*** sacharya has joined #savanna | 13:44 | |
*** NikitaKonovalov has joined #savanna | 13:44 | |
*** NikitaKonovalov has quit IRC | 13:45 | |
*** NikitaKonovalov has joined #savanna | 13:46 | |
*** dina_belova has quit IRC | 13:47 | |
*** dina_belova has joined #savanna | 13:47 | |
*** ruhe has joined #savanna | 13:51 | |
*** dina_belova has quit IRC | 13:52 | |
*** ruhe has quit IRC | 13:57 | |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna-dashboard: Neutron support https://review.openstack.org/44054 | 14:00 |
*** ruhe has joined #savanna | 14:01 | |
openstackgerrit | Vadim Rovachev proposed a change to stackforge/savanna: Added corrections to the documentation https://review.openstack.org/44055 | 14:01 |
*** ruhe has quit IRC | 14:04 | |
*** tmckay has joined #savanna | 14:09 | |
*** rnirmal has joined #savanna | 14:09 | |
*** akuznetsov has quit IRC | 14:11 | |
*** dina_belova has joined #savanna | 14:18 | |
*** nprivalova has quit IRC | 14:19 | |
*** dina_belova has quit IRC | 14:21 | |
*** dina_belova has joined #savanna | 14:21 | |
openstackgerrit | Jonathan Maron proposed a change to stackforge/savanna: Enable the scaling up of nodes in a cluster https://review.openstack.org/43532 | 14:23 |
*** akuznetsov has joined #savanna | 14:25 | |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna-dashboard: Neutron support https://review.openstack.org/44054 | 14:26 |
*** NikitaKonovalov has quit IRC | 14:26 | |
*** IlyaE has joined #savanna | 14:32 | |
tmckay | nprivalova, akuznetsov, I think I can make URLs for job binaries "normal", so that JobOrigin records can just list a URL. "http://<savanna-host-port>/job-binaries/<id>/data" can retrieve raw data if we use "return data.encode('string_escape')" as the return result of the API function. This gives the data back in the same form as it is received in job_binary_create. From there, it can be copied, written to disk, etc. What do you think? | 14:37 |
tmckay | That way, we don't need any special indicator for "internal db" | 14:38 |
openstackgerrit | A change was merged to stackforge/savanna: Install configs to share/savanna from etc/savanna https://review.openstack.org/44049 | 14:39 |
*** NikitaKonovalov has joined #savanna | 14:40 | |
akuznetsov | I think this is a good idea. | 14:40 |
openstackgerrit | A change was merged to stackforge/savanna: Add support of periodic tasks for edp needs https://review.openstack.org/43626 | 14:42 |
*** sacharya has quit IRC | 14:42 | |
openstackgerrit | Alexander Kuznetsov proposed a change to stackforge/savanna: Added job execution after cluster start and operation for job execution https://review.openstack.org/43470 | 14:53 |
*** ruhe has joined #savanna | 14:58 | |
tmckay | akuznetsov, thanks | 15:00 |
tmckay | I'll put up a CR soon with an addition to the job-binaries API | 15:01 |
*** nprivalova has joined #savanna | 15:02 | |
tmckay | nprivalova, hi, do you have scrollback handy? If not I can repost a comment from a few minutes ago. | 15:04 |
tmckay | brb | 15:05 |
*** dina_belova has quit IRC | 15:06 | |
*** dina_belova has joined #savanna | 15:07 | |
nprivalova | tmckay, hi! | 15:09 |
nprivalova | tmckay, I'm ok with your idea | 15:10 |
*** dina_belova has quit IRC | 15:11 | |
tmckay | nprivalova, great, thanks. I think it will simplify things | 15:11 |
*** sacharya has joined #savanna | 15:15 | |
nprivalova | tmckay, akuznetsov, crobertsrh, JFYI we'd like to have 3 main flows: mr, pig and hive. To make mr work we need to send configs through POST into job_execute. Our url is @rest.post('/jobs/<job_id>/execute/from/<input_id>/to/<output_id>/on/' | 15:22 |
nprivalova | '<cluster_id>') . Currently we don't use data from this request, but we should. So I'd like to starting on this part (adding additional field 'param' in JobExecution, validation e.g.). Besides it is needed not to breake transient cluster starting | 15:22 |
tmckay | nprivalova, sounds good to me | 15:23 |
*** rnirmal has quit IRC | 15:23 | |
*** rnirmal has joined #savanna | 15:24 | |
*** NikitaKonovalov has quit IRC | 15:30 | |
akuznetsov | nprivalova agree | 15:31 |
openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Fix "Broken Cinder Volume" https://review.openstack.org/44079 | 15:37 |
crobertsrh | nprivalova: That sounds reasonable to me (sorry, I didn't hear my "bing" when you messaged). | 15:42 |
openstackgerrit | Vadim Rovachev proposed a change to stackforge/savanna: Integration tests refactoring https://review.openstack.org/44080 | 15:44 |
tmckay | question to all, are there tests for the REST api itself? I see tests for the conductor, but I am not aware of http tests. Do they exist? | 15:44 |
*** sacharya has left #savanna | 15:45 | |
*** sacharya has joined #savanna | 15:45 | |
rnirmal | tmckay: there's tests for api validation if that's what you are looking for.. don't think there's functional/unit http api tests | 15:46 |
tmckay | rnirmal, I'm thinking of something that parses responses and makes sure they are of the correct form, and that expected errors are returned, etc. | 15:48 |
tmckay | for instance, we expect wrapped responses but that's easy to miss (unless someone has sharp eyes in a code review) | 15:49 |
ruhe | UT coverage is a subject for improvement. see http://jenkins.savanna.mirantis.com/job/gate-savanna-coverage/331/cobertura/? | 15:50 |
rnirmal | tmckay: I see that would be good to add... I've added some as part of a bug fix https://github.com/stackforge/savanna/blob/master/savanna/tests/unit/service/validation/test_cluster_create_validation.py#L328 | 15:50 |
rnirmal | is that what you are thinking of ? | 15:51 |
*** ruhe has quit IRC | 15:52 | |
*** ivan1 has left #savanna | 15:54 | |
tmckay | rnirmal, yes, that's pretty close I think. The data looks like JSON -- it's just a level or two below the actual v10.py REST api, if I understand it correctly. | 15:54 |
rnirmal | right it's passing in json.. but not invoking the rest api | 15:56 |
tmckay | rnirmal, for that matter, we haven't added any edp service validation tests that I can see.. | 15:56 |
tmckay | all the tests are under the conductor. | 15:57 |
tmckay | I wonder if there are appropriate tests to add to service validation | 15:57 |
tmckay | maybe something to swing back to | 15:57 |
rnirmal | yeah there's definitely opportunities to add more tests | 15:57 |
rnirmal | tmckay: like plugin validations? | 15:58 |
tmckay | rnirmal, I'm not familiar with the plugin validations. Essentially, it seems to me that we should be able to create automated tests for good/bad REST requests and ensure proper responses. It feels like something is missing without it :) | 16:01 |
tmckay | I have been living in the REST api for edp so it's on my mind ;-) | 16:02 |
tmckay | so, I would acutally use httplib or urllib or some other wrapper and send requests all the way through, and examine the responses. | 16:04 |
rnirmal | tmckay: yeah that would definitely be nice to have. I know nova used to have stubs for the wsgi layer | 16:06 |
rnirmal | to make actual http requests and examine responses. It could also fall under the integration tests.. where nothing need to be mocked | 16:07 |
tmckay | rnirmal, I'll make a note to add a bug (request for enhancement, some say) for this. | 16:08 |
rnirmal | :) that would be a good addition to the tests | 16:09 |
*** akuznetsov has quit IRC | 16:12 | |
*** dmitryme has quit IRC | 16:15 | |
*** NikitaKonovalov has joined #savanna | 16:15 | |
*** dina_belova has joined #savanna | 16:17 | |
*** nprivalova has quit IRC | 16:19 | |
*** dina_belova has quit IRC | 16:22 | |
*** ruhe has joined #savanna | 16:33 | |
*** dmitryme has joined #savanna | 16:33 | |
*** SergeyLukjanov has quit IRC | 16:40 | |
*** ruhe has quit IRC | 16:42 | |
*** ruhe has joined #savanna | 16:42 | |
*** NikitaKonovalov has quit IRC | 16:47 | |
*** NikitaKonovalov has joined #savanna | 16:47 | |
*** IlyaE has quit IRC | 16:52 | |
*** dina_belova has joined #savanna | 16:54 | |
*** ruhe has quit IRC | 16:59 | |
* tmckay thinks "six" is a bad name for a compatibility lilbrary in Python | 16:59 | |
tmckay | cute, but bad | 16:59 |
*** mattf is now known as _mattf | 17:04 | |
*** SergeyLukjanov has joined #savanna | 17:05 | |
*** NikitaKonovalov has quit IRC | 17:10 | |
*** ruhe has joined #savanna | 17:10 | |
*** NikitaKonovalov has joined #savanna | 17:11 | |
*** IlyaE has joined #savanna | 17:17 | |
*** _mattf is now known as mattf | 17:23 | |
openstackgerrit | A change was merged to stackforge/savanna: Enable the scaling up of nodes in a cluster https://review.openstack.org/43532 | 17:26 |
openstackgerrit | Yaroslav Lobankov proposed a change to stackforge/savanna: Integration test refactoring https://review.openstack.org/43925 | 17:34 |
*** ruhe has quit IRC | 17:37 | |
*** dmitryme has quit IRC | 17:46 | |
*** NikitaKonovalov has quit IRC | 17:46 | |
*** NikitaKonovalov has joined #savanna | 17:47 | |
*** NikitaKonovalov has quit IRC | 17:51 | |
*** NikitaKonovalov has joined #savanna | 17:52 | |
*** NikitaKonovalov has quit IRC | 17:55 | |
*** NikitaKonovalov has joined #savanna | 17:56 | |
*** NikitaKonovalov has quit IRC | 18:03 | |
*** NikitaKonovalov has joined #savanna | 18:05 | |
*** akuznetsov has joined #savanna | 18:09 | |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Get rid of pycrypto dep https://review.openstack.org/44040 | 18:10 |
*** NikitaKonovalov has quit IRC | 18:21 | |
*** IlyaE has quit IRC | 18:22 | |
*** NikitaKonovalov has joined #savanna | 18:22 | |
*** akuznetsov has quit IRC | 18:30 | |
*** akuznetsov has joined #savanna | 18:32 | |
*** openstack has joined #savanna | 18:46 | |
*** dkoryavov has joined #savanna | 18:55 | |
*** dkoryavov has left #savanna | 18:55 | |
*** SergeyLukjanov has quit IRC | 18:58 | |
*** SergeyLukjanov has joined #savanna | 18:59 | |
*** IlyaE has joined #savanna | 19:04 | |
*** akuznetsov has quit IRC | 19:17 | |
*** IlyaE has quit IRC | 19:20 | |
*** NikitaKonovalov has quit IRC | 19:26 | |
*** dmitryme has joined #savanna | 19:36 | |
*** IlyaE has joined #savanna | 19:38 | |
*** mattf is now known as _mattf | 19:38 | |
openstackgerrit | Trevor McKay proposed a change to stackforge/savanna: Extend JobBinary REST api to allow retrieval of raw data https://review.openstack.org/44088 | 19:39 |
*** dina_belova has quit IRC | 20:00 | |
*** dina_belova has joined #savanna | 20:01 | |
*** IlyaE has quit IRC | 20:01 | |
*** SergeyLukjanov has quit IRC | 20:05 | |
*** dina_belova has quit IRC | 20:05 | |
*** NikitaKonovalov has joined #savanna | 20:27 | |
*** NikitaKonovalov has quit IRC | 20:31 | |
*** crobertsrh is now known as _crobertsrh | 20:50 | |
*** dmitryme has quit IRC | 20:55 | |
*** tmckay has quit IRC | 20:57 | |
*** dina_belova has joined #savanna | 21:01 | |
*** dina_belova has quit IRC | 21:05 | |
*** dina_belova has joined #savanna | 21:11 | |
*** dina_belova has quit IRC | 21:15 | |
*** NikitaKonovalov has joined #savanna | 21:27 | |
*** NikitaKonovalov has quit IRC | 21:32 | |
*** sacharya has quit IRC | 21:41 | |
*** dina_belova has joined #savanna | 22:12 | |
*** dina_belova has quit IRC | 22:16 | |
*** IlyaE has joined #savanna | 22:18 | |
*** _mattf is now known as mattf | 22:19 | |
*** NikitaKonovalov has joined #savanna | 22:27 | |
*** NikitaKonovalov has quit IRC | 22:32 | |
*** sacharya has joined #savanna | 22:53 | |
*** dina_belova has joined #savanna | 23:12 | |
*** dina_belova has quit IRC | 23:16 | |
*** NikitaKonovalov has joined #savanna | 23:28 | |
*** NikitaKonovalov has quit IRC | 23:32 | |
*** sacharya has quit IRC | 23:43 | |
*** rnirmal has quit IRC | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!