*** kbroughton has joined #savanna | 00:17 | |
*** matsuhashi has joined #savanna | 00:28 | |
*** sacharya has joined #savanna | 00:37 | |
*** nosnos has joined #savanna | 00:38 | |
*** rnirmal has quit IRC | 00:39 | |
*** sacharya has quit IRC | 01:50 | |
*** sacharya has joined #savanna | 01:51 | |
*** matsuhashi has quit IRC | 03:15 | |
*** matsuhashi has joined #savanna | 03:56 | |
*** sacharya1 has joined #savanna | 04:23 | |
*** sacharya has quit IRC | 04:26 | |
*** SergeyLukjanov has joined #savanna | 04:31 | |
*** kbroughton has quit IRC | 05:10 | |
*** akuznetsov has joined #savanna | 05:26 | |
*** sacharya1 has quit IRC | 05:26 | |
*** SergeyLukjanov has quit IRC | 05:29 | |
*** SergeyLukjanov has joined #savanna | 05:42 | |
*** SergeyLukjanov has quit IRC | 05:44 | |
*** IlyaE has joined #savanna | 05:55 | |
*** akuznetsov has quit IRC | 06:25 | |
*** akuznetsov has joined #savanna | 06:26 | |
*** NikitaKonovalov has joined #savanna | 06:28 | |
*** akuznetsov has quit IRC | 06:48 | |
openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Add running hdfs operations from plugin specific user https://review.openstack.org/48232 | 07:36 |
---|---|---|
*** dmitryme has joined #savanna | 07:41 | |
*** SergeyLukjanov has joined #savanna | 07:53 | |
*** macjack has joined #savanna | 08:09 | |
*** SergeyLukjanov has quit IRC | 08:09 | |
*** macjack has quit IRC | 08:10 | |
openstackgerrit | Ilya Tyaptin proposed a change to stackforge/savanna: Trusts for longrunning tasks https://review.openstack.org/44706 | 08:10 |
*** macjack has joined #savanna | 08:11 | |
*** macjack has quit IRC | 08:12 | |
*** SergeyLukjanov has joined #savanna | 08:13 | |
*** gals has joined #savanna | 08:19 | |
*** DinaBelova has joined #savanna | 08:22 | |
*** DinaBelova has quit IRC | 08:43 | |
*** NikitaKonovalov has quit IRC | 08:47 | |
*** IlyaE has quit IRC | 08:49 | |
*** dmitryme has quit IRC | 08:54 | |
*** NikitaKonovalov has joined #savanna | 08:58 | |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/python-savannaclient: Sync with dashboard https://review.openstack.org/48458 | 08:59 |
*** dmitryme has joined #savanna | 09:01 | |
*** alazarev has joined #savanna | 09:16 | |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna-dashboard: Migrate to using python-savannaclient https://review.openstack.org/48607 | 09:16 |
openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna-dashboard: Job configs based on job type https://review.openstack.org/48290 | 09:24 |
openstackgerrit | A change was merged to stackforge/python-savannaclient: Sync with dashboard https://review.openstack.org/48458 | 09:28 |
*** NikitaKonovalov has quit IRC | 09:30 | |
*** dmitryme has quit IRC | 09:59 | |
openstackgerrit | A change was merged to stackforge/savanna: Integration test refactoring https://review.openstack.org/43925 | 10:03 |
*** NikitaKonovalov has joined #savanna | 10:04 | |
openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna: Add /jobs/config-hints/<job_type> REST API call https://review.openstack.org/45419 | 10:04 |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna-dashboard: Job Origins migrated to Jobs https://review.openstack.org/48081 | 10:04 |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna-dashboard: Migrate to using python-savannaclient 0.3a1 https://review.openstack.org/48607 | 10:04 |
*** dmitryme has joined #savanna | 10:07 | |
*** NikitaKonovalov_ has joined #savanna | 10:11 | |
*** NikitaKonovalov has quit IRC | 10:13 | |
*** NikitaKonovalov_ is now known as NikitaKonovalov | 10:13 | |
*** alazarev has quit IRC | 10:19 | |
*** alazarev has joined #savanna | 10:20 | |
*** NikitaKonovalov has quit IRC | 10:23 | |
*** NikitaKonovalov has joined #savanna | 10:24 | |
openstackgerrit | Ilya Tyaptin proposed a change to stackforge/savanna: Trusts for longrunning tasks https://review.openstack.org/44706 | 10:30 |
*** DinaBelova has joined #savanna | 10:30 | |
*** DinaBelova has quit IRC | 10:33 | |
*** alazarev has quit IRC | 10:36 | |
*** NikitaKonovalov has quit IRC | 10:37 | |
*** esmute has quit IRC | 10:37 | |
*** esmute has joined #savanna | 10:47 | |
*** alazarev has joined #savanna | 10:48 | |
*** matsuhashi has quit IRC | 10:52 | |
*** alazarev has quit IRC | 10:54 | |
*** kbroughton has joined #savanna | 11:00 | |
*** alazarev has joined #savanna | 11:08 | |
*** _mattf is now known as mattf | 11:25 | |
openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna: Add /jobs/config-hints/<job_type> REST API call https://review.openstack.org/45419 | 11:34 |
*** NikitaKonovalov has joined #savanna | 11:37 | |
*** matsuhashi has joined #savanna | 11:44 | |
*** NikitaKonovalov has quit IRC | 11:46 | |
*** SergeyLukjanov has quit IRC | 11:55 | |
*** alazarev has quit IRC | 12:01 | |
*** matsuhashi has quit IRC | 12:01 | |
*** alazarev has joined #savanna | 12:03 | |
*** SergeyLukjanov has joined #savanna | 12:05 | |
*** dmitryme has quit IRC | 12:05 | |
*** matsuhashi has joined #savanna | 12:10 | |
*** matsuhashi has quit IRC | 12:11 | |
*** dmitryme has joined #savanna | 12:14 | |
*** gals has quit IRC | 12:17 | |
*** alazarev has quit IRC | 12:21 | |
*** tmckay has quit IRC | 12:28 | |
*** _crobertsrh is now known as crobertsrh | 12:29 | |
*** matsuhashi has joined #savanna | 12:35 | |
*** kbroughton has quit IRC | 12:52 | |
*** kbroughton has joined #savanna | 12:55 | |
*** alazarev has joined #savanna | 12:57 | |
openstackgerrit | Dmitry Mescheryakov proposed a change to stackforge/savanna: Implement threaded SSH for provisioning and Vanilla plugin https://review.openstack.org/48646 | 13:00 |
*** kbroughton has quit IRC | 13:07 | |
*** nosnos has quit IRC | 13:15 | |
openstackgerrit | Yaroslav Lobankov proposed a change to stackforge/savanna: Rename folder "integration_new" to "integration" https://review.openstack.org/48652 | 13:17 |
openstackgerrit | Yaroslav Lobankov proposed a change to stackforge/savanna: Migration to new integration tests https://review.openstack.org/48652 | 13:19 |
*** kbroughton has joined #savanna | 13:26 | |
mattf | any of you guys/gals know how to move the ephemeral instance storage location? i want it off my root partition. | 13:28 |
*** tmckay has joined #savanna | 13:38 | |
crobertsrh | Question: For data sources, it looks like "Swift" is currently the only supported type. Is that correct, or is someone working on additional types? | 13:48 |
aignatov | hi crobertsrh, very good questio, yes it seems we have new one in draft | 13:51 |
aignatov | https://review.openstack.org/#/c/47828/ | 13:51 |
aignatov | I've added you to watch this | 13:52 |
crobertsrh | Thanks | 13:52 |
aignatov | if you want you can take it and check how it works, as I remebered from Renat it works on external HDFS | 13:53 |
aignatov | i didn't check it yet | 13:53 |
SergeyLukjanov | mattf, I've never tried to do it… are you using devstack? | 13:54 |
SergeyLukjanov | I mean AIO installation? | 13:54 |
aignatov | crobertsrh, is Trevor working on this bp https://blueprints.launchpad.net/savanna/+spec/epd-job-origin-from-swift ? | 13:55 |
mattf | SergeyLukjanov, i'm using an rdo havana install | 13:56 |
crobertsrh | aignatov: I believe that he is | 13:56 |
aignatov | so i'm assigning it for him | 13:57 |
aignatov | thanks | 13:57 |
crobertsrh | aignatov: I will take a look at it. I'm about to do some work on the UI for data sources. I will add HDFS as an option there (currently, we have a select box with only one option, which was odd. That's what spawned my original question). | 13:58 |
aignatov | I see | 13:58 |
aignatov | another question from me | 13:58 |
aignatov | about this https://blueprints.launchpad.net/savanna/+spec/epd-job-origin-from-database | 13:59 |
aignatov | it seems it's already implemented | 13:59 |
crobertsrh | Yes, I think it is already implemented....checking to see if it has been merged. | 14:00 |
crobertsrh | Yes, looks like it has been merged, but wasn't really tagged with the blueprint. https://review.openstack.org/#/c/46910/ | 14:01 |
aignatov | hmm, do anyone know how to attach patch to bp directly? | 14:04 |
aignatov | I know ^) | 14:04 |
aignatov | :) | 14:04 |
aignatov | hust add a coment with link to patch) | 14:04 |
aignatov | *just | 14:04 |
openstackgerrit | Yaroslav Lobankov proposed a change to stackforge/savanna: Migration to new integration tests https://review.openstack.org/48652 | 14:09 |
*** rnirmal has joined #savanna | 14:13 | |
crobertsrh | Another question: Is it ok for a UI change request to be set to depend on a savanna-api change request? ie: no problem with a dep across projects? | 14:18 |
SergeyLukjanov | crobertsrh, I don't know how to do it :( | 14:20 |
crobertsrh | Ok, no worries. I just won't do "git review" until the api change is merged. | 14:20 |
SergeyLukjanov | oh :) | 14:20 |
*** tmckay has quit IRC | 14:22 | |
*** tmckay has joined #savanna | 14:31 | |
openstackgerrit | A change was merged to stackforge/savanna-dashboard: Adding on-the-fly script creation https://review.openstack.org/48044 | 14:31 |
openstackgerrit | A change was merged to stackforge/savanna-dashboard: Removing swift-external from job binaries https://review.openstack.org/48114 | 14:32 |
*** matsuhashi has quit IRC | 14:51 | |
openstackgerrit | A change was merged to stackforge/savanna: Add running hdfs operations from plugin specific user https://review.openstack.org/48232 | 14:56 |
aignatov | tmckay, hi | 15:07 |
tmckay | aignatov, hi | 15:07 |
*** dmitryme has quit IRC | 15:08 | |
aignatov | i think this bp https://blueprints.launchpad.net/savanna/+spec/edp-job-configs-params is already implemented | 15:08 |
aignatov | am I correct? | 15:08 |
aignatov | I see only Nadya's patch attached to this bp | 15:09 |
tmckay | well, I think it has changed | 15:09 |
aignatov | https://review.openstack.org/44442 | 15:09 |
tmckay | Job's don't contain configs anymore, only job executions. Jobs only point to binaries | 15:09 |
aignatov | but Nadya's patch talks us that it's partially implemented | 15:09 |
aignatov | so, may we change it's status to Implemented or it's still beta available? | 15:12 |
aignatov | what do you think? | 15:12 |
tmckay | aignatov, if you look at https://review.openstack.org/44442, parts of it are superseded by https://review.openstack.org/#/c/48000/ | 15:13 |
*** DinaBelova has joined #savanna | 15:13 | |
aignatov | oh, I see it, indeed | 15:13 |
tmckay | I think it's implemented. Jobs are configurable with configs, args, and params, that much is true. But all config comes at execution time afaik, there is no way to store config for later use. | 15:14 |
aignatov | agree | 15:14 |
aignatov | I'll change it | 15:14 |
tmckay | okay. | 15:14 |
aignatov | am asking you and Chad about implemented bps ann bugs just to make sure that we didn't missing something) | 15:15 |
tmckay | good idea :) | 15:15 |
tmckay | I lost what I had done for swift internals so far, but most of the time was "learning". There was not much code yet, so I | 15:16 |
*** dmitryme has joined #savanna | 15:16 | |
tmckay | I'll reproduce it today and continue | 15:16 |
aignatov | no problems, I'm also trying to dig deeper into edp to make full comprehension of this activity too :) | 15:19 |
*** IlyaE has joined #savanna | 15:21 | |
crobertsrh | tmckay, anyone else: For data sources, any idea what the urls for swift and hdfs need to look like? I'm working on the UI to provide "hints", but it's unclear to me what they need to be just based on looking at the validation code. | 15:34 |
tmckay | crobertsrh, I imagine data source swift url will be the same as for job binary... that is | 15:37 |
tmckay | swift-internal://contain/object | 15:37 |
crobertsrh | ok, I'll go with that for now | 15:37 |
tmckay | (container that is) | 15:37 |
crobertsrh | hdfs should just be "hdfs://whatever"? | 15:37 |
tmckay | for internal, it means that it's local and keystone provides the endpoints, etc, and fills in the account information. A full swift url is swift://host/account/container/object | 15:38 |
tmckay | but the client puts that stuff together | 15:38 |
tmckay | hdfs, I am unsure... | 15:38 |
*** DinaBelova has quit IRC | 15:42 | |
*** DinaBelova has joined #savanna | 15:49 | |
tmckay | crobertsrh, fyi, based on the latest we won't support swift-external yet, but swift-external I believe means that we need all the information supplied by the user to acess the external, including an auth url if it's not the same, and a user name and password. | 15:51 |
crobertsrh | ok, that is good info | 15:51 |
tmckay | crobertsrh, I believe this stuff would be stored in the job-binary, along with the url. We'll have to confirm with Nadya when she gets back though, I think details are a little fuzzy. | 15:51 |
crobertsrh | ok | 15:52 |
tmckay | croberts, fyi on the master branch the validation for data_source just has "credentials" as type "object" with no other validation | 16:03 |
tmckay | for job_binary, it has an "extra" field that may contain stuff for accessing binaries, assumably for externals | 16:04 |
tmckay | so I think there still is some fuzz | 16:04 |
tmckay | reboot... | 16:04 |
*** tmckay has quit IRC | 16:06 | |
*** tmckay has joined #savanna | 16:19 | |
openstackgerrit | Yaroslav Lobankov proposed a change to stackforge/savanna: Migration to new integration tests https://review.openstack.org/48652 | 16:32 |
*** dmitryme has quit IRC | 16:37 | |
*** dmitryme has joined #savanna | 16:41 | |
*** sacharya has joined #savanna | 16:48 | |
*** DinaBelova has quit IRC | 17:00 | |
*** SergeyLukjanov has quit IRC | 17:03 | |
*** alazarev has quit IRC | 17:09 | |
*** mattf is now known as _mattf | 17:15 | |
tmckay | dmitryme, aignatov, just fyi, crobertsrh repro'd the awful tox -e py27 test on his matching Lenovo T510 with the same dismal performance numbers writing to disk. | 17:16 |
tmckay | as a side project, I am going to try to inject the Python profiler into the tox test and find out why it's so bad | 17:17 |
tmckay | maybe this weekend :) | 17:17 |
*** _mattf is now known as mattf | 17:27 | |
*** _tstclair has quit IRC | 17:37 | |
*** mattf is now known as _mattf | 17:45 | |
*** SergeyLukjanov has joined #savanna | 17:50 | |
*** _mattf is now known as mattf | 17:52 | |
*** tmckay1 has joined #savanna | 17:54 | |
*** DinaBelova has joined #savanna | 18:09 | |
*** IlyaE has quit IRC | 19:01 | |
openstackgerrit | Chad Roberts proposed a change to stackforge/savanna-dashboard: Fixing data-source details view https://review.openstack.org/48725 | 19:10 |
openstackgerrit | Chad Roberts proposed a change to stackforge/savanna-dashboard: Fixing data-source details view https://review.openstack.org/48725 | 19:12 |
*** DinaBelova has quit IRC | 19:17 | |
openstackgerrit | Chad Roberts proposed a change to stackforge/savanna-dashboard: Fixing job-binaries details page. https://review.openstack.org/48729 | 19:24 |
*** IlyaE has joined #savanna | 19:30 | |
*** dmitryme has quit IRC | 19:37 | |
openstackgerrit | Chad Roberts proposed a change to stackforge/savanna-dashboard: Fixing job-binaries details page https://review.openstack.org/48729 | 19:56 |
*** tmckay has left #savanna | 19:57 | |
*** SergeyLukjanov has quit IRC | 19:58 | |
*** mattf is now known as _mattf | 19:59 | |
*** tmckay1 is now known as tmckay | 20:03 | |
*** crobertsrh is now known as _crobertsrh | 20:42 | |
*** rnirmal has quit IRC | 21:11 | |
*** tmckay has left #savanna | 21:30 | |
*** IlyaE has quit IRC | 22:21 | |
*** sacharya has left #savanna | 22:28 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!