| *** nosnos has joined #savanna | 00:16 | |
| *** kbroughton has joined #savanna | 00:24 | |
| *** matsuhashi has joined #savanna | 00:35 | |
| *** sacharya has quit IRC | 00:42 | |
| *** IlyaE has joined #savanna | 01:10 | |
| *** sacharya has joined #savanna | 01:10 | |
| *** IlyaE has quit IRC | 01:21 | |
| *** tmckay has left #savanna | 01:30 | |
| *** IlyaE has joined #savanna | 01:47 | |
| *** SergeyLukjanov has joined #savanna | 02:03 | |
| *** SergeyLukjanov has quit IRC | 02:03 | |
| *** SergeyLukjanov has joined #savanna | 02:04 | |
| openstackgerrit | A change was merged to stackforge/savanna: Bump oslo.config version to use Havana release https://review.openstack.org/48060 | 02:08 |
|---|---|---|
| *** SergeyLukjanov has quit IRC | 03:05 | |
| *** nosnos has quit IRC | 03:40 | |
| *** nosnos has joined #savanna | 03:41 | |
| *** nosnos has quit IRC | 03:42 | |
| *** nosnos has joined #savanna | 03:44 | |
| *** tstclair has quit IRC | 03:54 | |
| *** tstclair has joined #savanna | 03:58 | |
| *** tstclair has quit IRC | 04:04 | |
| *** tstclair has joined #savanna | 04:05 | |
| *** IlyaE has quit IRC | 04:19 | |
| *** sacharya has quit IRC | 04:26 | |
| *** IlyaE has joined #savanna | 04:35 | |
| *** nadya has joined #savanna | 04:45 | |
| *** nadya has quit IRC | 04:55 | |
| *** nadya has joined #savanna | 05:01 | |
| *** kbroughton has quit IRC | 05:09 | |
| *** nadya has quit IRC | 05:10 | |
| *** DinaBelova has joined #savanna | 05:11 | |
| *** kbroughton has joined #savanna | 05:11 | |
| *** SergeyLukjanov has joined #savanna | 05:18 | |
| *** SergeyLukjanov has quit IRC | 05:18 | |
| *** DinaBelova has quit IRC | 05:48 | |
| *** DinaBelova has joined #savanna | 05:53 | |
| *** akuznetsov has joined #savanna | 06:02 | |
| *** DinaBelova has quit IRC | 06:33 | |
| *** nadya has joined #savanna | 06:40 | |
| *** akuznetsov has quit IRC | 06:54 | |
| *** akuznetsov has joined #savanna | 06:56 | |
| *** kbroughton has quit IRC | 07:03 | |
| *** IlyaE has quit IRC | 07:14 | |
| openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna: Fix submitting hive job https://review.openstack.org/47000 | 07:16 |
| *** nadya has quit IRC | 07:19 | |
| *** akuznetsov has quit IRC | 07:23 | |
| openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna: Fix submitting hive job https://review.openstack.org/47000 | 07:27 |
| *** nmakhotkin_ has left #savanna | 07:36 | |
| *** nikolayM has joined #savanna | 07:36 | |
| openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna: Fix submitting hive job https://review.openstack.org/47000 | 07:38 |
| *** NikitaKonovalov has joined #savanna | 08:02 | |
| *** NikitaKonovalov has quit IRC | 08:40 | |
| *** SergeyLukjanov has joined #savanna | 08:58 | |
| *** DinaBelova has joined #savanna | 09:00 | |
| *** DinaBelova has quit IRC | 09:10 | |
| *** aignatov has quit IRC | 09:15 | |
| *** aignatov has joined #savanna | 09:16 | |
| *** DinaBelova has joined #savanna | 09:22 | |
| *** DinaBelova has quit IRC | 09:58 | |
| *** DinaBelova has joined #savanna | 10:00 | |
| *** DinaBelova has quit IRC | 10:22 | |
| *** tmckay has joined #savanna | 10:53 | |
| *** kbroughton has joined #savanna | 11:00 | |
| *** ruhe has joined #savanna | 11:05 | |
| *** sacharya has joined #savanna | 11:41 | |
| *** ruhe has quit IRC | 12:00 | |
| openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Add running hdfs operations from plugin specific user https://review.openstack.org/48232 | 12:31 |
| openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna: Add /job-configs/<job_type> REST API call https://review.openstack.org/45419 | 12:34 |
| openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Add running hdfs operations from plugin specific user https://review.openstack.org/48232 | 12:37 |
| *** ruhe has joined #savanna | 12:39 | |
| *** _crobertsrh is now known as crobertsrh | 12:46 | |
| openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Add running hdfs operations from plugin specific user https://review.openstack.org/48232 | 12:49 |
| *** tmckay has quit IRC | 13:07 | |
| openstackgerrit | Yaroslav Lobankov proposed a change to stackforge/savanna: Integration test refactoring https://review.openstack.org/43925 | 13:08 |
| *** SergeyLukjanov has quit IRC | 13:15 | |
| openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Add running hdfs operations from plugin specific user https://review.openstack.org/48232 | 13:25 |
| *** sacharya has quit IRC | 13:54 | |
| *** sacharya has joined #savanna | 13:57 | |
| *** sacharya has quit IRC | 13:57 | |
| *** kbroughton has quit IRC | 14:00 | |
| *** matsuhashi has quit IRC | 14:07 | |
| *** nosnos has quit IRC | 14:08 | |
| *** ruhe has quit IRC | 14:09 | |
| *** tmckay has joined #savanna | 14:12 | |
| *** tstclair has quit IRC | 14:13 | |
| *** tstclair has joined #savanna | 14:16 | |
| *** rnirmal has joined #savanna | 14:18 | |
| *** kbroughton has joined #savanna | 14:24 | |
| *** IlyaE has joined #savanna | 14:27 | |
| *** ruhe has joined #savanna | 14:28 | |
| *** sacharya has joined #savanna | 14:40 | |
| *** sacharya has quit IRC | 14:44 | |
| openstackgerrit | Ilya Tyaptin proposed a change to stackforge/savanna: Trusts for longrunning tasks https://review.openstack.org/44706 | 14:48 |
| *** ruhe has quit IRC | 14:51 | |
| tmckay | akuznetsov, aignatov, btw, I am working on data retrieval from internal swift. importing swiftclient, using the swift cli as a model. user/password currently are stored in the "extra" field in a job binary | 15:54 |
| tmckay | trying to figure out where to get the "account" value to form the url | 15:55 |
| tmckay | more of a status update. I have a swift connection (yay!) but no data retrieval yet, and I added a REST call I can use to test :) | 15:57 |
| aignatov | tmckay, is it possible to get account value to directly ask keystone which sfiwt is | 16:04 |
| aignatov | I'm not an swift expert but want to help you :) | 16:04 |
| *** SergeyLukjanov has joined #savanna | 16:05 | |
| *** akuznetsov has joined #savanna | 16:05 | |
| tmckay | :) it does seem that keystone knows all. I'm going to step through the swift cli program more carefully (swift list) and see how it constructs the url | 16:05 |
| tmckay | my "_get_conn(user,password)" connection works, but after that I have not figured out how to retrieve accounts, containers, and data. | 16:06 |
| tmckay | I would be further on this, but I tried very hard for a couple days to get devstack to run successfully for me on F19 and launch a cluster from savanna. Alas, I failed ultimately. | 16:08 |
| tmckay | so I've decided that just having devstack running a swift service is enough for me to implement this :) I'll try clusters again later | 16:08 |
| * tmckay really wanted to run Nadya's jobs from beginning to end | 16:08 | |
| aignatov | tmckay, currently we have patchset on the review - it has some logic related to swift tests | 16:10 |
| aignatov | And it seems it contains all you wants | 16:10 |
| aignatov | https://review.openstack.org/#/c/43925/29/savanna/tests/integration_new/tests/swift.py | 16:10 |
| tmckay | aignatov, beautiful, thanks! | 16:11 |
| aignatov | all parameters like OS_TENANT_NAME, COMMON.OS_USERNAME, COMMON.OS_PASSWORD can be retrieved from savanna.conf | 16:12 |
| aignatov | so you can construct working url to get objects from swift | 16:12 |
| tmckay | aignatov, here is a question (we can check with Nadya, too). Current "extra" field in JobBinary for "swift-internal" contains user/password, so I am using those for the connection | 16:14 |
| tmckay | aignatov, instead of values from savanna.conf | 16:14 |
| tmckay | otherwise, why have them? That was my thought. | 16:14 |
| aignatov | very good question:) now I see that JobBinary fields user/password are redundant | 16:16 |
| aignatov | maybe there is some hidden idea | 16:16 |
| aignatov | a | 16:17 |
| aignatov | ignore my 'a' | 16:17 |
| aignatov | btw, we can't check with Nadya anything for the next two weeks | 16:24 |
| aignatov | she's on the vacations | 16:24 |
| tmckay | aignatov, ack, we'll continue on. If it works, then changing where user/pass come from will be easy | 16:36 |
| aignatov | ok, feel free to ask me any questions | 16:40 |
| aignatov | btw, I'm going to create integration tests for EDP to include it into the savanna-ci | 16:41 |
| *** akuznetsov has quit IRC | 16:55 | |
| tmckay | aignatov, sounds great | 16:58 |
| tmckay | yay, I retrieved an account object from the connection. Progresss | 17:19 |
| tmckay | (the extra 's' is for 'savanna') | 17:19 |
| *** sacharya has joined #savanna | 17:31 | |
| *** SergeyLukjanov has quit IRC | 17:32 | |
| *** rnirmal has quit IRC | 18:01 | |
| tmckay | woohoo! I uploaded a copy of the Apache License to tmckay/LICENSE in swift, defined a JobBinary with swift-internal://tmckay/LICENSE as a url, and was able to retrieve it via a savanna test url (job_binaries/<id>/data) | 18:03 |
| tmckay | now I just have to things like error check | 18:03 |
| tmckay | aignatov, ping | 18:04 |
| *** mattf is now known as _mattf | 18:08 | |
| *** SergeyLukjanov has joined #savanna | 18:17 | |
| *** kbroughton_ has joined #savanna | 19:07 | |
| *** _mattf is now known as mattf | 19:07 | |
| *** kbroughton has quit IRC | 19:09 | |
| *** kbroughton_ is now known as kbroughton | 19:09 | |
| *** IlyaE has quit IRC | 19:20 | |
| *** rnirmal has joined #savanna | 19:25 | |
| crobertsrh | tmckay: Question for ya regarding job binaries and jb-internals | 19:30 |
| crobertsrh | When deleting a job binary, there is a bug that the job-binary-internal is not deleted. | 19:31 |
| crobertsrh | 2 questions, I guess.... | 19:31 |
| crobertsrh | 1) Should the api just take care of that deletion for us under the covers? | 19:31 |
| crobertsrh | 2) If not, how can the dashboard delete the associated jb-internal, not seeing a field that has jb-internal id? | 19:32 |
| *** IlyaE has joined #savanna | 19:34 | |
| *** SergeyLukjanov has quit IRC | 19:47 | |
| tmckay | crobertsrh, sorry, missed the bing | 19:57 |
| crobertsrh | no prob | 19:58 |
| tmckay | reading | 20:00 |
| tmckay | hmmm, so we have a job-binary that points to a job-binary-internal | 20:00 |
| tmckay | you delete the job-binary, and the internal is still there. | 20:01 |
| tmckay | that's not a bug, imho. | 20:01 |
| tmckay | crobertsrh, the internal is just storage. It's uploaded through a separate REST call. In fact, the internals have to be created before job-binary can point to them | 20:02 |
| tmckay | and, it's not consistent -- if job-binary points to an object in swift, we aren't going to delete the swift object when we delete the reference, are we? | 20:03 |
| tmckay | crobertsrh, got a bug number? I can comment.... or maybe there are notes there that change my mind | 20:04 |
| tmckay | crobertsrh, at any rate, there is an api call that will get you the ids for all the current job-binary-internals | 20:04 |
| crobertsrh | tmckay: https://bugs.launchpad.net/savanna/+bug/1229857 | 20:05 |
| *** akuznetsov has joined #savanna | 20:05 | |
| tmckay | crobertsrh, and to answer number 2, there should be a url in the job-binary that has the binary-internal id embedded in it | 20:05 |
| crobertsrh | Ah, ok. Was wondering whether or not that url was the actual id. | 20:05 |
| tmckay | so, you should be able to grab the url and pull the id out. But, maybe this is a checkbox for the user? "Delete the internal blob, too?" | 20:05 |
| crobertsrh | I think we definitely need a way in the UI to delete the jb-internal, otherwise a pure UI-only user would just accumulate jb-internals. | 20:07 |
| crobertsrh | And if we don't have a separate job-binary-internals "panel", the only chance to delete them is on the job-binary deletion. | 20:08 |
| tmckay | well, remember, internal handles the case when you don't have swift | 20:08 |
| crobertsrh | I suspect that's where Nadya was coming from when creating this bug. | 20:08 |
| tmckay | agreed, if there is no separate panel then the UI should treat them as unified. But from the perspective of savanna-api, they do not have to be unified. That is a fiction of the UI presentation. | 20:09 |
| crobertsrh | Yes | 20:09 |
| tmckay | that argues for you spinning the crank to do the deletion from the UI | 20:09 |
| crobertsrh | Right. I think I'll go ahead and "spin the crank" | 20:09 |
| crobertsrh | Might be something to revisit later. | 20:09 |
| tmckay | spin away :) | 20:09 |
| openstackgerrit | Chad Roberts proposed a change to stackforge/savanna-dashboard: Deleting job binary now deletes associated job-binary-internal https://review.openstack.org/48338 | 20:26 |
| tmckay | eje, okay, there are 2 sec BZs left, and a third BZ which was fixed in 2.3 but missed and never processed. It was verified against 2.4 | 20:46 |
| tmckay | on all three, I' | 20:47 |
| tmckay | I'll ping dryan and see what to do. If we need tech notes, I'll add them tomorrow. | 20:47 |
| tmckay | the rest, I did | 20:47 |
| tmckay | doh | 20:48 |
| tmckay | way wrong window | 20:48 |
| *** IlyaE has quit IRC | 20:57 | |
| *** rnirmal has quit IRC | 21:00 | |
| *** rnirmal has joined #savanna | 21:00 | |
| *** akuznetsov has quit IRC | 21:01 | |
| *** tmckay has left #savanna | 21:05 | |
| *** mattf is now known as _mattf | 21:07 | |
| *** kbroughton_ has joined #savanna | 21:11 | |
| *** kbroughton has quit IRC | 21:13 | |
| *** kbroughton_ is now known as kbroughton | 21:13 | |
| *** sacharya has quit IRC | 21:57 | |
| *** IlyaE has joined #savanna | 21:57 | |
| *** kbroughton has quit IRC | 22:36 | |
| *** IlyaE has quit IRC | 22:56 | |
| *** _mattf is now known as mattf | 22:59 | |
| *** crobertsrh is now known as _crobertsrh | 22:59 | |
| *** tmckay has joined #savanna | 23:43 | |
| *** sacharya has joined #savanna | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!