| *** sacharya has joined #savanna | 00:01 | |
| *** NikitaKonovalov has quit IRC | 00:03 | |
| *** NikitaKonovalov has joined #savanna | 00:59 | |
| *** NikitaKonovalov has quit IRC | 01:03 | |
| *** nosnos has joined #savanna | 01:22 | |
| *** tstclair has quit IRC | 01:32 | |
| *** tstclair has joined #savanna | 01:32 | |
| *** fandikurnia01 has joined #savanna | 01:53 | |
| *** NikitaKonovalov has joined #savanna | 01:59 | |
| *** NikitaKonovalov has quit IRC | 02:03 | |
| *** nosnos has quit IRC | 02:57 | |
| *** nosnos has joined #savanna | 02:58 | |
| *** NikitaKonovalov has joined #savanna | 03:00 | |
| *** NikitaKonovalov has quit IRC | 03:04 | |
| *** akuznetsov has joined #savanna | 03:17 | |
| *** akuznetsov has quit IRC | 03:30 | |
| *** sacharya has quit IRC | 03:30 | |
| *** sacharya has joined #savanna | 03:31 | |
| *** akuznetsov has joined #savanna | 03:34 | |
| *** NikitaKonovalov has joined #savanna | 04:00 | |
| *** NikitaKonovalov has quit IRC | 04:05 | |
| *** akuznetsov has quit IRC | 04:09 | |
| *** sacharya has quit IRC | 04:11 | |
| *** SergeyLukjanov has joined #savanna | 04:13 | |
| *** SergeyLukjanov has quit IRC | 04:14 | |
| *** akuznetsov has joined #savanna | 04:16 | |
| *** SergeyLukjanov has joined #savanna | 04:20 | |
| *** SergeyLukjanov has quit IRC | 04:30 | |
| *** SergeyLukjanov has joined #savanna | 04:33 | |
| *** SergeyLukjanov has quit IRC | 04:48 | |
| *** SergeyLukjanov has joined #savanna | 04:57 | |
| *** SergeyLukjanov has quit IRC | 04:57 | |
| *** NikitaKonovalov has joined #savanna | 05:01 | |
| *** coolsvap has joined #savanna | 05:04 | |
| *** NikitaKonovalov has quit IRC | 05:05 | |
| *** NikitaKonovalov has joined #savanna | 05:33 | |
| *** NikitaKonovalov has quit IRC | 05:33 | |
| *** SergeyLukjanov has joined #savanna | 05:42 | |
| *** NikitaKonovalov has joined #savanna | 06:05 | |
| *** coolsvap has quit IRC | 06:13 | |
| *** nosnos has quit IRC | 06:17 | |
| *** nosnos has joined #savanna | 06:24 | |
| *** akuznetsov has quit IRC | 06:39 | |
| *** akuznetsov has joined #savanna | 06:40 | |
| *** SergeyLukjanov has quit IRC | 06:43 | |
| *** NikitaKonovalov has quit IRC | 06:52 | |
| *** dmitryme has joined #savanna | 07:46 | |
| *** asavu has joined #savanna | 07:49 | |
| *** dmitryme has quit IRC | 07:59 | |
| *** NikitaKonovalov has joined #savanna | 08:06 | |
| *** asavu has quit IRC | 08:07 | |
| *** SergeyLukjanov has joined #savanna | 08:09 | |
| *** nprivalova has joined #savanna | 08:10 | |
| *** akuznetsov has quit IRC | 08:32 | |
| *** alazarev has joined #savanna | 08:51 | |
| *** akuznetsov has joined #savanna | 09:02 | |
| *** NikitaKonovalov has quit IRC | 09:22 | |
| *** alazarev has quit IRC | 09:38 | |
| *** alazarev has joined #savanna | 09:40 | |
| *** asavu has joined #savanna | 09:52 | |
| *** NikitaKonovalov has joined #savanna | 10:00 | |
| *** dmitryme has joined #savanna | 10:10 | |
| *** nprivalova has quit IRC | 10:18 | |
| *** asavu has quit IRC | 10:24 | |
| *** akuznetsov has quit IRC | 10:31 | |
| *** NikitaKonovalov has quit IRC | 10:31 | |
| *** SergeyLukjanov has quit IRC | 10:36 | |
| *** NikitaKonovalov has joined #savanna | 10:37 | |
| *** SergeyLukjanov has joined #savanna | 10:38 | |
| *** SergeyLukjanov has quit IRC | 10:54 | |
| *** NikitaKonovalov has quit IRC | 11:00 | |
| *** akuznetsov has joined #savanna | 11:02 | |
| *** nprivalova has joined #savanna | 11:03 | |
| *** SergeyLukjanov has joined #savanna | 11:07 | |
| openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Fix random fails of unit tests https://review.openstack.org/46245 | 11:13 |
|---|---|---|
| *** nprivalova has quit IRC | 11:19 | |
| *** nprivalova has joined #savanna | 11:25 | |
| *** alazarev has quit IRC | 11:26 | |
| *** fandikurnia01 has quit IRC | 11:28 | |
| *** alazarev has joined #savanna | 11:41 | |
| *** NikitaKonovalov has joined #savanna | 11:42 | |
| openstackgerrit | ChangBo Guo proposed a change to stackforge/savanna: Don't use ModelBase.save() inside of transaction https://review.openstack.org/46258 | 11:48 |
| *** asavu has joined #savanna | 11:57 | |
| *** _crobertsrh is now known as crobertsrh | 12:05 | |
| *** dmitryme has quit IRC | 12:13 | |
| *** dmitryme has joined #savanna | 12:14 | |
| openstackgerrit | Chad Roberts proposed a change to stackforge/savanna-dashboard: Adds EDP support in the UI for job execution https://review.openstack.org/44930 | 12:16 |
| *** asavu has quit IRC | 12:26 | |
| openstackgerrit | Yaroslav Lobankov proposed a change to stackforge/savanna: Integration test refactoring https://review.openstack.org/43925 | 12:28 |
| *** NikitaKonovalov has quit IRC | 12:33 | |
| *** fandikurnia01 has joined #savanna | 12:39 | |
| *** fandikurnia01 has quit IRC | 12:49 | |
| *** tmckay has joined #savanna | 12:55 | |
| *** NikitaKonovalov has joined #savanna | 12:56 | |
| *** alazarev has quit IRC | 13:00 | |
| *** alazarev has joined #savanna | 13:09 | |
| nprivalova | crobertsrh, hi! | 13:14 |
| crobertsrh | hello | 13:14 |
| openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna: Floating ip assignement support https://review.openstack.org/44822 | 13:15 |
| nprivalova | tell me please, may I start JobOrigin? yesterday we decided that you will work on binaries part. Does JobOrigin belong to binaries part :)? | 13:16 |
| *** chandoo has joined #savanna | 13:16 | |
| crobertsrh | Job Origin depends upon the binaries to some extent. | 13:16 |
| crobertsrh | Since Job origin will display a list of binaries | 13:17 |
| nprivalova | so it's your part, right? | 13:17 |
| crobertsrh | I think that the list of binaries is the only touch point | 13:18 |
| crobertsrh | If we start from my current review, job origins can be worked on separately since those lists are populated. | 13:18 |
| nprivalova | ok. I'm starting jobOrigin. Hope it will not block someone else... | 13:25 |
| *** nosnos has quit IRC | 13:26 | |
| crobertsrh | I don't think it should. | 13:30 |
| crobertsrh | nprivalova: quick question. I have a reasonable bit of skeleton functionality for job origin in my current review. What is the best way to proceed with that? | 13:32 |
| nprivalova | crobertsrh, I just start my work from yours. It's possible to add your CR in dependencies | 13:35 |
| crobertsrh | Ah, ok. I figured there was something sensible that could be done. You make it sound super easy :) | 13:35 |
| *** alazarev has quit IRC | 13:42 | |
| *** alazarev has joined #savanna | 14:06 | |
| *** sacharya has joined #savanna | 14:09 | |
| openstackgerrit | A change was merged to stackforge/savanna: Add "mains" and "libs" fields to JobOrigins https://review.openstack.org/45129 | 14:19 |
| aignatov | great job, Nadya and Trevor! | 14:25 |
| *** IlyaE has joined #savanna | 14:30 | |
| *** sacharya has quit IRC | 14:30 | |
| *** SergeyLukjanov has quit IRC | 14:42 | |
| tmckay | nprivalova, I made a draft to wrap workflow generation in an object and remove "ifs" from job_manager. https://review.openstack.org/#/c/46294/ Is something like this what you have in mind? | 14:47 |
| tmckay | I'll look for more things to move -- there may be more functions to add, and classes may not ultimately go in workflow_creator. | 14:48 |
| tmckay | Probably retrieving a script name from a job origin can be wrapped to, and something should maybe happen with the special hive-site upload case | 14:48 |
| tmckay | and of course, it needs doc strings, etc | 14:49 |
| nprivalova | tmckay, yes. it looks ok. I'll add akuznetsov to draft | 14:49 |
| tmckay | nprivalova, okay, I'll keep going | 14:50 |
| *** rnirmal has joined #savanna | 14:54 | |
| akuznetsov | tmckay this is great | 14:55 |
| tmckay | akuznetsov, thanks, I'll see if there are other things I can do to clean up | 14:56 |
| *** alazarev has quit IRC | 15:03 | |
| tmckay | nprivalova, what do you think about moving the config setup out of job manager too into the factory stuff? It's only there to make the workflows work | 15:04 |
| tmckay | the swift credentials, I mean | 15:04 |
| tmckay | ultimately those should be dependent on input type | 15:04 |
| tmckay | I'll try it, I have an idea | 15:05 |
| *** alazarev has joined #savanna | 15:07 | |
| *** sacharya has joined #savanna | 15:07 | |
| nprivalova | ok. swift config as it is now is a temporary solution. it should depends on dataSource | 15:07 |
| tmckay | right | 15:07 |
| *** kbroughton has joined #savanna | 15:12 | |
| kbroughton | I'm planning to test savanna by co-locating it on a controller node. The hd is 1 Tb. Any suggestions on how to partition the drive if at all? Does savanna want its own partition? How about swift? | 15:14 |
| *** SergeyLukjanov has joined #savanna | 15:21 | |
| aignatov | Hi kbroughton, now there are not special requiremnts for savanna's storage and partitioning | 15:28 |
| kbroughton | ok, thanks. Are there any "Labs" or walk throughs of running some basic MR jobs using savanna? | 15:30 |
| aignatov | As for swift, it should be installed as common OpenStack service, and there are no special requirements for it from Savanna perspective | 15:30 |
| aignatov | yes sure, did you read user guide are did you see screencast oveview? | 15:31 |
| aignatov | *overview | 15:31 |
| aignatov | anyway you can run basic mr jobs inside provisioned cluster, nothing special is needed :) | 15:32 |
| aignatov | let me give you a links | 15:32 |
| *** kbroughton has quit IRC | 15:38 | |
| *** kbroughton has joined #savanna | 15:38 | |
| *** rnirmal_ has joined #savanna | 15:39 | |
| aignatov | on provisioned cluster go here 'cd /usr/share/hadoop' | 15:40 |
| aignatov | and run | 15:40 |
| aignatov | 'hadoop jar hadoop-examples.jar pi 10 100' | 15:40 |
| aignatov | that's it :) | 15:40 |
| *** rnirmal has quit IRC | 15:40 | |
| *** rnirmal_ is now known as rnirmal | 15:40 | |
| aignatov | savanna screencast http://www.youtube.com/watch?v=SrlHM0-q5zI | 15:42 |
| aignatov | it also includes basic mr jobs running | 15:42 |
| aignatov | kbroughton, do I answer on your question? :) | 15:43 |
| kbroughton | Yes, thanks! | 15:43 |
| openstackgerrit | A change was merged to stackforge/savanna: Use setup.py develop for tox install https://review.openstack.org/45724 | 15:46 |
| aignatov | btw, kbroughton, we have regular community meetings on Thursday's, so the closest one will be today at 18:00 UTC | 15:47 |
| aignatov | you are welcome! | 15:47 |
| *** rnirmal has quit IRC | 15:50 | |
| *** rnirmal has joined #savanna | 15:51 | |
| kbroughton | ok thanks. i'll check it out. | 15:51 |
| mattf | CRITICAL savanna [-] cannot import name relationship | 16:07 |
| *** akuznetsov has quit IRC | 16:07 | |
| mattf | ^^ ring any bells? | 16:07 |
| dmitryme | time to drop database? | 16:08 |
| SergeyLukjanov | mattf, sqla version? | 16:08 |
| mattf | # rpm -qa | grep alchemy | 16:08 |
| mattf | python-zope-sqlalchemy-0.4-3.el6.noarch | 16:08 |
| mattf | python-sqlalchemy0.7-0.7.8-1.el6.x86_64 | 16:08 |
| mattf | python-sqlalchemy-0.5.5-3.el6_2.noarch | 16:08 |
| dmitryme | that last one is confusing | 16:10 |
| *** NikitaKonovalov has quit IRC | 16:11 | |
| mattf | # ls -ald /usr/lib*/python2.6/site-packages/*chemy* | 16:11 |
| mattf | drwxr-xr-x. 4 root root 4096 Sep 12 10:48 /usr/lib64/python2.6/site-packages/SQLAlchemy-0.7.8-py2.6-linux-x86_64.egg | 16:11 |
| mattf | drwxr-xr-x. 8 root root 4096 Sep 12 09:20 /usr/lib/python2.6/site-packages/sqlalchemy | 16:11 |
| mattf | drwxr-xr-x. 2 root root 4096 Sep 12 09:20 /usr/lib/python2.6/site-packages/SQLAlchemy-0.5.5-py2.6.egg-info | 16:11 |
| mattf | drwxr-xr-x. 2 root root 4096 Sep 12 10:48 /usr/lib/python2.6/site-packages/sqlalchemy_migrate-0.6-py2.6.egg-info | 16:11 |
| mattf | drwxr-xr-x. 2 root root 4096 Sep 12 09:20 /usr/lib/python2.6/site-packages/zope.sqlalchemy-0.4-py2.6.egg-info | 16:11 |
| *** alazarev has quit IRC | 16:11 | |
| mattf | -rw-r--r--. 1 root root 301 Jun 28 2010 /usr/lib/python2.6/site-packages/zope.sqlalchemy-0.4-py2.6-nspkg.pth | 16:11 |
| mattf | yeah, there are two versions installed. one in lib64 and the other in lib | 16:11 |
| SergeyLukjanov | savanna requires sqla>=0.7 | 16:12 |
| * mattf digs | 16:12 | |
| *** rnirmal has quit IRC | 16:25 | |
| *** rnirmal has joined #savanna | 16:25 | |
| *** asavu has joined #savanna | 16:26 | |
| *** nprivalova has quit IRC | 16:37 | |
| *** akuznetsov has joined #savanna | 16:46 | |
| *** mattf is now known as _mattf | 16:46 | |
| *** _mattf is now known as mattf | 16:55 | |
| *** ruhe has joined #savanna | 16:58 | |
| *** asavu has quit IRC | 17:05 | |
| *** NikitaKonovalov has joined #savanna | 17:09 | |
| *** dmitryme has quit IRC | 17:09 | |
| *** dmitryme has joined #savanna | 17:10 | |
| *** ruhe has quit IRC | 17:13 | |
| *** NikitaKonovalov has quit IRC | 17:13 | |
| *** NikitaKonovalov has joined #savanna | 17:17 | |
| *** NikitaKonovalov has quit IRC | 17:23 | |
| *** NikitaKonovalov has joined #savanna | 17:24 | |
| *** NikitaKonovalov has quit IRC | 17:29 | |
| *** NikitaKonovalov has joined #savanna | 17:32 | |
| *** ruhe has joined #savanna | 17:42 | |
| *** SergeyLukjanov has quit IRC | 17:42 | |
| *** SergeyLukjanov has joined #savanna | 17:44 | |
| *** dmitryme has quit IRC | 17:50 | |
| *** NikitaKonovalov has quit IRC | 17:53 | |
| *** NikitaKonovalov has joined #savanna | 17:54 | |
| *** dmitryme has joined #savanna | 17:55 | |
| SergeyLukjanov | savanna team meeting will be in #openstack-meeting-alt channel in 10 minutes | 17:57 |
| *** crobertsrh1 has joined #savanna | 17:58 | |
| *** crobertsrh has quit IRC | 18:01 | |
| *** nadya has joined #savanna | 18:01 | |
| *** aignatov_ has joined #savanna | 18:01 | |
| *** crobertsrh1 is now known as crobertsrh | 18:04 | |
| *** ruhe has quit IRC | 18:08 | |
| *** ruhe has joined #savanna | 18:12 | |
| *** akuznetsov has quit IRC | 18:14 | |
| *** NikitaKonovalov has quit IRC | 18:23 | |
| *** NikitaKonovalov has joined #savanna | 18:24 | |
| mattf | crobertsrh, commenting that out resulted in progress | 18:35 |
| crobertsrh | But not total victory? | 18:35 |
| mattf | not yet | 18:36 |
| tmckay | nadya, okay, I think I have moved as much out of job_manager.py as is reasonable. All explicit tests on job_type are gone. I moved the hive site upload to an "extra config for workflow" method and fixed up the tests. Let me know what you think. Any other errors relating to this that you think need attention? | 18:38 |
| tmckay | sorry, not "errors", "areas" | 18:38 |
| mattf | crobertsrh, i think it's because i'm using a 0.2 image and an 0.3 savanna. so things like oozie are missing from the image | 18:39 |
| crobertsrh | Ah, yep, that would do it | 18:39 |
| mattf | sooooooo close to working w/ havanna dro | 18:39 |
| *** akuznetsov has joined #savanna | 18:40 | |
| crobertsrh | Yeah, when I grabbed the latest devstack a couple weeks back, that tweak was all I needed. | 18:40 |
| crobertsrh | Not sure if there is a nova pythonclient change or what the root cause is. Was just happy to make progress at that point. | 18:40 |
| mattf | darn, i just trashed my savanna-image-elements machine | 18:40 |
| nadya | tmckay, It's great! You may create CR and I'll test it tomorrow in thelab | 18:42 |
| tmckay | nadya, thank you. It's about time I get an actual 1 machine cluster set up so I can really run this stuff :) I think I've done about all I can do with savanna-api and tox tests ;-) | 18:43 |
| ruhe | mattf, what do you think about adding info about RPMs to Savanna docs? | 18:44 |
| *** dmitryme has quit IRC | 18:46 | |
| mattf | w00t! | 18:47 |
| mattf | ruhe, i feel like it's getting like a better and better option | 18:48 |
| mattf | i may have just successfully installed savanna on rdo havanna and run dfsadmin & pi | 18:48 |
| mattf | if i can reproduce, i can add the rpms to RDO and the additional information for the savanna docs will be quite minimal | 18:49 |
| nadya | tmckay, actually it looks like we're mostly done with main functionality in EDP-core:) there is a task regarding storing binaries in swift.And today Kolya filed a new bug | 18:49 |
| mattf | ruhe, i updated my side docs last night - https://github.com/mattf/savanna/blob/RDO-quickstart/doc/source/rdo_quickstart.rst | 18:49 |
| tmckay | nadya, that's great. What next? | 18:49 |
| mattf | Estimated value of Pi is 3.14158440000000000000 | 18:49 |
| mattf | close enough for gov't work | 18:49 |
| ruhe | :) | 18:50 |
| *** NikitaKonovalov has quit IRC | 18:50 | |
| *** akuznetsov has quit IRC | 18:50 | |
| tmckay | unless the government is building aircraft and the like | 18:50 |
| *** NikitaKonovalov has joined #savanna | 18:50 | |
| nadya | matt, that, s perfect! every time I run Pi hadoop tells me that it equals 4... | 18:50 |
| mattf | nadya, lol! | 18:50 |
| mattf | in soviet russia pi calculates you? | 18:51 |
| nadya | lol | 18:51 |
| aignatov_ | xD | 18:52 |
| *** aignatov_ has quit IRC | 18:53 | |
| nadya | tmckay, we need to discuss this with Alex K | 18:53 |
| nadya | tmckay, we still cannot pass params for pig and hive scripts | 18:54 |
| nadya | tmckay, I remembered | 18:55 |
| *** NikitaKonovalov has quit IRC | 18:59 | |
| *** asavu has joined #savanna | 18:59 | |
| tmckay | nadya, okay | 19:07 |
| *** ruhe has quit IRC | 19:08 | |
| *** IlyaE has quit IRC | 19:23 | |
| *** kbroughton has quit IRC | 19:26 | |
| *** akuznetsov has joined #savanna | 19:31 | |
| mattf | crobertsrh, seen http://paste.fedoraproject.org/39194/79014352 ? | 19:32 |
| crobertsrh | No, that's a new one for me. | 19:33 |
| crobertsrh | Never used python 2.6 though. | 19:34 |
| crobertsrh | Hopefully, that's not it | 19:34 |
| crobertsrh | Was this when you were firing-up a cluster? | 19:34 |
| *** NikitaKonovalov has joined #savanna | 19:35 | |
| mattf | crobertsrh, nope, just after login | 19:36 |
| mattf | well, i was already logged in when i bounced httpd. so maybe even on the login screen | 19:36 |
| *** NikitaKonovalov has quit IRC | 19:40 | |
| *** nadya has quit IRC | 19:40 | |
| mattf | issue appears to be solved w/ s/quantum/neutron/ | 19:40 |
| crobertsrh | Ah :) | 19:40 |
| *** NikitaKonovalov has joined #savanna | 19:41 | |
| *** crobertsrh has quit IRC | 19:51 | |
| *** SergeyLukjanov has quit IRC | 19:54 | |
| *** akuznetsov has quit IRC | 20:01 | |
| *** akuznetsov has joined #savanna | 20:10 | |
| *** crobertsrh has joined #savanna | 20:11 | |
| mattf | NikitaKonovalov, yt? | 20:18 |
| mattf | +neutron = importutils.import_any('openstack_dashboard.api.quantum', | 20:18 |
| mattf | + 'horizon.api.quantum') | 20:18 |
| mattf | from savannadashboard/clusters/tabs.py | 20:19 |
| mattf | in my deployment those should be ...api.neutron. why did you choose ....api.quantum ? | 20:19 |
| *** akuznetsov has quit IRC | 20:20 | |
| openstackgerrit | John Speidel proposed a change to stackforge/savanna: Configuration token replacement is incorrect for some topologies https://review.openstack.org/46349 | 20:24 |
| *** crobertsrh is now known as _crobertsrh | 20:34 | |
| openstackgerrit | Matthew Farrellee proposed a change to stackforge/savanna-dashboard: Add neutron import available in the RDO release of Havanna https://review.openstack.org/46350 | 20:37 |
| *** NikitaKonovalov has quit IRC | 20:47 | |
| *** kbroughton has joined #savanna | 21:36 | |
| *** asavu has quit IRC | 21:37 | |
| *** mattf is now known as _mattf | 21:43 | |
| *** NikitaKonovalov has joined #savanna | 21:47 | |
| *** NikitaKonovalov has quit IRC | 21:51 | |
| *** sacharya has quit IRC | 22:20 | |
| *** kbroughton has quit IRC | 22:43 | |
| *** NikitaKonovalov has joined #savanna | 22:48 | |
| *** NikitaKonovalov has quit IRC | 22:52 | |
| *** asavu has joined #savanna | 23:01 | |
| *** sacharya has joined #savanna | 23:09 | |
| *** rnirmal has quit IRC | 23:18 | |
| *** asavu has quit IRC | 23:40 | |
| *** NikitaKonovalov has joined #savanna | 23:47 | |
| *** NikitaKonovalov has quit IRC | 23:52 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!