Monday, 2014-03-10

*** Ch00k has quit IRC00:34
*** nosnos has joined #savanna01:37
*** nosnos has quit IRC01:38
*** nosnos has joined #savanna01:40
*** rhodgin has joined #savanna01:51
*** efirtv has quit IRC02:16
*** IlyaE has joined #savanna02:45
*** sugney has joined #savanna02:49
*** rhodgin has quit IRC04:36
*** saju_m has joined #savanna04:59
*** nosnos has quit IRC05:39
*** nosnos has joined #savanna05:39
*** akuznetsov has joined #savanna05:53
*** saju_m has quit IRC05:54
*** saju_m has joined #savanna05:55
*** akuznetsov has quit IRC05:56
*** akuznetsov has joined #savanna05:57
*** saju_m has quit IRC06:00
*** akuznetsov has quit IRC06:01
*** _nadya_ has joined #savanna06:01
*** saju_m has joined #savanna06:02
*** akuznetsov has joined #savanna06:06
*** sugney has quit IRC06:07
*** akuznetsov has quit IRC06:11
*** akuznetsov has joined #savanna06:15
*** akuznetsov has quit IRC06:16
*** akuznetsov has joined #savanna06:17
*** _nadya_ has quit IRC06:17
*** akuznetsov has quit IRC06:23
*** _nadya_ has joined #savanna06:28
*** akuznetsov has joined #savanna06:29
*** _nadya_ has quit IRC06:31
*** tancha has joined #savanna06:31
*** nosnos_ has joined #savanna06:51
*** nosnos has quit IRC06:51
*** _nadya_ has joined #savanna06:52
*** akuznetsov has quit IRC06:55
*** akuznetsov has joined #savanna06:55
*** nosnos has joined #savanna06:56
*** nosnos_ has quit IRC06:58
*** IlyaE has quit IRC07:03
*** tancha has quit IRC07:04
*** nosnos has quit IRC07:05
*** nosnos has joined #savanna07:08
*** nosnos has quit IRC07:12
*** nosnos has joined #savanna07:12
*** Ch00k has joined #savanna07:33
*** matsuhashi has joined #savanna07:39
*** _nadya_ has quit IRC07:41
*** _nadya_ has joined #savanna07:44
*** _nadya_ has quit IRC08:15
*** saju_m has quit IRC08:22
*** saju_m has joined #savanna08:28
*** akuznetsov has quit IRC08:30
*** akuznetsov has joined #savanna08:36
*** _nadya_ has joined #savanna08:46
*** matsuhashi has quit IRC08:50
*** saju_m has quit IRC08:50
*** matsuhashi has joined #savanna08:54
*** saju_m has joined #savanna09:04
*** Ch00k has quit IRC09:04
*** witlessb has joined #savanna09:04
*** saju_m has quit IRC09:10
*** saju_m has joined #savanna09:11
*** _nadya_ has quit IRC09:20
*** akuznetsov has quit IRC09:23
*** _nadya_ has joined #savanna09:36
*** _nadya_ has quit IRC09:38
*** tosky has joined #savanna10:35
*** saju_m has quit IRC11:05
openstackgerritMatthew Farrellee proposed a change to openstack/savanna-dashboard: Update oslo-incubator importutils module
*** matsuhashi has quit IRC12:11
*** matsuhashi has joined #savanna12:13
*** _nadya_ has joined #savanna12:30
*** _nadya_ has quit IRC12:32
*** _mattf is now known as mattf12:52
*** elmiko has joined #savanna13:06
*** rhodgin has joined #savanna13:17
*** tmckay has joined #savanna13:24
*** _nadya_ has joined #savanna13:26
tmckaymattf, I don't seem to have permissions to assign the blueprint to myself.  There is nothing to click on.
mattftmckay, you want that one?13:30
tmckaymattf, yes13:30
*** matsuhashi has quit IRC13:32
mattfelmiko, is there a rename blueprint you'd like to take?13:32
elmikomattf, let me review the list again and i'll find one13:33
tmckayokay, so am I correct that renaming is an all out, first priority effort as of now?13:33
*** nosnos has quit IRC13:38
elmikotmckay, what are you doing in terms of testing on the package import renames from savanna->sahara?13:46
tmckayelmiko, well, I assume the unit tests and integration tests are enough.  The unit tests are easy.  The savanna integration tests are pretty easy to run locally, but on my box at least I have to modify the templates so the cluster is much smaller (2 masters and a worker)13:48
tmckaySame for the cli -- unit tests, and integration tests.  I purposely made the cli integration test easy to run locally.13:48
tmckayelmiko, since it's a onetime change (hopefully) I don't think we need to add any additional tests to the suite for the rename13:49
elmikothe unit test part makes sense to me, i'm still a little confused on the integration portion13:50
elmikomattf, sign me up for savanna-renaming-dashboard13:52
tmckay elmiko, well, you can run "tox -e integration" from savanna and it will use the python bindings in the client to launch a cluster, run jobs, and scale.  It takes a little bit of configuration (in itest.conf) and you need a running instance of openstack. Also, for small boxes like mine the cluster it builds is too big.  Normally, this is done automatically by gerrit but I run them sometimes.13:59
_crobertsrhI may have missed a few things on Friday afternoon regarding the rename effort (I got crazy sick in the afternoon and bailed a bit early).  Do we have a timeframe on these now?13:59
elmikotmckay, thanks that will help14:00
SergeyLukjanovhey folks14:00
tmckay_crobertsrh, repos have been moved according to openstack-dev14:00
elmikohi Sergey14:00
SergeyLukjanovtoday is the day off in Russia, I'll a but more available in a few hours14:01
SergeyLukjanov_crobertsrh, re timeframe - we should rename and ensure that everything working till the RC14:01
SergeyLukjanov_crobertsrh, the due to the release mid April it'll be great to have RC 2-3 weeks before it14:02
_crobertsrhOk, thanks14:02
SergeyLukjanov_crobertsrh, repos itself will be renamed this week, so, it'll be great to have all renaming CRs at the mid week to land them right after the repos renaming done14:03
_crobertsrhOk, so the plan is to do all the renaming stuff in the current repos, then switch over.  Makes sense to me.14:04
SergeyLukjanovI hope to rename repos mid week, but in the bad case it'll be done in weekend14:04
tmckaySergeyLukjanov, oh, I was thinking the repos were moved already.  My mistake.14:04
_crobertsrhOk, that shouldn't be a problem.14:05
SergeyLukjanovtmckay, it's a swap of initial plan, we were too late with new name :)14:05
_crobertsrhFor CRs, should each "type" of change get it's own bug or bp?  ie:  1 bp to change urls in dashboard?14:05
elmikoSergeyLukjanov, will we be getting this week as well?14:05
SergeyLukjanovelmiko, the main docs site is docs.o.o/developer/savanna / sahara14:06
SergeyLukjanovand it'll be available right after the repo renaming14:06
SergeyLukjanovthe same w/ rtfd14:07
*** _nadya_ has quit IRC14:07
mattf_crobertsrh, one bp, multiple work items, multiple commits14:08
_crobertsrhmattf:  roger, Roger.14:08
mattfelmiko, will you chat w/ chad about the dashboard bp, he has more exp w/ that codebase atm14:08
elmikomattf, sure thing14:09
mattf_crobertsrh, you taking the dashboard bp?14:13
_crobertsrhmattf:  I will.  elmiko can probably lend a hand on a work item or two14:14
mattfelmiko, what about the wiki or image-elements?14:15
mattfinstead of the dashboard14:15
_crobertsrhsorry for having to play catch-up this morning.  Our whole house was nearly wiped-out by the plague between Thursday and Sunday.14:15
*** _nadya_ has joined #savanna14:16
elmikomattf, sure thing. sign me up for image-elements14:18
SergeyLukjanovdoes anybody already started working on client?14:19
elmikoi think tmckay is signed up for it, not sure if he has started yet14:21
mattfelmiko, ack14:22
tmckaySergeyLukjanov, yes, I took the client bp14:23
SergeyLukjanovcould you please do the same patch for client
SergeyLukjanovbut with doubling packages instead of conf14:24
SergeyLukjanovwe need to land such patches earlier to unblock dev of other components14:24
tmckaySergeyLukjanov, so by doubling packages, do you mean the references in setup.cfg?14:27
SergeyLukjanovtmckay, I mean adding saharaclient package14:28
SergeyLukjanovwith reference to the old one14:28
SergeyLukjanovto be able to import from new package too14:28
tmckayokay, I think I see.  Because the client is used all over.14:29
tmckaySergeyLukjanov, what do you have in mind for "doubling"?  Copying the directory structure?  Some kind of python import magic?14:33
SergeyLukjanovtmckay, hm, good question :)14:37
SergeyLukjanovtmckay, /me need to take a look on python import internals14:37
tmckayk, i'll poke around too.  Not duplicating code is obviously better :)14:37
openstackgerritJenkins proposed a change to openstack/savanna: Updated from global requirements
openstackgerritA change was merged to openstack/savanna-dashboard: Update oslo-incubator importutils module
*** tosky has quit IRC14:57
*** _nadya_ has quit IRC15:04
*** tosky has joined #savanna15:08
tmckaySergeyLukjanov, I am thinking just a symlink.  git should store it, assuming gerrit will be okay with it.  Setting up and trying now on the client, with unit and integration test15:30
* tmckay that awesome integration test ;-)15:30
SergeyLukjanovtmckay, symlink is bad, it'll not allow to import correctly I think15:31
SergeyLukjanovtmckay, that how I think it should be done
tmckaySergeyLukjanov, okay, that looks promising15:33
SergeyLukjanovtmckay, would you like to make this change or /me just push it?15:35
tmckaySergeyLukjanov, if you have the patch ready, by all means, feel free to push it15:40
tmckayI'll work on fixing up all the references in the code15:40
SergeyLukjanovtmckay, ok, th15:41
openstackgerritSergey Lukjanov proposed a change to openstack/python-savannaclient: Make savanna able to be executed/used as sahara
*** _nadya_ has joined #savanna15:43
tmckaySergeyLukjanov, should we add "Partial implements" for to that CR ^^ ?15:47
*** _nadya_ has quit IRC15:53
SergeyLukjanovtmckay, due to the time period when we'll don't have autoupdates of lp projects15:56
SergeyLukjanovI think we should manually add changes to bp whiteboard15:56
openstackgerritA change was merged to openstack/savanna: Update oslo-incubator context module
*** tmckay is now known as tmckay_bbl16:07
*** _crobertsrh has quit IRC16:09
*** crobertsrh has joined #savanna16:10
toskyany ongoing breaking change? Trying to update with devstack and I see
openstackgerritSergey Lukjanov proposed a change to openstack/python-savannaclient: Make savanna able to be executed/used as sahara
*** mattf is now known as _mattf16:58
* tosky finds and looks at _mattf17:17
elmikolol, nice17:18
elmiko@SergeyLukjanov, will be migrated to
SergeyLukjanovelmiko, sure, today is the day-off in Russia, so, alias will be added tomorrow17:38
elmikothanks Sergey17:44
elmikoworking on the image-elements refactor, it looks like we will need to change the path of the Horton Works s3 repository, do we have access to that or should i put a request in somewhere?18:12
SergeyLukjanovelmiko, I think you need to email Erik B.18:13
SergeyLukjanovanyway, we can update this link later18:13
SergeyLukjanovit's not really matter from where we're taking stuff18:13
elmikook, should i leave the old link in place then?18:13
toskyso, that error above was an issue of mine18:15
*** _mattf is now known as mattf18:19
openstackgerritMatthew Farrellee proposed a change to openstack/savanna: Update oslo-incubator service module
openstackgerritMatthew Farrellee proposed a change to openstack/savanna: Update oslo-incubator config module
SergeyLukjanovelmiko, just add a workitem to bp18:24
*** tmckay_bbl is now known as tmckay18:24
tmckayI guess dentists are okay, and they probably like what they do, but I hate going there18:26
* tmckay contemplates just sucking shakes through a straw for the rest of his life18:26
SergeyLukjanovtmckay, heh, agreed18:31
SergeyLukjanovmattf, aignatov, please, take a look at
mattfSergeyLukjanov, where are you keeping track of the things the need to be undone when support for "savanna" is dropped?18:38
SergeyLukjanovmattf, one more grep18:38
mattfwill you capture it in a bp that can be assigned to some future milestone?18:39
mattf-> turn it into community knowledge18:39
* mattf wonders if he can tm "community knowledge" - it's more important than developer knowledge!18:39
openstackgerritChad Roberts proposed a change to openstack/savanna-dashboard: Changing "savanna" references in strings and templates.
elmikofor embedded comments that reference, will those be redirected to the new launchpad?18:45
mattfi'm curious about that too. i was assuming we'd have to change all those after the launchpad move.18:51
elmikoi'm leaving the old urls in comments for now18:51
SergeyLukjanovelmiko, we'll rename lp after repos will be renamed18:53
elmikook thanks18:53
SergeyLukjanovto not break everything at one moment18:53
elmikomakes sense18:53
SergeyLukjanovelmiko, I hope lp will add redirects18:53
elmikothat would be nice :)18:53
SergeyLukjanovelmiko, at least, for bugs - lp doen't check the mentioned project18:54
SergeyLukjanovelmiko, so, you can link to the savanna bug like
SergeyLukjanovand it'll work18:54
elmikoSergeyLukjanov, i'll change the references to that as it's more agnostic18:55
SergeyLukjanovelmiko, but don't use nove in the link, I think "openstack" will work better18:55
elmikogot it18:55
SergeyLukjanovelmiko, oops, not working ;(18:56
SergeyLukjanovelmiko, let's change comments later ;)18:56
mattfelmiko, re comment. you should file a review against oslo-incubator to improve the code. we'll pick up the improvement when we copy from oslo-incubator next time.18:56
elmikomattf, ok. how do i get to the original oslo-incubator upstream?18:57
SergeyLukjanovelmiko, re your comment for systemd, IMO we shouldn't set sock.connect(_abstractify(notify_socket)) if notify_socket is None or empty, so, "if notify_socket:" works better in this case18:57
elmikoSergeyLukjanov: agreed, i just meant the "if" test would read clearer if it were against "is not None"18:58
SergeyLukjanovelmiko, but "if something" != "if something is not None"18:59
mattfin any event, the oslo folks will weigh in on it at some point, if we push a patch to them. it's their code18:59
elmikoSergeyLukjanov: right, but os.getenv returns None if it can't find the entry. so the effect is the same with a more explicit reading using "is not None"19:00
SergeyLukjanovelmiko, it'll return empty string if you specify just NOTIFY_SOCKET=19:02
elmikoSergeyLukjanov: good point19:02
elmikomattf, given what Sergey is saying i'll just hold off on making a comment at oslo-incubator19:04
mattfeither way. the path to get any code changed under */openstack/common/* is to do it via oslo-incubator19:05
elmikomattf, check19:06
elmikoSergeyLukjanov: should i leave the old links in place until we get the alias?19:12
SergeyLukjanovelmiko, I think you could rename, but add note to the commit message to check that it's accessible before merging19:13
elmikoSergeyLukjanov: will do19:13
SergeyLukjanovelmiko, thx19:13
elmikoi will leave the hortonworks source-repository-hadoopswift in place for now though19:14
SergeyLukjanovelmiko, yup, I think it'll take much more time to rename19:14
elmikook, i'll note it in the commit and on the blueprint page19:15
SergeyLukjanovelmiko, I've asked Erik and John to rename resources
elmikoSergeyLukjanov: great, thanks! for image-elements it's only one reference.19:19
*** akuznetsov has joined #savanna19:19
elmikomattf, i've got this change done. do you have some suggestions on how i should test it?19:20
mattfthere is a script in there called the goal for that script is to provide a vetted set of elements that can be used to produce images that work w/ each plugin.19:36
mattfso the way to go about testing is to run the script w/ a few of the -p options then try to spin up a cluster using the generated images19:36
mattfi think there's currently 4-7 output image, and that's a lot. you shouldn't have to test each image.19:36
elmikook, i will probably have to test with the old repos in place until we get the alias in place19:37
*** tosky has quit IRC19:43
SergeyLukjanovmattf, there are much more output images...19:53
mattfhow many?19:53
SergeyLukjanov6 for vanilla, 3 for hdp, 2? for idh and 1 for spark19:53
mattfthat's too many imho19:53
SergeyLukjanovplugin x version x op. system19:54
SergeyLukjanovw/ exceptions19:54
SergeyLukjanovthere is no need to test them all19:54
mattfwell, imho spark should just be an addition to vanilla, hdp or idh19:55
mattfand we should focus on version 2 of hadoop19:55
mattfit might be that our # of OS is too high by 119:56
SergeyLukjanovmattf, I think that we have some automation for savanna-ci that checks new images... we need to ask Ivan Berezovsky about it19:58
SergeyLukjanovI hope that I'll be able to talk with him in office tomorrow19:59
mattfit's probably somewhere in the ci repo?20:01
SergeyLukjanovmattf, dunno20:02
mattfthe missing link is a test to see if the generated image actually works?20:02
mattfhmm, it might be more complete than i assumed20:03
mattfi'll be interested in hearing what ivan has to say20:03
elmikomattf, do i need to have devstack running before i start creating disk images?20:05
mattfno, it's independent of openstack itself (uses no OS services)20:06
elmikook, i'm still a little hazy on how to get the images into the stack. could you point me at some docs?20:06
crobertsrhelmiko:  Once the image is uploaded to glance, then it needs to be tagged by savanna's image registry in order to actually use it with savanna.20:08
crobertsrhtagging it let's savanna know which plugin/version is in the image.20:08
mattf -- savanna image-register20:09
elmikolol, was just about to ask if tagging == registering20:09
elmikomattf, crobertsrh, thanks20:10
mattfsadly, registering means adding a username, tagging makes the image available to a plugin20:10
elmikoahh, ok20:10
mattfsoo? heat will eliminate the need for assigning a username20:10
mattfi'm kinda hoping that lands soon so we can eliminate the registration step all together20:11
elmikoso, do i actually need to run this under sudo, or is that just for the package installations?20:15
mattfyou need to run it under sudo20:15
*** akuznetsov has quit IRC20:15
elmikoand it looks like it will place the images in the parent dir, is that accurate?20:17
mattfiirc, yeah20:20
crobertsrhoooh, when do we migrate to #sahara?20:26
SergeyLukjanovcrobertsrh, to #openstack-sahaa20:26
SergeyLukjanovcrobertsrh, when logging and bots will be updated to the new channel20:26
SergeyLukjanovcrobertsrh, I'll send an announcement20:26
SergeyLukjanovto ml20:27
openstackgerritChad Roberts proposed a change to openstack/savanna-dashboard: Changing "savanna" references in README.rst to "sahara"
mattfSergeyLukjanov, what did the legal folks say about the indian sahara collision? i'd hate to multi-rename20:27
SergeyLukjanovmattf, waiting for answer, but it's in absolutely different areas, so, there shouldn't be any issues20:28
SergeyLukjanovmattf, we can find such issues for *any* good name we proposed....20:28
SergeyLukjanovnot Stackadoop maybe20:28
mattfand there'd be a reason for that!20:29
elmiko+1 Stackadoop20:30
SergeyLukjanovshasum('savanna') is not bad too20:31
elmikonice, is that the Russian word?20:32
SergeyLukjanovelmiko, unfortunately nope :)20:32
SergeyLukjanovelmiko, d57e03ed6d30081f0dd274cd35a352287f57162620:32
elmikodifficult to pronounce though...20:33
SergeyLukjanovelmiko, yeah, we could use first N chars like git20:33
elmikojust out of curiosity what is the english represenation of the Russian word for savanna?20:33
elmikolol, so the same...20:34
crobertsrhremember, the second н is silent20:34
elmikoi'm still +1 Stackadoop20:34
SergeyLukjanovcrobertsrh, in ru we pronounce it with double n20:34
crobertsrhAh, of course :)  I should be better at Russian right now after watching the Olympics.20:35
SergeyLukjanovfyi sahara is "сахара"20:35
crobertsrhMaybe this is as good as I get, I suppose.20:35
elmikowhat if we just named it caxapa... no name collisions most likely ;)20:35
tmckayI like "caxapa"  We should pronounce that in English20:36
elmikoyea totally20:36
mattfno name collision that people in the english speaking world can easily google for anyway20:36
elmikoright20:36 ?20:36
tmckayand it looks mysterious20:36
elmikoon a more serious note, how does this export DIB_CLOUD_IMAGES get used?20:39
openstackgerritSergey Lukjanov proposed a change to openstack/savanna: We're now using nove client >= 2.17.0
mattffind DIB_CLOUD_IMAGES in
*** mattf is now known as _mattf20:42
elmikook, so it looks like i need to have diskimage-builder installed as well20:42
elmikotmckay, given that i started the edp rename thing before we started the name change, i'll just have to merge from master once we finish the savanna portion of the rename?21:00
tmckayelmiko, did you push a CR up for that?21:09
elmikonot yet21:09
elmikoi'm still working it21:09
tmckayokay.  If you have the job type constant changes as a patch, you should be able to just apply it when the repo moves21:10
elmikocool, i was just thinking that i might run into some impediments until we have a repo alias in place tomorrow for this image-elements patch, so i would finish up the jobtype rename21:11
elmikobut it gave me pause for thought considering the rename21:12
tmckayyeah, I would just keep working on it, and then save it with git diff at some point and then patch it in21:12
elmikook, thanks21:12
*** crobertsrh is now known as _crobertsrh21:13
*** IlyaE has joined #savanna21:20
openstackgerritA change was merged to openstack/savanna: Update oslo-incubator service module
*** _mattf is now known as mattf21:34
openstackgerritA change was merged to openstack/savanna: Update oslo-incubator config module
openstackgerritJenkins proposed a change to openstack/savanna: Updated from global requirements
openstackgerritMatthew Farrellee proposed a change to openstack/savanna: Cleanup openstack-common.conf
elmikomattf, looks like this sahara-image-elements is going to be difficult to test until we get the git project in place. i can test it, but i will have to modify the repo names. any advice on how to proceed?22:06
elmikofyi, i've made notes in the commit about needing the new url's before we merge.22:08
openstackgerritMatthew Farrellee proposed a change to openstack/savanna: Cleanup openstack-common.conf
*** rhodgin has quit IRC22:12
mattfelmiko, i don't think there's much risk in the repo rename. so testing now is likely valid for later.22:13
elmikomattf, ok. there are other issues too, mostly surrounding the script pulling from repos that don't have the name change yet. so... chicken and egg kind of thing. should i just push the commit for review?22:13
mattfif you've done some basic validation, sure22:14
elmikoi'm pretty sure jenkins is going to have a fit if it tries to run these though22:15
*** witlessb has quit IRC22:26
*** rhodgin has joined #savanna22:36
*** IlyaE has quit IRC22:51
*** IlyaE has joined #savanna23:54
*** IlyaE has quit IRC23:54

Generated by 2.14.0 by Marius Gedminas - find it at!