Tuesday, 2016-01-12

*** dschroeder has quit IRC00:15
*** memogarcia has joined #openstack-freezer00:16
*** EinstCrazy has joined #openstack-freezer01:05
*** EinstCrazy has quit IRC01:06
*** EinstCrazy has joined #openstack-freezer01:07
*** memogarcia has quit IRC01:09
*** memogarcia has joined #openstack-freezer01:19
*** EinstCrazy has quit IRC01:50
*** EinstCrazy has joined #openstack-freezer01:51
*** EinstCra_ has joined #openstack-freezer02:03
*** memogarcia has quit IRC02:04
*** EinstCra_ has quit IRC02:06
*** EinstCrazy has quit IRC02:06
*** EinstCrazy has joined #openstack-freezer02:08
*** memogarcia has joined #openstack-freezer02:18
EinstCrazyHi,there ,  I want to run freezer. But I only found a documentation of api. How could I run other module?02:20
*** memogarcia has quit IRC03:15
*** EinstCrazy has quit IRC03:33
*** EinstCrazy has joined #openstack-freezer03:33
*** memogarcia has joined #openstack-freezer03:33
*** memogarcia has quit IRC04:54
*** memogarcia has joined #openstack-freezer05:15
*** EinstCra_ has joined #openstack-freezer05:25
*** EinstCrazy has quit IRC05:25
*** EinstCra_ has quit IRC05:29
*** EinstCrazy has joined #openstack-freezer05:30
*** EinstCrazy has quit IRC06:03
*** EinstCrazy has joined #openstack-freezer06:03
*** EinstCrazy has quit IRC06:39
*** EinstCrazy has joined #openstack-freezer06:39
*** memogarcia has quit IRC06:42
*** EinstCra_ has joined #openstack-freezer06:45
*** EinstCrazy has quit IRC06:45
*** EinstCra_ has quit IRC06:56
*** EinstCrazy has joined #openstack-freezer06:57
*** EinstCrazy has quit IRC06:57
*** EinstCrazy has joined #openstack-freezer06:57
*** EinstCrazy has quit IRC07:00
*** EinstCra_ has joined #openstack-freezer07:00
*** EinstCra_ has quit IRC07:08
*** EinstCrazy has joined #openstack-freezer07:08
*** memogarcia has joined #openstack-freezer07:10
*** EinstCra_ has joined #openstack-freezer07:41
*** EinstCrazy has quit IRC07:41
*** EinstCrazy has joined #openstack-freezer08:07
*** EinstCra_ has quit IRC08:07
*** EinstCrazy has quit IRC08:12
*** EinstCrazy has joined #openstack-freezer08:12
*** samuelBartel has joined #openstack-freezer08:27
*** memogarcia has quit IRC08:39
*** reldan has joined #openstack-freezer08:57
*** memogarcia has joined #openstack-freezer08:57
*** daemontool has joined #openstack-freezer09:11
openstackgerritFausto Marzi proposed openstack/freezer: Parallel backup  https://review.openstack.org/24784009:13
*** reldan has quit IRC09:14
daemontoolMorning09:16
*** openstackgerrit has quit IRC09:17
*** openstackgerrit has joined #openstack-freezer09:18
openstackgerritMerged openstack/freezer: Parallel backup  https://review.openstack.org/24784009:21
*** memogarcia has quit IRC09:33
daemontoolall: I think we need to have a quick meeting today, regarding a new stable branch release for Liberty and align with Mitaka09:39
daemontoolvannif,  szaher m3m0 frescof Slashme  ^^09:39
vannifCompany leader to identify Baker Team - Rambo, Messner, Ortega, Coletta, Jurgensen, Berry, Krakauer confirm! This is Colonel Trautman. Talk to me, Johnny09:40
vannif^^09:41
vannifThey're all gone Sir.09:41
vannifFor breakfast :D09:41
daemontoolJohnny Rico09:42
daemontoolvannif, is Eldar there around?09:43
vannifnot yet09:44
vannifRico ? isn't it Heinlein's "starship troopers" ?09:45
daemontoolyes09:45
vannifawesome novel09:47
daemontoolvannif, can we move forward the reviews to be approved from https://review.openstack.org/#/q/status:open+project:openstack/freezer09:48
*** reldan has joined #openstack-freezer09:50
daemontoolhi reldan parallel is merged09:50
reldanHi daemontool: I have seen! Good job, thank you )09:51
daemontoolif possible, please do further invasive tests this week09:51
*** frescof__ has quit IRC09:51
*** frescof__ has joined #openstack-freezer09:52
reldanYes, daemontool. Sure.09:52
*** szaher_ has joined #openstack-freezer09:55
*** szaher has quit IRC09:56
*** EinstCrazy has quit IRC09:57
daemontoolreldan, please take a look at the reviews that can be mergeable here https://review.openstack.org/#/q/status:open+project:openstack/freezer10:02
reldandaemontool: Sure, will review all that today10:03
*** memogarcia has joined #openstack-freezer10:05
openstackgerritMerged openstack/freezer: Drop MANIFEST.in - Because it's already use PBR  https://review.openstack.org/26144210:07
*** memogarcia has quit IRC10:08
daemontoolvannif,  anything needs to be merged form the API for liberty and mitaka?10:08
openstackgerritMerged openstack/freezer: Fix grammatical and spelling errors in the README.rst file.  https://review.openstack.org/26606710:12
m3m0daemontool, https://review.openstack.org/#/q/owner:guillermo.ramirez-garcia%2540hp.com+status:open10:13
daemontoolm3m0,  reviewing them right now10:14
daemontoolm3m0,  here https://review.openstack.org/#/c/256417/5/disaster_recovery/api/api.py line 3510:18
daemontoolah ok sorry I just say a dictionary id returned if OPENSTACK_API_VERSIONS is not available from settings10:18
daemontoolall good10:18
daemontoolall: please review https://review.openstack.org/#/q/owner:guillermo.ramirez-garcia%2540hp.com+status:open10:21
daemontoolm3m0,  what about https://review.openstack.org/#/c/265864/ ?10:21
daemontoolvannif, can we implement a backup listing from the api using the scheduler?10:22
m3m0that last one is still work in progress10:22
m3m0daemontool ^^10:23
daemontoolTeam, today the temperature is high :)10:23
daemontoolm3m0,  yes I see that, do you plan to merge it for Mitaka?10:23
daemontoolhow much time do you need for it?10:23
m3m0yes, should be ready by the end of the week10:23
daemontoolok10:23
openstackgerritVishal kumar mahajan proposed openstack/freezer: Fix the parameter order of assertEqual.  https://review.openstack.org/26402810:41
m3m0daemontool10:41
m3m0https://blueprints.launchpad.net/freezer/+spec/freezer-templates10:41
m3m0^^10:41
*** memogarcia has joined #openstack-freezer10:41
openstackgerritMerged openstack/freezer: Pass proxy enviroment varibles in tox  https://review.openstack.org/26144910:44
openstackgerritMerged openstack/freezer: Updated Windows installer and binaries documentation  https://review.openstack.org/26522710:45
openstackgerritMerged openstack/freezer: Add default namespace to apiclient  https://review.openstack.org/26527710:46
openstackgerritMerged openstack/freezer: use openstack command to create user and project  https://review.openstack.org/26466510:46
openstackgerritMerged openstack/freezer: Deprecated tox -downloadcache option removed  https://review.openstack.org/25667810:52
openstackgerritMerged openstack/freezer: Blueprint specs for python-freezerclient repo  https://review.openstack.org/26377610:52
openstackgerritMerged openstack/freezer: Design specs and considerations for tenant based backups  https://review.openstack.org/25990510:52
*** emildi has joined #openstack-freezer11:15
*** openstackgerrit has quit IRC11:17
*** openstackgerrit has joined #openstack-freezer11:18
*** reldan has quit IRC11:42
*** reldan has joined #openstack-freezer11:59
openstackgerritVishal kumar mahajan proposed openstack/freezer: Fix the parameter order of assertEqual.  https://review.openstack.org/26402812:23
*** memogarcia has quit IRC12:30
daemontoolreldan,  can you review this patchset please, is about tests https://review.openstack.org/#/c/264028/12:34
reldandaemontool: Yes, sure12:34
reldandaemontool: +2 from me12:35
daemontoolreldan,  ok ty12:38
openstackgerritMerged openstack/freezer: Fix the parameter order of assertEqual.  https://review.openstack.org/26402812:38
*** EinstCrazy has joined #openstack-freezer12:45
*** Slashme has quit IRC13:18
*** Slashme has joined #openstack-freezer13:18
*** memogarcia has joined #openstack-freezer13:22
*** memogarcia has quit IRC13:56
*** ddieterly has joined #openstack-freezer14:05
*** ddieterly has quit IRC14:17
*** vannif has quit IRC14:29
*** ddieterly has joined #openstack-freezer14:55
*** vannif has joined #openstack-freezer14:57
ddieterlya requirement has come up to add the ability to backup /var/log and elastic search. any ideas on how much of an effort that would be?14:58
ddieterlyseems like freezer already has the ability to do /var/log14:58
ddieterlythis requirement is coming from the logging team14:59
daemontoolddieterly, I think /var/log is fairly easy to backup as generally it does not contain data that can be corrupted (i.e. /var/lib/postgres)15:13
daemontoola creation of a job so execute the backup is enough15:13
daemontoolin your use case is /var/log seating on an lvm volume?15:14
daemontooldo you have an estimate of the size of /var/log for your use case? this could help too15:15
ddieterlydaemontool: i don't have the answer to those questions15:16
ddieterlyin which meeting do these kind of things usually get discussed?15:18
daemontoolpublicly there's a weekly meeting every Thursday at 16:00 GMT (please let us know if this time is not suitable for you we can change it)15:20
daemontoolbut I think this is more a question for the logging team15:20
daemontoolinternally15:20
ddieterlythursday at 16:00 gmt works fine for me15:22
daemontoolddieterly, anyway it's a config setting15:22
daemontoolnow work related from the coding side15:22
ddieterlyok, how about the elasticsearch backup? i would imagine that there is some work there to dump a consistent state of the db before slurping up the files.15:23
daemontoolddieterly, es far as I know, elasticsearch write metadata on  journal files15:29
daemontoolso every write should be atomic15:29
daemontool*I think* by executing an lvm snapshot of /var/log/elasticsearch (or where the es logs are)15:30
daemontooland then executing a plain file system backup should work15:30
ddieterlyso this looks like a config change as well?15:30
daemontoolyep15:30
ddieterlyok, thanks.15:30
daemontoolyw15:31
ddieterlyis someone working on the devstack plugin for freezer?15:32
daemontoolyes15:33
ddieterlywho?15:33
daemontoolvannif15:33
daemontooldid one for the freezer-api15:34
daemontoolhttps://github.com/openstack/freezer-api/tree/master/devstack15:34
daemontoolbut we need to add one also for freezer15:34
daemontoolnow the gate job is experimental15:34
daemontoolwe need to set it as voting15:34
ddieterlyok15:35
daemontoolif you are interested on doing it for the freezer repo please go on15:35
ddieterlyi'm thinking about it15:35
daemontoolalso for the freezer-web-ui repo15:35
daemontoolok15:35
daemontoolas you want15:35
ddieterlyis there a prioritized list of things to work on for freezer?15:37
frescof__ddieterly: https://blueprints.launchpad.net/freezer15:39
ddieterlyis this what people are working off of? https://blueprints.launchpad.net/freezer15:39
ddieterlyah, yes15:39
daemontoolddieterly,  one sec15:39
daemontoolthere's also a roadmap15:39
daemontoolon the wiki15:39
daemontoolhttps://wiki.openstack.org/wiki/FreezerRoadmap from https://wiki.openstack.org/wiki/Freezer15:40
daemontoolddieterly,  if I have to be honest15:40
daemontoolwe need to be more open and disciplined15:40
ddieterlyno, lie to me. i like that. ;-)15:40
daemontoolhaha15:40
daemontoolok15:40
daemontoolregarding the blueprint15:41
daemontoolroadmap etc15:41
daemontoolsometimes we start writing code before write the bp and so on15:41
daemontoolnow we are trying to be a bit more strict15:41
ddieterlyyea, c'est la guerre15:41
daemontoollol15:41
daemontoollike this one https://blueprints.launchpad.net/freezer/+spec/freezerclient15:42
daemontooland follow the template15:42
daemontooland so on15:42
daemontoolsometimes we do, sometimes not15:42
daemontoolc'est la vie :)15:42
daemontoolbut you can work on anything you want15:42
daemontoolreally15:42
ddieterlycool15:43
daemontoolddieterly,  anywah you are very welcome >)15:43
daemontoolthere's also this specs for tenant based backups in case you have time to review it https://review.openstack.org/#/c/259905/15:47
ddieterlyok15:47
ddieterlythanks15:47
daemontoolvannif,  ping15:49
daemontoolvannif,  < ping -s 1380 -f15:50
frescof__:D15:52
daemontoolreldan,  do you remember that issue you had with testr that wasn't showing the coverage report?15:52
daemontoolI'm having the same issue with openstack/freezer-api15:52
daemontoolon15:52
reldanYes, I remember15:53
daemontoolhttps://review.openstack.org/#/c/260950/15:53
daemontoolhow did you solve it_15:53
daemontool?15:53
daemontoolEinstCrazy, Hi15:53
reldanBut it was locally, nope. I just started to use coverage on jenkins15:53
daemontoolany thoughts about that?15:53
daemontoolRan 266 tests in 0.795s15:54
daemontoolPASSED (id=0)15:54
daemontoolNo data to report.15:54
daemontoolpy27 runtests: commands[2] | coverage report -m15:54
daemontool  /home/anakin/software/python/freezer-api-testr/freezer-api$ /home/anakin/software/python/freezer-api-testr/freezer-api/.tox/py27/bin/coverage report -m15:54
daemontoolName    Stmts   Miss  Cover   Missing15:54
daemontool-------------------------------------15:54
daemontoolNo data to report.15:54
daemontoolERROR: InvocationError: '/home/anakin/software/python/freezer-api-testr/freezer-api/.tox/py27/bin/coverage report -m'15:54
daemontoolin the freezer-api when using testr15:54
daemontoolno code is executed by the etsts15:54
EinstCrazyHi15:54
daemontools/etsts/tests/15:54
daemontoolEinstCrazy,  how are you doing15:55
reldan2015-12-23 10:59:01.947 | 2015-12-23 10:59:01,932 root ERROR Missing request body15:55
reldan2015-12-23 10:59:01.951 | 2015-12-23 10:59:01,936 root INFO Action registered, action id: qwerqwerqwerrewq15:55
daemontoolyour contribs are most welcome and they do not pass unnoticed15:55
reldan2015-12-23 10:59:01.952 | 2015-12-23 10:59:01,937 keystonemiddleware.auth_token INFO Starting Keystone auth_token middleware15:55
reldan2015-12-23 10:59:01.968 | 2015-12-23 10:59:01,938 root ERROR regular test failure15:55
reldan2015-12-23 10:59:01.968 | 2015-12-23 10:59:01,939 root ERROR regular test failure15:55
reldan2015-12-23 10:59:01.968 | 2015-12-23 10:59:01,939 keystonemiddleware.auth_token WARNING15:55
reldan2015-12-23 10:59:01.968 | 2015-12-23 10:59:01,940 root ERROR Unable to update session asdfsadf. TransportError(regular test failure, 1)15:56
reldanA lot of errors before15:56
daemontoolcan anyone throw something to vannif  there?15:56
daemontoollol15:56
vannifyo15:57
daemontoolvannif,  do you have any idea why on https://review.openstack.org/#/c/260950/15:57
daemontoolwhen switching to testr no lines of code are executed?15:58
EinstCrazyYeah, nowadays I want to have some backup to openstack vm, I've noticed this project. And I want to do something of it. But I've some problem in running it. Where could I get a help?15:58
EinstCrazyHow could I run the scheduler15:58
daemontoolEinstCrazy, your comment let me understand that our documentation about that is poor, right?15:59
daemontoolEinstCrazy,  do you need to backup the whole vm or data whitin the vm?15:59
EinstCrazyrecently, I want to backup the whole vm. but data within the vm will be needed nearly16:01
daemontoolvannif,  http://paste.openstack.org/show/wxQOuMT4aeZVv4o8Kd4a/ in particular the part where it says "Coverage.py warning: Module freezer-api was never imported."16:02
daemontoolok16:02
daemontoolis the data on a volume or on the vm?16:02
daemontoolso we provide basic feature for the vm backups16:02
daemontoolreldan, can give you help on that16:02
daemontoolbut it can be done16:03
EinstCrazywell, I want to backup the whole vm automatic first. I can get that ?16:03
reldanEinstCrazy - do you want to backup attached cinder volumes as well?16:04
EinstCrazyyes16:04
daemontoolreldan, when you get the chance, can you add that steps to the doc?16:05
daemontoolty!16:05
daemontoolvannif, any clue?16:05
reldanUnfortunatelly we have no such feature now. We can implement nova ephemeral disk backup or we can invoke cinder backup on volume, or create a snapshot from cinder volume, then create additional volume, create an image from volume, download image from glance and upload it to storage16:06
daemontoolreldan,  can we use the scheduler to execute 2 jobs, one that execute a vm backup and the otehr to execute a cinder volume backup?16:06
daemontoolof course backing the cinder volume attached to the vm16:07
daemontoolthat's probably what EinstCrazy  is looking for16:07
daemontoolright?16:07
EinstCrazyWhile, what if the volume attached to a activity vm?16:07
reldanIn this case we can do a snapshot with force (yes, we can get inconsistency in this case)16:08
*** dschroeder has joined #openstack-freezer16:08
daemontoolEinstCrazy, yes in that case we would get crash consistent backup16:08
EinstCrazyThank you.16:09
EinstCrazyAnd I want to know how could I run the freezer-scheduler ?16:09
reldanI suppose vannif is the biggest expert for scheduler16:10
daemontoolEinstCrazy,  did you tried from https://github.com/openstack/freezer/blob/master/README.rst to follow the steps after16:13
daemontool"The first step to use the scheduler is creating a document with the job:"16:13
EinstCrazyThank you. I'll try later.16:24
daemontoolEinstCrazy,  please let us know if you need any help16:25
EinstCrazyThank you. I'm great to talk anything about the project or sth of backup.16:26
*** EinstCrazy has quit IRC16:28
*** samuelBartel has quit IRC17:04
vannifsorry. I was busy17:05
daemontoolvannif,  np17:06
vanniffreezer-scheduler .. what is exactly that you want to do ? run it inside a vm ?17:06
daemontoolI wat thinking, what about an option of executing the jobs in parallel?17:06
daemontool:)17:06
daemontoolvannif,  I don't know it was EinstCrazy issue17:07
vannifjobs in parallel ? you mean execute different actions in parallel, specified in the same job ?17:08
vannifor completely different jobs, each with it's own job document and scheduling information ?17:08
daemontoolvannif,  yes17:08
openstackgerritFausto Marzi proposed openstack/freezer-api: Switch to testr from pytest  https://review.openstack.org/26095017:08
daemontoolmultiple actions in parallel17:09
daemontoolwithin the same job17:09
daemontoolanyway17:09
daemontoolthere was the case of a user17:09
daemontoolthat wants to use the scheduler17:10
daemontoolto execute a backup of a vm and a volume attached to it17:10
daemontoolso we should probably ad a job example for the scheduler to the doc17:10
daemontoolvannif,  ^^17:10
daemontoolplease take a look at https://review.openstack.org/26095017:10
reldandaemontool, please take a look https://review.openstack.org/#/c/266470/17:10
daemontoolI think now we are ready17:10
daemontoolfor branching17:10
daemontooltomorrow I'll do it17:10
daemontoolreldan,  that's cool17:11
daemontoolneeded from long time17:11
daemontool:)17:11
reldanYes, and really small change )17:11
vannifbackup the ephemeral volume of a VM ? you need to execute the backup on the node on which the vm is running17:11
daemontoolwhy?17:12
daemontoolwe can use the nova api and the cinder api17:12
daemontoolwe can create a job with two actions17:12
daemontool1 for the vm backup and another one for the cinder volume attached17:12
vannifoh, yes. but nova suspends the vm while the backup is running. if that's ok, then yes17:13
daemontoola snapshot is created...17:14
daemontoolI don't think the vm is suspended while the snapshot is created17:14
daemontoolreldan,  any clue?17:14
reldandaemontool: It shouldn’t from my point of view. But I’m not sure17:15
daemontoolreldan,  can you check that?17:15
daemontoolplease?17:15
reldanYes, sure17:15
reldanWe are at the meeting now, but after that I will check17:15
daemontoolvannif,  please review https://review.openstack.org/#/c/266470/17:16
daemontooland https://review.openstack.org/#/c/260950/17:16
daemontoolreldan,  you too if you get the chance please17:16
reldanYes, sure17:16
daemontoollet's finish jenkins verify first17:17
daemontoolI have to go now17:17
daemontoolI'll be back online in ~1 hour17:17
daemontoolfrescof,  https://review.openstack.org/#/c/260950/17:18
*** daemontool has quit IRC17:22
*** reldan has quit IRC18:02
*** ddieterly has quit IRC18:17
*** reldan has joined #openstack-freezer18:57
*** daemontool has joined #openstack-freezer19:00
openstackgerritDeklan Dieterly proposed openstack/freezer: Add check for name=='__main__'  https://review.openstack.org/26655219:55
*** reldan has quit IRC20:49
*** daemontool has quit IRC20:52
*** reldan has joined #openstack-freezer20:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!