Thursday, 2015-10-08

*** openstackgerrit has quit IRC00:01
*** openstackgerrit has joined #openstack-freezer00:01
*** reldan has quit IRC01:22
*** szaher has quit IRC02:12
*** dschroeder has quit IRC02:57
*** smekel has quit IRC04:07
*** smekel has joined #openstack-freezer04:08
*** szaher has joined #openstack-freezer07:49
*** reldan has joined #openstack-freezer08:22
*** reldan has quit IRC08:22
*** reldan has joined #openstack-freezer08:47
*** jonaspf has quit IRC09:00
*** jonaspf has joined #openstack-freezer09:02
*** nullvariable has joined #openstack-freezer10:17
*** jonaspf has quit IRC10:19
*** jonaspf has joined #openstack-freezer10:22
*** vannif has quit IRC10:26
*** jonaspf has quit IRC11:25
*** jonaspf has joined #openstack-freezer11:26
openstackgerritEldar Nugaev proposed stackforge/freezer: Test coverage improvments: Validator and Utils  https://review.openstack.org/23146911:28
openstackgerritEldar Nugaev proposed stackforge/freezer: Test coverage improvments: Validator and Utils  https://review.openstack.org/23146911:31
*** jonaspf has quit IRC11:41
*** jonaspf has joined #openstack-freezer11:45
openstackgerritEldar Nugaev proposed stackforge/freezer: Test coverage improvments: Validator and Utils  https://review.openstack.org/23146912:12
*** jonaspf has quit IRC12:14
*** jonaspf has joined #openstack-freezer12:18
*** vannif has joined #openstack-freezer13:22
*** marzif has joined #openstack-freezer13:23
*** marzif has quit IRC13:41
*** marzif has joined #openstack-freezer13:41
*** marzif has quit IRC14:00
*** marzif has joined #openstack-freezer14:01
*** marzif has quit IRC14:02
*** jonaspf has quit IRC14:37
*** dschroeder has joined #openstack-freezer14:43
*** jonaspf has joined #openstack-freezer14:45
openstackgerritMemo Garcia proposed stackforge/freezer-web-ui: Add Freezer dashboard to Admin dashboard  https://review.openstack.org/23258115:00
m3m0Hey guys are you ready for the meeting?15:01
m3m0#startmeeting15:01
freezerBot`m3m0: Error: A meeting name is required, e.g., '#startmeeting Marketing Committee'15:01
openstackm3m0: Error: A meeting name is required, e.g., '#startmeeting Marketing Committee'15:01
reldanready15:01
m3m0#startmeeting Thu 08/ 1015:01
freezerBot`Meeting started Thu Oct  8 15:01:45 2015 UTC and is due to finish in 60 minutes.  The chair is m3m0. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
freezerBot`Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
freezerBot`The meeting name has been set to 'thu_08__10'15:01
openstackMeeting started Thu Oct  8 15:01:45 2015 UTC and is due to finish in 60 minutes.  The chair is m3m0. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
openstackThe meeting name has been set to 'thu_08__10'15:01
m3m0as always, notes about the meeting are available here... https://etherpad.openstack.org/p/freezer_meetings15:02
m3m0please update your information15:02
m3m0vannif, you are first to go15:03
vannifhi all.15:04
vannifworking on integration tests.15:04
vannifto install freezer-api as a devstack plugin15:05
vannifand freezer-web-ui as well as soon as the freezer-api installs flawlessly15:05
vannifI've also to finish some more evoluted integration tests for lvm15:06
m3m0do we have a blueprint that we can review or comment for this task?15:06
*** marzif has joined #openstack-freezer15:06
vannifhmmm not specifically for devstack plugins, they are part of a broader effort to provide integration tests15:06
marzifI'm late, sorry15:06
vannifthat is pretty much all for me atm15:07
m3m0is this internal or external effort? this will be commited upstream?15:07
vannifyes. upstream.15:07
m3m0cool, if you need help with reviews let us know15:08
vannifactually it's a /devstack folder in the freezer-api project tree wich contains scripts to install the api15:08
vannifin the end the user will only need a single line in the local.conf15:08
vannifwhich triggers the git clone and install scripts15:09
m3m0I assume the README cover this procedure right?15:09
vannifthat is the "framework" for the integration tests15:09
vannifyes, it will contain instructions for that15:09
m3m0nice :)15:10
vannifbut htanks for the remainder ;)15:10
vannifreminder15:10
m3m0no problem :)15:10
m3m0do you have anything else to say? or do you need help with anything?15:11
vannifnothing mush to say. Fausto is giving me some help with the devstack dependencies installation15:12
vannifs/mush/much15:12
m3m0perfect :), thanks a lot15:12
vannifthank you15:12
m3m0reldan you're next15:12
reldanThank you15:13
reldanLast week I mostly was improving code coverage. Cannot say that I improved it drastically, but a couple of percentages.15:14
reldanI also should make changes in cofig - for parallel backup, but going to do it after release15:14
m3m0that's great news15:14
m3m0about what exactly?15:14
reldanAbout 2.0 I assume15:15
reldanThat should be in couple of weeks15:15
reldanI also would like to refactor lvm/shadow15:16
m3m0I agree with the refactor15:16
m3m0the interface should be the same15:16
reldanBecause now for example we cannot do windows shadow with mysql15:16
reldanonly lvm15:16
reldanAnd it seems not very right15:16
m3m0that's true, it should be decouple15:17
reldanAlso lvm is the last place that heavily uses backup_dict15:17
m3m0but are we going to use the exec command? or do you have anything in mind for that?15:17
reldanAnd not only read from this dictionary, but makes writes to dictionary and even replaces15:18
reldanSorry, what is exec command?15:18
m3m0shadow code also has the same behaviour15:18
m3m0is for pre and post script execution15:18
reldanYes, and let’s imagine that we would like to support postreSql15:19
reldanYes, we should create some classes here and decouple, making snapshot shoudn’t know anything about mysql, sqlserver, mongo or anything15:19
reldanI was trying to refactor it - but it seems to be a very big refactor, so I just postponed it until the release15:20
m3m0and how will we manage the release of the databases after the snapshot creation?15:21
m3m0how is develop right now is that it blocks the db and then create a snapshot and then relase the db, is that behaviuor going to change?15:21
m3m0or this is an early talk?15:22
reldanlet’s say we have an Application - it may by Mongo, Mysql, Postgres and it should have stop and start. And Snaphsot engine (Shadow, Lvm) with create and remove15:22
reldanSo we should have application.stop(); snapshot.create(); application.start(); snapshot.remove()15:23
m3m0I like this kind of interface15:23
marzifreldan,  you are referring to the object interface, but not on stopping the service itself right?15:23
marzifI think it's good15:24
marzifwe can do something like application.flush()15:24
reldanYou, know probably it is not a good name. But as far as I know for mssql - we actually stop service15:24
reldanmarzif: +115:24
marzifyes15:24
m3m0yes15:24
m3m0until we find a better way15:24
marzifapplication.stop if we stop make sense :)15:24
marziffor mysql we can use app.flush15:24
reldanlet’s say flush15:25
reldanand recover15:25
vannifwhat about context managers ?15:25
m3m0I have a question15:25
reldanWhat is a context manager?15:25
m3m0if a new application will be supported as a plugin, should we add an interface to extend the arguments for that application?15:25
vanniffor example:15:25
vannifwith db.lock:15:25
vannif  do things15:26
reldanm3m0: If we have a pluggable mechanism - probably we can just search it by name15:26
vannifwell, we can discuss it in a deep dive15:26
reldanYes, anyway we can provide application to snapshot, if we actually need it15:27
reldanlike snapshot.create(application)15:27
reldansnapshot.remove(application)15:27
m3m0mmm do we actually need to pass the application?15:28
marziflet's write a bp for this15:28
reldanI have no idea, but if it is necessery - we can do this way15:28
reldanAdditional small comment - I suppose we should return from a job some result15:28
m3m0+1 for the bp15:28
reldanAnd don’t work with backup_dict15:29
reldanLet’s have backup_dict at least read_only15:29
szahervannif that what we were discussing today ?15:29
reldanAnd after the release, we should integrate rsync15:30
m3m0but we return a result15:30
reldanIt everything I had15:30
m3m0at least with the api isn't15:30
m3m0?15:30
marzifreldan,  backup_dict I think will be removed with Cliff15:30
reldanmarzif: Yes! And it means that we should return something new instead of dict15:31
reldanAnd we shouldn’t have a writes to dict15:31
marzifafter oslo.log implementation we can proceed with Cliff, yep15:31
vannifszaher, before lunch ? no, it was configuration file support. removing the backup_opt_dict is something that we discuss about in regard to many aspects, not just because of oslo.config15:31
vannifthey are related of course15:32
szahervannif, no what me, you and pierrer pluggable arch. for storage and agent15:32
vannifbut I think reldan is talking about how to refactor the snapshot and db-locking code15:32
szaher vannif, no what me, you and pierre were discussing before that15:33
reldanOk, let’s discuss it later - because it already takes so long15:33
szaherOk, sorry guys15:33
vannifmoving responsibilities to specific objects15:33
reldanI have nothing to add now15:33
m3m0thanks reldan15:33
reldanThank you m3m015:33
m3m0and let us know if you need reviews or help with anything15:34
reldanhttps://review.openstack.org/#/c/231469/15:34
marzifreldan,  there are two reviews that needs to be +Aed right?15:34
m3m0marzif you're next15:34
marzifok15:34
reldanhttps://review.openstack.org/#/c/229467/15:34
reldanYes15:34
marzifI've been helping vannif  with the integrated tests, doing code review, some arch meeting15:35
marzifnothing really concrete lol15:35
marzifI think we should move to cliff after oslo.log15:35
m3m0I agree with that15:35
marzifand rethink the cli in a way that is backward compatible for a while15:36
marzifand create the python-freezerclient module15:36
marzifalso I'm following up the move of the stackforge/freezer* repos to openstack namespace15:36
m3m0szaher said that we should deprecate freezerc15:36
m3m0and start using freezer15:36
marzifwe should use freezer-agent15:37
marzifexplicitally15:37
m3m0but not get rid of freezerc until the next release15:37
marzifand freezer for the freezer client15:37
marziffreezerc is not a big issue, we can just create a symlink15:37
marzifwhen we install the python egg15:37
marzifanyway, we can dive deep on this after the oslo log implementation15:38
m3m0and +2 for python-freezerclient15:38
marzifalso we need to change the way we tag the releases across our 3 repos15:38
m3m0is oslo.log planned for 2.0?15:38
marzifnope15:38
marzifSaad write the code15:39
marzifbut it won't be in15:39
marzifas soon 2.0 is released we'll merge the oslo.log stuff15:39
marzifalso we need to use a common version15:39
marziflike 2015.10.08 for the 3 packages15:39
scmarzif: I can help with logging but after work, it's difficult to schedule work on freezer for me other wise15:40
marzifotherwise we don't know which freezer-api works for sure the freezer-scheduler and so on15:40
marzifsame for the web-ui15:40
scszaher: do you mind some after dinner sessions?15:40
m3m0and are we going to create branches for openstack relases?15:41
m3m0like stable/liberty?15:41
marzifif we can yes15:41
marzifwe have to15:41
m3m0or are we going to move differently?15:41
marzifstable/release_name15:41
marzifbut I was referring to the release naming convention15:41
marziffor the python eggs we upload to pypi15:41
marzifwhile the repo branching/tagging is exactly as you said15:42
m3m0and is there any difference once we move from stackforge to openstack?15:43
*** szaher_ has joined #openstack-freezer15:43
marzifwe probably needs less interaction with infra15:44
marzifbut it will be all the same15:44
m3m0and do you need help with anything?15:44
marzifnot for now15:45
marzifty15:45
marzifthat's all from me15:45
m3m0cool, thanks :)15:45
m3m0szaher zsaher_ you're next15:45
reldanI don’t see him15:46
m3m0thanks :)15:47
m3m0I'll go next15:47
m3m0I've been working on the ui15:47
m3m0some commits are merged that help with the interaction of the newer versions of the api15:47
m3m0and fix some bugs15:47
m3m0now I'm working on the UX part of the ui15:48
m3m0and soon on the testing, the thing is that besides unittesting I'll need to implement selenium testing15:48
m3m0as part as the UX enhancements15:48
m3m0the job window will be enough for a new user to create jobs with actions and managing sessions15:49
m3m0but if they want, they can manage those items individually in their on page15:49
*** szaher_ has quit IRC15:50
m3m0I'm also adding a CRUD page for actions15:50
m3m0and a list of clients to interact with15:50
m3m0and a kind of big re factoring in the code because most of the code is boilerplate and it's been repeated over and over15:50
m3m0and I have this commit in progress https://review.openstack.org/#/c/232581/15:51
m3m0which enable freezer dashboard on the admin panel15:51
m3m0but I have a question marzif15:51
m3m0do we want freezer to be on it's own panel but only visible to admins15:52
m3m0or do we want freezer to be included on the admin panel itself15:52
m3m0the first one is very very easy to implement15:52
m3m0the second one is a little bit more tricky15:53
m3m0and lastly for the ui15:53
m3m0I'm working on a installation script to make things easier for automation15:53
m3m0regarding windows, I haven't work on that for a while15:53
m3m0and I need to rebase the changes for freezer-agent on windows15:53
m3m0and complete the scheduler for windows as well15:54
m3m0that's it for me at the moment15:54
m3m0szaher, you're next15:54
szaherOkay15:55
szaherActually I was working on bug fixing15:55
szaherI fixed some and we need to test them on windows first15:55
szahernot all but this one specially https://review.openstack.org/#/c/229467/15:56
szaherplz review and If it's Okay approve15:56
szaherm3m0 vannif we need to approve after m3m0 test on windows15:56
szahersorry this is the correct one https://review.openstack.org/#/c/231398/15:57
szaherI will be working on making freezer use oslo libraries for now it will be logging15:58
szaherthat is it for me, fixing bugs and this blueprint :)15:59
szaherthanks m3m015:59
m3m0nice, thanks a lot szhare16:00
m3m0do you have anything more to say16:00
m3m0#endmeeting16:00
freezerBot`Meeting ended Thu Oct  8 16:00:43 2015 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:00
freezerBot`Minutes:        http://meetbot.stefanocanepa.it/freezer/openstack-freezer/2015/openstack-freezer.2015-10-08-15.01.html16:00
freezerBot`Minutes (text): http://meetbot.stefanocanepa.it/freezer/openstack-freezer/2015/openstack-freezer.2015-10-08-15.01.txt16:00
freezerBot`Log:            http://meetbot.stefanocanepa.it/freezer/openstack-freezer/2015/openstack-freezer.2015-10-08-15.01.log.html16:00
openstackMeeting ended Thu Oct  8 16:00:43 2015 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/thu_08__10/2015/thu_08__10.2015-10-08-15.01.html16:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/thu_08__10/2015/thu_08__10.2015-10-08-15.01.txt16:00
openstackLog:            http://eavesdrop.openstack.org/meetings/thu_08__10/2015/thu_08__10.2015-10-08-15.01.log.html16:00
marzifm3m0,  sorry I didn't see your questions16:06
marzif:(16:06
marzifit will be for admin and normal users16:08
*** marzif has quit IRC16:08
*** marzif has joined #openstack-freezer16:08
marzifso we can manage infrastructure nodes  from the admin, and backup as a service from the user panel16:09
marzifalso the disaster recovery can be helpful from the admin16:09
marzifit's good question we need to understand what make sense for admin and what not16:09
marzifI think for now it's worth to have it in both places16:09
marzifanyone can review this https://review.openstack.org/#/c/231469/16:28
*** reldan has quit IRC17:03
*** reldan has joined #openstack-freezer17:22
*** subscope has joined #openstack-freezer17:25
*** marzif has quit IRC17:35
*** reldan has quit IRC18:17
*** reldan has joined #openstack-freezer18:26
*** ig0r_ has joined #openstack-freezer20:58
*** ig0r_ has quit IRC21:03
*** ig0r_ has joined #openstack-freezer21:05
*** ig0r_ has quit IRC21:10
*** m3m0 has quit IRC23:07
*** m3m0 has joined #openstack-freezer23:10

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!