15:01:48 <m3m0> #startmeeting openstack-freezer 06-08-2015 15:01:48 <openstack> Meeting started Thu Aug 6 15:01:48 2015 UTC and is due to finish in 60 minutes. The chair is m3m0. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:01:48 <freezerBot`> m3m0: Error: Can't start another meeting, one is in progress. Use #endmeeting first. 15:01:49 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:01:52 <openstack> The meeting name has been set to 'openstack_freezer_06_08_2015' 15:02:21 <m3m0> fabriziov please go ahead 15:02:27 <fabriziov> ok 15:02:46 <fabriziov> I'm currently working on integration tests with Eldar. 15:03:34 <m3m0> for the client? api? or scheduler? or all of theem? 15:03:43 <fabriziov> we plan on writing tests that will spawn an instance of the freezer agent, execute backups and check the results 15:04:05 <fabriziov> the scheduler will be involved in a second moment 15:04:41 <fabriziov> the idea is to start writing some tests using cmdline or config files 15:05:08 <fabriziov> the scheduler is a daemon and it won't exit with an exit_code 15:05:36 <fabriziov> I think testing the freezer agent will be a big improvement. 15:05:48 <m3m0> I agree with that 15:05:56 <fabriziov> we spend a lot of time testing the storage plugins 15:06:10 <m3m0> I've been testing local in windows as well 15:06:14 <m3m0> it doesn't work 15:06:37 <m3m0> tar binaries don't support --file argument :( 15:06:57 <m3m0> any progress in the testing on linux? 15:07:42 <fabriziov> what u mean ? 15:07:58 <fabriziov> integration tests ? 15:08:23 <m3m0> in windows local storage is not working because the tar binary doesn't support the --file argument need it for that 15:08:48 <m3m0> but what was the outcome for the testing in linux of the storage plugins? 15:08:54 <fabriziov> oh, ok. yes in linux we tested local storage and ssh storage as well 15:09:33 <fabriziov> it seems to be working, but we can't spend all that time whenever we need to modify some code 15:09:50 <m3m0> I agree with thaty 15:10:24 <fabriziov> at the moment we don't spin up any vagrant machine. the tests will check if OS env vars are defined 15:10:41 <fabriziov> and use any cloud instance is defined 15:10:47 <fabriziov> or SSH remote host 15:11:37 <fabriziov> so that tests can be done quickly on the workstations. 15:12:40 <fabriziov> later I've to check a probable problem with the scheduler when api is not reachable. 15:13:02 <m3m0> perfect, but could be nice if you write some docs on how to reproduce the test environment 15:13:36 <fabriziov> and work on support for older versions of the falcon wsgi framework, since we are tied to old version for HLM 15:13:47 <fabriziov> yes. definitely 15:14:17 <m3m0> how's that going? 15:15:12 <fabriziov> need to remove some features introduced by version 0.2.0 such as middlewares 15:15:37 <fabriziov> I mean, middlewares will stay, but written in another way :) 15:15:56 <fabriziov> still need some time tho 15:16:11 <m3m0> do you think it will get into beta 1? 15:16:35 <fabriziov> that is the idea 15:16:49 <m3m0> if you need help just let me know 15:17:11 <fabriziov> sure thanks. 15:17:57 <m3m0> do you have anything more to add? 15:18:45 <fabriziov> no, I think that's all for now 15:19:36 <m3m0> thanks :) 15:19:40 <m3m0> reldan you're next 15:19:51 <reldan> Thank you 15:19:57 <reldan> 1) SSH Storaged is merged 15:19:57 <reldan> 2) I have commit about improving unit-tests for storage.py. Here it is - please review https://review.openstack.org/#/c/209916/ 15:19:58 <reldan> 3) Now Fabrizio and I are working on integration tests. 15:20:04 <reldan> The first phase - implementing backup and restore / write backup restore correctness checker - analyse tree, hashsumms, owners etc. 15:20:05 <reldan> And the first phase will be using local storage. It is easy, it is hard to imagine a workstation without hdd in real life, 15:20:06 <reldan> we shouldn't manage credentials at first step. 15:20:28 <reldan> And first step will be just testing it from python - invoke main method with additional parameters. 15:20:32 <reldan> The second phase - test incremental backups, restore, remove_older_than, always_level, max_level 15:20:42 <reldan> The third phase and next phases - LVM, WINDOWS, SWIFT, SSH - here we need a lot of work with environement, devstack, windows etc. 15:20:49 <reldan> And it has a lot of open questsions: like - how to run it in openstack infra. 15:20:54 <reldan> It will be great to test it in Windows and Linux, and probably in different flavors of linux as well. 15:21:05 <reldan> But all of that should be discussed later. 15:21:52 <m3m0> do you have a date for the first phase? 15:22:50 <reldan> I want to show some result tomorrow and after that we will increase number of tests 15:23:05 <m3m0> perfect, very very good job 15:23:31 <reldan> Thank you! 15:23:38 <m3m0> do you have anything to add? 15:23:48 <reldan> Nope, thank you m3m0 15:23:52 <m3m0> thanks 15:24:00 <m3m0> Slashme you're next 15:25:10 <Slashme> Hey, nothing on the public side for me this week, I'm very busy with internal stuff 15:25:42 <m3m0> grat :) 15:26:12 <m3m0> well for marzif... he's working on the rsync incremental 15:26:46 <m3m0> https://review.openstack.org/#/c/159804/ if you can take a look and review that it will be appreciate 15:26:47 <marzif> rsync incremental, lvm-autosnap working with both /dev/dm-* and /dev/mapper-* 15:27:07 <m3m0> and he's working on fixing the problem of the autosnap argument in freezer 15:27:18 <marzif> thanks m3m0 :) 15:27:49 <m3m0> ok, for my side, I've been working on implementing a verbose mode for freezerc 15:28:05 <m3m0> https://review.openstack.org/#/c/209555/ 15:28:13 <m3m0> and it is still on development 15:28:44 <m3m0> I've been testing the new storages on windows and I've found several issues 15:29:40 <m3m0> the first one is that --file argument fails on windows because it needs another argument which is the --multiple-volume 15:30:07 <m3m0> but when provide that it cannot work on compressed tar, so I'm looking how to fix that 15:30:28 <m3m0> and for ssh storage there is another issue 15:31:03 <m3m0> because (as far as I know) the only way to have ssh installed on windows is to use cygwin or similar emulators 15:31:58 <m3m0> so that force users to install another dependencie 15:32:06 <m3m0> dependency* 15:32:54 <m3m0> also I readded freezerc as an entry point in windows 15:33:07 <m3m0> and fix some vssadmin issues 15:33:34 <m3m0> change all the "/" in paths for os.sep 15:34:24 <m3m0> and as soon as I finish with windows I'll integrate freezer with monasca 15:34:28 <m3m0> that's it for me 15:34:41 <m3m0> does anyone have anything more to add? 15:35:11 <m3m0> if not please make sure to review some of the commits that are in gerrit 15:36:23 <m3m0> #endmeetinup] 15:36:26 <m3m0> #endmeetinup 15:37:49 <m3m0> #endmeeting