15:01:48 #startmeeting openstack-freezer 06-08-2015 15:01:48 Meeting started Thu Aug 6 15:01:48 2015 UTC and is due to finish in 60 minutes. The chair is m3m0. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:01:48 m3m0: Error: Can't start another meeting, one is in progress. Use #endmeeting first. 15:01:49 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:01:52 The meeting name has been set to 'openstack_freezer_06_08_2015' 15:02:21 fabriziov please go ahead 15:02:27 ok 15:02:46 I'm currently working on integration tests with Eldar. 15:03:34 for the client? api? or scheduler? or all of theem? 15:03:43 we plan on writing tests that will spawn an instance of the freezer agent, execute backups and check the results 15:04:05 the scheduler will be involved in a second moment 15:04:41 the idea is to start writing some tests using cmdline or config files 15:05:08 the scheduler is a daemon and it won't exit with an exit_code 15:05:36 I think testing the freezer agent will be a big improvement. 15:05:48 I agree with that 15:05:56 we spend a lot of time testing the storage plugins 15:06:10 I've been testing local in windows as well 15:06:14 it doesn't work 15:06:37 tar binaries don't support --file argument :( 15:06:57 any progress in the testing on linux? 15:07:42 what u mean ? 15:07:58 integration tests ? 15:08:23 in windows local storage is not working because the tar binary doesn't support the --file argument need it for that 15:08:48 but what was the outcome for the testing in linux of the storage plugins? 15:08:54 oh, ok. yes in linux we tested local storage and ssh storage as well 15:09:33 it seems to be working, but we can't spend all that time whenever we need to modify some code 15:09:50 I agree with thaty 15:10:24 at the moment we don't spin up any vagrant machine. the tests will check if OS env vars are defined 15:10:41 and use any cloud instance is defined 15:10:47 or SSH remote host 15:11:37 so that tests can be done quickly on the workstations. 15:12:40 later I've to check a probable problem with the scheduler when api is not reachable. 15:13:02 perfect, but could be nice if you write some docs on how to reproduce the test environment 15:13:36 and work on support for older versions of the falcon wsgi framework, since we are tied to old version for HLM 15:13:47 yes. definitely 15:14:17 how's that going? 15:15:12 need to remove some features introduced by version 0.2.0 such as middlewares 15:15:37 I mean, middlewares will stay, but written in another way :) 15:15:56 still need some time tho 15:16:11 do you think it will get into beta 1? 15:16:35 that is the idea 15:16:49 if you need help just let me know 15:17:11 sure thanks. 15:17:57 do you have anything more to add? 15:18:45 no, I think that's all for now 15:19:36 thanks :) 15:19:40 reldan you're next 15:19:51 Thank you 15:19:57 1) SSH Storaged is merged 15:19:57 2) I have commit about improving unit-tests for storage.py. Here it is - please review https://review.openstack.org/#/c/209916/ 15:19:58 3) Now Fabrizio and I are working on integration tests. 15:20:04 The first phase - implementing backup and restore / write backup restore correctness checker - analyse tree, hashsumms, owners etc. 15:20:05 And the first phase will be using local storage. It is easy, it is hard to imagine a workstation without hdd in real life, 15:20:06 we shouldn't manage credentials at first step. 15:20:28 And first step will be just testing it from python - invoke main method with additional parameters. 15:20:32 The second phase - test incremental backups, restore, remove_older_than, always_level, max_level 15:20:42 The third phase and next phases - LVM, WINDOWS, SWIFT, SSH - here we need a lot of work with environement, devstack, windows etc. 15:20:49 And it has a lot of open questsions: like - how to run it in openstack infra. 15:20:54 It will be great to test it in Windows and Linux, and probably in different flavors of linux as well. 15:21:05 But all of that should be discussed later. 15:21:52 do you have a date for the first phase? 15:22:50 I want to show some result tomorrow and after that we will increase number of tests 15:23:05 perfect, very very good job 15:23:31 Thank you! 15:23:38 do you have anything to add? 15:23:48 Nope, thank you m3m0 15:23:52 thanks 15:24:00 Slashme you're next 15:25:10 Hey, nothing on the public side for me this week, I'm very busy with internal stuff 15:25:42 grat :) 15:26:12 well for marzif... he's working on the rsync incremental 15:26:46 https://review.openstack.org/#/c/159804/ if you can take a look and review that it will be appreciate 15:26:47 rsync incremental, lvm-autosnap working with both /dev/dm-* and /dev/mapper-* 15:27:07 and he's working on fixing the problem of the autosnap argument in freezer 15:27:18 thanks m3m0 :) 15:27:49 ok, for my side, I've been working on implementing a verbose mode for freezerc 15:28:05 https://review.openstack.org/#/c/209555/ 15:28:13 and it is still on development 15:28:44 I've been testing the new storages on windows and I've found several issues 15:29:40 the first one is that --file argument fails on windows because it needs another argument which is the --multiple-volume 15:30:07 but when provide that it cannot work on compressed tar, so I'm looking how to fix that 15:30:28 and for ssh storage there is another issue 15:31:03 because (as far as I know) the only way to have ssh installed on windows is to use cygwin or similar emulators 15:31:58 so that force users to install another dependencie 15:32:06 dependency* 15:32:54 also I readded freezerc as an entry point in windows 15:33:07 and fix some vssadmin issues 15:33:34 change all the "/" in paths for os.sep 15:34:24 and as soon as I finish with windows I'll integrate freezer with monasca 15:34:28 that's it for me 15:34:41 does anyone have anything more to add? 15:35:11 if not please make sure to review some of the commits that are in gerrit 15:36:23 #endmeetinup] 15:36:26 #endmeetinup 15:37:49 #endmeeting