| *** openstackgerrit has quit IRC | 00:01 | |
| *** openstackgerrit has joined #openstack-freezer | 00:02 | |
| *** reldan has quit IRC | 00:17 | |
| *** jonaspf has joined #openstack-freezer | 00:25 | |
| *** arunb has quit IRC | 00:32 | |
| *** jonaspf has quit IRC | 01:06 | |
| *** jonaspf has joined #openstack-freezer | 01:13 | |
| *** jonaspf has quit IRC | 01:27 | |
| *** jonaspf has joined #openstack-freezer | 02:03 | |
| *** jonaspf has quit IRC | 02:18 | |
| *** jonaspf has joined #openstack-freezer | 02:32 | |
| *** jonaspf has quit IRC | 02:46 | |
| *** jonaspf has joined #openstack-freezer | 02:57 | |
| *** jonaspf has quit IRC | 03:12 | |
| *** jonaspf has joined #openstack-freezer | 03:13 | |
| *** Yitao has joined #openstack-freezer | 03:17 | |
| Yitao | Helop | 03:18 |
|---|---|---|
| *** Yitao has quit IRC | 03:18 | |
| *** jonaspf has quit IRC | 03:27 | |
| *** jonaspf has joined #openstack-freezer | 03:31 | |
| *** jonaspf has quit IRC | 03:47 | |
| *** jonaspf has joined #openstack-freezer | 04:08 | |
| *** jonaspf has quit IRC | 04:23 | |
| *** jonaspf has joined #openstack-freezer | 04:48 | |
| *** jonaspf has quit IRC | 05:16 | |
| *** jonaspf has joined #openstack-freezer | 05:20 | |
| *** jonaspf has quit IRC | 06:48 | |
| *** jonaspf has joined #openstack-freezer | 06:49 | |
| *** jonaspf has quit IRC | 07:04 | |
| *** jonaspf has joined #openstack-freezer | 07:10 | |
| *** jonaspf has quit IRC | 08:08 | |
| *** jonaspf has joined #openstack-freezer | 08:22 | |
| *** jonaspf has quit IRC | 08:40 | |
| *** jonaspf has joined #openstack-freezer | 08:56 | |
| *** jonaspf has quit IRC | 09:12 | |
| *** jonaspf has joined #openstack-freezer | 09:25 | |
| *** marzif has joined #openstack-freezer | 10:29 | |
| *** jonaspf has quit IRC | 11:12 | |
| *** jonaspf has joined #openstack-freezer | 11:13 | |
| *** reldan has joined #openstack-freezer | 11:35 | |
| *** marzif has quit IRC | 11:40 | |
| *** reldan has quit IRC | 11:56 | |
| *** reldan has joined #openstack-freezer | 12:13 | |
| *** jonaspf has quit IRC | 12:27 | |
| *** marzif has joined #openstack-freezer | 12:51 | |
| *** marzif_ has joined #openstack-freezer | 13:03 | |
| *** marzif has quit IRC | 13:04 | |
| *** marzif_ has quit IRC | 13:08 | |
| *** marzif_ has joined #openstack-freezer | 13:09 | |
| *** jonaspf has joined #openstack-freezer | 13:13 | |
| *** reldan has quit IRC | 13:15 | |
| *** reldan has joined #openstack-freezer | 13:22 | |
| openstackgerrit | Merged openstack/freezer: Fix nova backup https://review.openstack.org/238969 | 14:05 |
| openstackgerrit | Fabrizio Vanni proposed openstack/freezer: Fixed bug on requierments and deps https://review.openstack.org/238933 | 14:27 |
| openstackgerrit | Fabrizio Vanni proposed openstack/freezer: Improved freezerc and freezer-agent script management https://review.openstack.org/238940 | 14:35 |
| openstackgerrit | Memo Garcia proposed openstack/freezer: Fixed tar command for windows https://review.openstack.org/239932 | 14:41 |
| *** jonaspf has quit IRC | 14:50 | |
| *** dschroeder has joined #openstack-freezer | 15:07 | |
| *** jonaspf has joined #openstack-freezer | 15:08 | |
| openstackgerrit | Memo Garcia proposed openstack/freezer: Fixed tar command for windows https://review.openstack.org/239932 | 15:33 |
| *** jonaspf has quit IRC | 15:51 | |
| openstackgerrit | Memo Garcia proposed openstack/freezer: Fixed tar command for windows https://review.openstack.org/239932 | 15:52 |
| marzif_ | here: in 5 min we'll start the weekly meeting. Chairman: vannif | 16:00 |
| *** marzif_ has quit IRC | 16:00 | |
| *** marzif_ has joined #openstack-freezer | 16:00 | |
| *** jonaspf has joined #openstack-freezer | 16:03 | |
| vannif | #startmeeting 2015-10-29 | 16:05 |
| freezerBot` | Meeting started Thu Oct 29 16:05:19 2015 UTC and is due to finish in 60 minutes. The chair is vannif. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:05 |
| freezerBot` | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:05 |
| freezerBot` | The meeting name has been set to '2015_10_29' | 16:05 |
| openstack | Meeting started Thu Oct 29 16:05:19 2015 UTC and is due to finish in 60 minutes. The chair is vannif. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:05 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:05 |
| openstack | The meeting name has been set to '2015_10_29' | 16:05 |
| vannif | hello everyone | 16:05 |
| marzif_ | hello :) | 16:05 |
| vannif | shall we begin ? | 16:06 |
| marzif_ | yep | 16:06 |
| vannif | marzif, please start | 16:06 |
| marzif_ | I've been working on https://review.openstack.org/#/c/238940/ and https://review.openstack.org/#/c/238933/ | 16:06 |
| marzif_ | mainly on improving pbr support and requirements and still have the agent work on windows too (also with m3m0 code) | 16:07 |
| marzif_ | so now are installing before the setup() in setup.py the pre requirements | 16:08 |
| marzif_ | as advised in the pbr doc | 16:08 |
| marzif_ | well more then work on windows, that code allows the agent to be installed on windows | 16:08 |
| marzif_ | what really make the agent work is m3m0 code | 16:08 |
| marzif_ | also I've been doing few code reviews | 16:09 |
| marzif_ | I hope we can finish by tomorrow the dvsm integration job and restart working the block based incremental backups | 16:09 |
| vannif | so, we're introducing the freezer-agent in place of the freezerc script | 16:09 |
| marzif_ | one nice things also we submitted for the big tent here: https://review.openstack.org/#/c/239668/ | 16:10 |
| vannif | that is simply a kind of alias, right ? | 16:10 |
| marzif_ | we are using both now | 16:10 |
| marzif_ | they are alias | 16:10 |
| marzif_ | yes | 16:10 |
| *** marzif_ has quit IRC | 16:10 | |
| *** marzif_ has joined #openstack-freezer | 16:11 | |
| vannif | but in the future the plan is to have the freezer-agent to be incompatible from the point of view of the command line options | 16:11 |
| marzif_ | I got disconnected sorry... | 16:11 |
| marzif_ | the plan would be to remove the freezerc | 16:11 |
| marzif_ | and use only the freezer-agent with config files | 16:11 |
| marzif_ | we need to write a blueprint for that | 16:11 |
| marzif_ | or add a specs | 16:12 |
| marzif_ | I think we can have a point of discussion on the wiki | 16:12 |
| marzif_ | https://wiki.openstack.org/wiki/Freezer | 16:12 |
| marzif_ | all are encouraged to improve/modify that | 16:12 |
| marzif_ | and also we have a manifesto available here https://etherpad.openstack.org/p/freezer-manifesto please improve as you think would be better | 16:13 |
| vannif | good point | 16:14 |
| marzif_ | this is quite all the tasks I've been working in the last week | 16:14 |
| vannif | we definitely need to close the dvsm integration jobs, too | 16:15 |
| marzif_ | yep | 16:15 |
| vannif | good. thank you | 16:16 |
| marzif_ | : ) | 16:16 |
| vannif | reldan ? | 16:16 |
| marzif_ | ah... one last thing... | 16:16 |
| marzif_ | Saturday there's a new release planned of freezer | 16:17 |
| marzif_ | on pypi | 16:17 |
| marzif_ | and branch on git | 16:17 |
| marzif_ | so we should try to send our changes in by EOD tomorrow | 16:17 |
| m3m0 | is the code stable enough for pypi? | 16:18 |
| vannif | yes. that's why we are all involved in code reviews :) | 16:18 |
| *** arunb has joined #openstack-freezer | 16:18 | |
| reldan | Ok, my turn ) | 16:18 |
| reldan | Chunk size for swift and fix for nova backups are merged now. I’m working on cinder backups. And going to send a pull request today or tomorrow. | 16:18 |
| marzif_ | well, the only way to know... is by adding the integration test job | 16:18 |
| marzif_ | :) | 16:18 |
| reldan | Problems: 1) We need to understand how to implement nova backups with bootable disk 2) We need to have discussion about new version of config (for parallel backups) in client | 16:20 |
| vannif | We have some manual integration tests. They don't cover completely *all* the features, but the most important yes. automating the tests is the current effort on the testing side | 16:20 |
| vannif | sorry reldan, please go on | 16:20 |
| reldan | It’s ok ) | 16:20 |
| marzif_ | reldan, feel free to create a subsection in the wiki to propose that if you want | 16:21 |
| vannif | yes relda. As marzif suggested, we can also start and share the discussion on the wiki, with an example config file for example | 16:22 |
| reldan | Ok. I can create two blueprints and send it on your review. | 16:22 |
| vannif | when sections and options make sense, we can write some tests and then continue with the implementation ;) | 16:22 |
| reldan | And I know that we would like to migrate our config to oslo.config | 16:23 |
| reldan | So our changes will be atop of oslo.config integration? | 16:23 |
| reldan | Ok, I can describe everything in my blueprints | 16:24 |
| vannif | yes. the idea is that. and also split the freezer-scheduler from the freezerclient, which should use cliff and act only as an interface to the freezer-api | 16:24 |
| reldan | In this case we should understand “depends on” relations between these improvements | 16:25 |
| marzif_ | +1 | 16:25 |
| reldan | But you are right, let me write everything in blueprint. I can also create issues or question list there | 16:26 |
| reldan | I also should write integration tests on nova and cinder backup | 16:26 |
| vannif | maybe we can work on the freezer-agent to fully support any new feature, and leave the freezerc with support for a reduced set of features | 16:26 |
| vannif | I think that's the point of having both freezerc and freezer-agent around for some time | 16:27 |
| reldan | So action plan for me: 1) Cinder backup fixes 2) Blueprints for nova bootable disk backup problem and parallel backup config 3) Integration tests for nova and cinder backup | 16:27 |
| reldan | Let’s discuss. I actually have no strong opinion how to do changes with configuration | 16:28 |
| reldan | it’s seems to be all from my side | 16:28 |
| vannif | thanks reldan. great job, btw | 16:29 |
| reldan | Thank you vannif ! | 16:29 |
| vannif | on my side. | 16:29 |
| vannif | nothing particularly relevant. code reviews, a (kind of) fix for the initialization of the elasticsearch index to support replicas | 16:30 |
| vannif | https://review.openstack.org/#/c/239880/ | 16:30 |
| marzif_ | vannif, <subliminal/*devstack integration gate job*/subliminal> | 16:32 |
| marzif_ | :) | 16:32 |
| vannif | new code to support editing of actions in the api is not complete. It adds knowledge of jobs to the api, which has been treating jobs as opaque document until now | 16:32 |
| vannif | ahahhah | 16:32 |
| vannif | yes | 16:32 |
| vannif | I have to focus more on the dvsm integration tests. | 16:32 |
| vannif | sorry guys .. I have to switch to integ tests ... now | 16:32 |
| vannif | ahah | 16:32 |
| vannif | I'm joking | 16:32 |
| marzif_ | lol | 16:32 |
| marzif_ | not a bad joke :) | 16:33 |
| vannif | well. that's all for me. | 16:33 |
| vannif | m3m0 ? | 16:33 |
| m3m0 | sup | 16:33 |
| m3m0 | I've been working on the ui mostly | 16:33 |
| m3m0 | on internal improvements to reduce the amount of code and have better resiliency | 16:34 |
| m3m0 | I'm implementing react js in some of the modal windows to improve usability but this is a experiment (because I'm learning react) | 16:35 |
| m3m0 | on the other side of business the freezer-agent on windows is working | 16:36 |
| m3m0 | with all the new changes | 16:36 |
| m3m0 | and I'm currently implementing the scheduler as well | 16:36 |
| m3m0 | that's it for me | 16:36 |
| vannif | are the fs snapshots being managed correctly ? | 16:36 |
| vannif | in case of errors, in particular | 16:36 |
| marzif_ | good question.... | 16:36 |
| m3m0 | I've been trying to recreate the error that I had where the snapshot wasn't remove while the agent fails | 16:38 |
| m3m0 | but the latest experiments that I did the snapshot was removed correctly | 16:39 |
| m3m0 | and I had to change the default value for snapshot in the arguments to be False | 16:40 |
| reldan | but you are right m3m0, always can imagine a forced closing of freezer in the middle of doing backup | 16:40 |
| reldan | And it can cause for example blocking mysql | 16:40 |
| m3m0 | the try: finally: should be enough for this cases | 16:41 |
| reldan | we have made a flush and stop transactions and then by some reason our process is killed | 16:41 |
| reldan | Yes, but not in case of process killing | 16:42 |
| m3m0 | good point | 16:43 |
| vannif | the unlock of the mysql is in a "finally" statement | 16:43 |
| vannif | yes | 16:43 |
| reldan | I know that the probability isn’t big enought | 16:43 |
| vannif | even the finally statement needs to be carefully analyzed. pitfalls can show up unexpectedly | 16:43 |
| reldan | And can be solved only be having some sort of watch dog | 16:43 |
| reldan | That can detect a failure of freezerc | 16:44 |
| m3m0 | does anyone know any sql server "expert" | 16:44 |
| reldan | you? | 16:44 |
| marzif_ | yes, one guy called m3m0 | 16:44 |
| *** mini has joined #openstack-freezer | 16:44 | |
| m3m0 | hahaha I'm just a very handsome guy | 16:45 |
| reldan | :) | 16:45 |
| vannif | well ... process killing ... we can make the process "difficult" to be killed. but in the end, if the user intentionally disrupts the process ... | 16:45 |
| reldan | It can take too much memory and be killed by os | 16:45 |
| reldan | let’s say we have wrong chunk_size parameter | 16:45 |
| m3m0 | or the process can be unresponsive | 16:46 |
| m3m0 | that happens a lot on windows at least :P | 16:46 |
| vannif | so, the idea could be to have a watchdog process to andle the killing and unlocking the db ? | 16:47 |
| reldan | Yes, but we should have different watchdogs for windows and linux )) | 16:47 |
| m3m0 | I don't like the idea | 16:47 |
| vannif | I think we can delay that to a later stage, only if the problem arises | 16:47 |
| vannif | I'm used to watchdogs in electronics, but at the moment, I'd say not to mess with convoluted solutions | 16:48 |
| m3m0 | we are adding more and more complexity in each iteration | 16:49 |
| vannif | yes | 16:49 |
| reldan | Ok ) but we still can have garbage after the run | 16:49 |
| vannif | and then ... who watches the watchdog ? :) | 16:49 |
| reldan | lvm snapshot | 16:49 |
| reldan | we can place it to initd | 16:49 |
| m3m0 | a watchcat | 16:49 |
| reldan | )) | 16:49 |
| reldan | Ok, sorry | 16:49 |
| vannif | leaving a lvm snapshot around is not a tremendous problem. | 16:50 |
| vannif | forgetting to unlock the db is much worse :) | 16:50 |
| reldan | You know | 16:51 |
| reldan | we can have something like log | 16:51 |
| reldan | Or distributed log | 16:51 |
| reldan | So we can see - ok we have server5 and it blocked the database | 16:51 |
| reldan | and don’t response already 10 minutes | 16:51 |
| reldan | so probably it should trigger alert | 16:52 |
| m3m0 | can we do the blocking in a commit rollback scenario? | 16:52 |
| marzif_ | in linux, with pymysql the db is unlocked automatically when the process exits, so if the python process crash the dh is unlocked | 16:52 |
| marzif_ | but we need to test that more I think | 16:52 |
| marzif_ | that should work the same also for windows as we are using the same module | 16:53 |
| vannif | yes. let's keep it simple for now, improving testing | 16:55 |
| vannif | let's say the idea of "heartbeats" and watchdogs is on-hold. | 16:55 |
| vannif | is that all m3m0 ? | 16:55 |
| m3m0 | yep, that's all from my side | 16:56 |
| vannif | thanks | 16:56 |
| vannif | federico, are you there ? do you want to say something on your side ? | 16:57 |
| marzif_ | federico3, ^^ | 16:57 |
| vannif | like lupinIII, sorry :) | 16:58 |
| vannif | well. I think that's all | 17:03 |
| vannif | thank you everyone | 17:04 |
| vannif | #endmeeting | 17:04 |
| freezerBot` | Meeting ended Thu Oct 29 17:04:22 2015 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:04 |
| freezerBot` | Minutes: http://meetbot.stefanocanepa.it/freezer/openstack-freezer/2015/openstack-freezer.2015-10-29-16.05.html | 17:04 |
| freezerBot` | Minutes (text): http://meetbot.stefanocanepa.it/freezer/openstack-freezer/2015/openstack-freezer.2015-10-29-16.05.txt | 17:04 |
| freezerBot` | Log: http://meetbot.stefanocanepa.it/freezer/openstack-freezer/2015/openstack-freezer.2015-10-29-16.05.log.html | 17:04 |
| openstack | Meeting ended Thu Oct 29 17:04:22 2015 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:04 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/2015_10_29/2015/2015_10_29.2015-10-29-16.05.html | 17:04 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/2015_10_29/2015/2015_10_29.2015-10-29-16.05.txt | 17:04 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/2015_10_29/2015/2015_10_29.2015-10-29-16.05.log.html | 17:04 |
| marzif_ | thanks vannif | 17:04 |
| federico3 | vannif: regarding the watchdog and table unlocking? | 17:04 |
| Slashme_ | One last thing. | 17:05 |
| Slashme_ | We are choosing the name for freezer devs, here is a survey to help in the process. Feel free to vote :) (updated with suggestions for those who already voted) | 17:05 |
| Slashme_ | https://www.surveymonkey.com/r/9VHG8ZK | 17:05 |
| vannif | sorry, federico3, we approached the 1 hour meeting :) | 17:05 |
| vannif | I thought you were afk | 17:06 |
| federico3 | (if that was the question, I always upvote simple watchdog processes) | 17:06 |
| marzif_ | federico3, ok | 17:08 |
| vannif | watchdog, good. could be simpler than expected. and efficient | 17:08 |
| marzif_ | vannif, let's write a bp or wiki for it | 17:08 |
| marzif_ | so we can discuss on it | 17:08 |
| marzif_ | I remember about timeout for tables locks... | 17:10 |
| marzif_ | we should find a way where even if the node where the agent is running crush (i.e. like everything but not the db) the table can be still unlocked | 17:11 |
| marzif_ | I remember clearly that with mysqldb module that was the case.. | 17:11 |
| marzif_ | but then we switched to pymysql for portability | 17:11 |
| marzif_ | and I'm not sure if that's still the case... | 17:11 |
| marzif_ | we need to do some test.... | 17:11 |
| marzif_ | it's importnat... | 17:11 |
| *** reldan has quit IRC | 17:12 | |
| vannif | what should be the responsibilities of the watchdog/supervisor ? just close or do something more, like releasing snapshots ... in that case it should know more than the simple pid of the monitored process | 17:12 |
| *** mini has quit IRC | 17:14 | |
| marzif_ | if we could find a way to do that within the same freezer-agent session I think it would be easier... like when the agent start, if there's already a snapshot name mounted that match with that backup settings, remove it if another agent process is not running... | 17:15 |
| marzif_ | just a thought.... | 17:15 |
| marzif_ | not sure if it is easy with a watchdog or from the backup sessions process | 17:16 |
| marzif_ | it's an interesting conversation | 17:16 |
| *** reldan has joined #openstack-freezer | 17:17 | |
| szaher | all: are we going to merge this patch soon https://review.openstack.org/#/c/238940/ ? | 17:20 |
| szaher | Improved freezerc and freezer-agent script management | 17:20 |
| *** mini has joined #openstack-freezer | 17:22 | |
| *** marzif_ has quit IRC | 17:31 | |
| *** marzif_ has joined #openstack-freezer | 17:34 | |
| *** mini has quit IRC | 17:43 | |
| *** mini has joined #openstack-freezer | 17:44 | |
| *** reldan has quit IRC | 18:00 | |
| *** marzif_ has quit IRC | 18:02 | |
| *** marzif_ has joined #openstack-freezer | 18:03 | |
| *** reldan has joined #openstack-freezer | 18:12 | |
| daemontool_ | szaher, yes | 18:15 |
| *** marzif_ has quit IRC | 18:16 | |
| openstackgerrit | Merged openstack/freezer: Add some FAQ items https://review.openstack.org/239658 | 18:26 |
| *** jonaspf has quit IRC | 18:50 | |
| *** jonaspf has joined #openstack-freezer | 19:06 | |
| szaher | thanks daemontool_ I will be waiting for that | 19:12 |
| *** marzif_ has joined #openstack-freezer | 19:14 | |
| *** jonaspf has quit IRC | 19:21 | |
| *** jonaspf has joined #openstack-freezer | 19:21 | |
| *** reldan has quit IRC | 19:29 | |
| *** marzif_ has quit IRC | 19:33 | |
| *** jonaspf has quit IRC | 19:36 | |
| *** reldan has joined #openstack-freezer | 19:58 | |
| *** jonaspf has joined #openstack-freezer | 20:07 | |
| *** marzif_ has joined #openstack-freezer | 20:22 | |
| *** jonaspf has quit IRC | 20:22 | |
| *** marzif__ has joined #openstack-freezer | 20:26 | |
| *** marzif_ has quit IRC | 20:26 | |
| *** jonaspf has joined #openstack-freezer | 20:52 | |
| *** marzif__ has quit IRC | 21:07 | |
| *** jonaspf has quit IRC | 21:12 | |
| *** marzif__ has joined #openstack-freezer | 22:06 | |
| *** reldan has quit IRC | 22:12 | |
| *** reldan has joined #openstack-freezer | 22:12 | |
| *** marzif__ has quit IRC | 22:20 | |
| *** reldan has quit IRC | 22:27 | |
| *** reldan has joined #openstack-freezer | 22:30 | |
| *** jonaspf has joined #openstack-freezer | 22:56 | |
| *** marzif__ has joined #openstack-freezer | 23:07 | |
| *** jonaspf has quit IRC | 23:22 | |
| *** marzif__ has quit IRC | 23:28 | |
| *** dschroeder has quit IRC | 23:31 | |
| *** reldan has quit IRC | 23:31 | |
| *** jonaspf has joined #openstack-freezer | 23:37 | |
| *** jonaspf has quit IRC | 23:52 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!