Wednesday, 2016-03-23

*** ddieterly has joined #openstack-freezer00:01
*** yangyapeng has quit IRC00:06
*** yangyapeng has joined #openstack-freezer00:06
*** yangyapeng has quit IRC00:11
*** daemontool has quit IRC00:15
*** dschroeder has quit IRC00:24
*** yangyapeng has joined #openstack-freezer01:09
*** yangyapeng has quit IRC01:14
*** reldan has quit IRC01:17
*** reldan has joined #openstack-freezer01:18
*** EinstCrazy has joined #openstack-freezer01:21
*** yangyapeng has joined #openstack-freezer01:28
*** ddieterly is now known as ddieterly[away]01:36
*** ddieterly[away] is now known as ddieterly02:02
*** reldan has quit IRC02:06
*** ddieterly is now known as ddieterly[away]02:13
*** ddieterly[away] has quit IRC03:14
yangyapengping vannif07:49
*** chenzeng has quit IRC07:52
*** c00281451 has joined #openstack-freezer08:11
*** EinstCra_ has joined #openstack-freezer08:13
*** EinstCrazy has quit IRC08:16
kelepirci_ping to all08:22
kelepirci_I am working on new sphinx documentation08:23
kelepirci_I have some questions08:23
*** c00281451 is now known as chenzeng08:23
m3m0kelepirci_: tell me, what questions? :)08:30
kelepirci_I am trying to decide which tempalte should I use?08:31
kelepirci_current default is openstack themed template.08:31
kelepirci_but docs.openstack.org has different template08:31
kelepirci_and I want to use Read The Doc template for documentation08:32
kelepirci_at the end. what template shall I use?08:33
m3m0the sphinx default should be fine08:41
openstackgerritMerged openstack/freezer-api: Add Freezer API Version Test  https://review.openstack.org/29084208:52
kelepirci_ok. I will go with the default08:52
kelepirci_than I should only include .rst files to source directory08:53
*** reldan has joined #openstack-freezer08:53
openstackgerritMemo Garcia proposed openstack/freezer-web-ui: UX improvements  https://review.openstack.org/29175708:59
openstackgerritMerged openstack/freezer: Start to introduce tempest tests.  https://review.openstack.org/28944309:02
*** reldan has quit IRC09:03
*** openstackgerrit has quit IRC09:03
*** openstackgerrit has joined #openstack-freezer09:04
yangyapengping m3m009:13
yangyapengm3m0: https://review.openstack.org/#/c/293244/  please review it , devstack is fail09:13
m3m0yangyapeng: there is a problem with the gates, there is a patch to fix this but is not merged yet09:21
m3m0I think we need to wait a little bit09:21
yangyapengOK  thx m3m009:32
*** daemontool has joined #openstack-freezer09:35
*** daemontool_ has joined #openstack-freezer09:36
*** daemontool_ has quit IRC09:36
openstackgerritFausto Marzi proposed openstack/freezer: Cynthia's first commit  https://review.openstack.org/29528909:41
openstackgerritFausto Marzi proposed openstack/freezer: Modify the vars display_name to 'name'  https://review.openstack.org/29324409:42
*** reldan has joined #openstack-freezer09:50
m3m0we should add in the logs the id or name of the job that wrote the log09:52
daemontoolgood idea09:53
openstackgerritFausto Marzi proposed openstack/freezer: Rename mode default to fs  https://review.openstack.org/29523009:54
m3m0is it me or the scheduler stops after each run?10:00
yangyapengfreezer-scheduer job-stop is ok ?10:01
yangyapengI exec job-stop, but the job runing still,unless job-delete10:02
m3m0daemontool all the backups are incremental by default right?10:07
*** EinstCra_ has quit IRC10:10
*** yangyapeng has quit IRC10:13
daemontoolm3m0,  nope10:15
daemontoolif you do not use max_level or always_level10:16
daemontoolthe backup shouldn't be incremental10:16
m3m0ok ok I have --no-incremental by default in the ui10:16
*** sharad has joined #openstack-freezer10:17
daemontool--no-incremental does not generate any metadata for the incremental10:17
daemontoolwhile without it it just generate always a level 010:17
m3m0then is it better to have max-level = 0?10:18
daemontoolthat was in case a user wanted to do incremental backups, after10:18
daemontoollike you generated a backup without incrementals10:18
daemontoolthen after the first run the user wants to generate an incremental from the previous10:18
daemontoolthat was the idea originally10:19
daemontoolI think it make sense to not do incremental it the user simly does not set (max|always)_level10:20
daemontoolprobably by default the use --no-incremental can be right10:20
*** frescof__ has quit IRC10:21
m3m0ok I'll do more tests first10:22
m3m0by the way10:22
m3m0the repo is created https://review.openstack.org/#/admin/projects/openstack/python-freezerclient10:22
m3m0what's the next step?10:22
*** sharad has quit IRC10:24
daemontoolm3m0,  we need to have all our components use that module10:25
daemontoolso we need to modify the existing namespace from apiclient to freezerclient10:25
m3m0shouldn't be the other way around10:25
daemontoollike what?10:25
slashmereldan: https://review.openstack.org/#/c/294536/ Please10:25
m3m0first import the code to that repo10:25
m3m0review it, create the github one10:26
m3m0and then move the other compoenents10:26
daemontoolthe github will be created automatically soon10:26
reldanslashme: sure, please https://review.openstack.org/#/c/295230/10:26
daemontoolwe do not have to do anything10:26
daemontoolevery repository under the openstack/ namespace10:26
daemontoolis a mirror from the openstack git10:26
m3m0ok, so how can we import the existing repo to review.openstack?10:27
m3m0is it automatically?10:28
daemontoolI'm not sure I'm following10:28
daemontoolsorry10:28
daemontoolone sec10:29
m3m0just asking, now we have the repo in review.openstack, do we need to import the code that is in my repo? or is it done automatically?10:30
daemontoolautomatically10:31
daemontoolhttps://review.openstack.org/#/c/255349/9/gerrit/projects.yaml line 314010:31
m3m0:) nice10:31
daemontoolIt should have happened already10:32
m3m0yep I just check it did10:32
daemontoolah it was approved10:32
daemontoolthis morning10:32
daemontoolprobably infra have a cron process10:32
daemontoolto do that periodically10:33
daemontoolwe just need to wait a bit and the repos will be mirrored10:33
daemontoolwe need to fix our launchpad10:45
daemontoolso if anyone wants to opena bug on kilo or liberty or mitaka  it can eb done10:46
daemontoolnow all the bugs are opened to master10:46
daemontooljokke_, ping10:49
daemontoolalso now we are in mitaka rc110:49
daemontoolbut if we need to backport a feature in mitaka rc1  from master (Newton) what would be the version change...10:50
jokke_daemontool: pong10:50
daemontooljokke_, so we branched  stable/mitaka10:51
daemontoolfor rc110:51
daemontoolnow I need to backport a bug10:51
jokke_daemontool: nice10:51
daemontoolwhat would be the version change in setup.cfg?10:51
daemontooluntil mitaka release the version is still 2.0.0.0rc1 or rc2 rc310:52
jokke_on the stable mitaka branch, correct10:52
daemontoolno version bump?10:52
daemontoolor the new backports will be part or rc2?10:53
jokke_so if you have 2.0.0.0rc1 tagged and you think the bugfix warrants rc2, you can just change the setup.conf reflect to that already10:53
jokke_ but please do them in separate changes ;)10:53
jokke_so don't change the version in the bugfix backport10:54
jokke_that gets messy10:54
daemontoolah ok10:54
daemontoolso we can backport all the changes we need to get in mitaka, and then submit a new patch with version bump10:55
jokke_I'm not 100% sure if your gate will fail or not trying to submit patches to version that is already tagged, so you might need to make the version bump first and then depend all the backports to that10:55
*** reldan has quit IRC10:58
daemontoolah ok, brilliant10:59
daemontoolthanks a lot Erno :)10:59
*** reldan has joined #openstack-freezer11:00
jokke_NP11:02
openstackgerritMerged openstack/freezer: Rename mode default to fs  https://review.openstack.org/29523011:02
jokke_BTW I did not see candidacy e-mail, who is gonna be Freezer PTL next cycle?11:03
daemontoolslashme,11:06
daemontoolit's in the candidacy repo11:06
daemontoolyes agree, we should have sent the email11:07
daemontoolbut I'm not sure I totally like the current ptl email step down :)11:08
daemontoolthe freezerclinent should be able to display information not only from the freezer-api11:10
daemontoolbut also from the storages11:10
daemontoolany thought?11:10
daemontoolor from the cinder/nova api when using related native backups api endpoints11:11
slashmedaemontool: I agree, but how do you manage permission then ? In swift it is easy, your user can or cannot access objets, But with ssh for example, as long as you have the key, you are able to list all backups11:37
*** yangyapeng has joined #openstack-freezer11:42
daemontoolyes11:44
daemontoolif you have the key you can list it11:44
daemontoolthe user needs to use multiple users if all the backups11:45
daemontooldoes not have to be listed11:45
openstackgerritMemo Garcia proposed openstack/freezer-web-ui: UX improvements  https://review.openstack.org/29175711:49
m3m0please review :) https://review.openstack.org/29175711:49
m3m0and this: https://review.openstack.org/#/c/280811/11:52
m3m0and this as well: https://review.openstack.org/#/c/278407/11:52
*** reldan has quit IRC11:53
*** yangyapeng has quit IRC12:01
*** yangyapeng has joined #openstack-freezer12:02
*** yangyape_ has joined #openstack-freezer12:04
*** reldan has joined #openstack-freezer12:04
yangyape_ job.event has two  status,  none or stop?12:06
*** yangyapeng has quit IRC12:07
daemontoolyangyape_,  I think {start,stop,abort,None}12:14
daemontoolvannif,  ping12:14
daemontoolI think we need to create a CONSTANT list   somewhere to list all the event, rather than hardcoding them12:15
daemontoolyangyape_,  https://github.com/openstack/freezer-api/blob/master/freezer_api/api/v1/jobs.py#L22612:15
yangyape_job.event = Job.NO_EVENT Job.STOP_EVENT Job.ABORT_EVENT12:16
yangyape_I see it12:16
yangyape_now it has a error cinder-vol-id when create_glance12:17
yangyape_the function _get_endpoint_and_token is changed.12:17
yangyape_freezer-scheduler is a must,  reload of the action12:20
openstackgerritEldar Nugaev proposed openstack/freezer: Added --overwrite parameter for removing all files from restore directory. Default value --overwrite=False  https://review.openstack.org/29640412:26
daemontoolm3m0, do you want to do tomorrow then web ui and source code walkthruough?12:27
daemontoolalso if vannif  in holidays?]12:27
daemontoolslashme, rolling-upgrades specs proposal from Cross-Project Laison https://review.openstack.org/#/c/290977/12:30
slashmevannif seems to be in hollidays this week12:35
daemontoolok12:37
daemontoolreldan,  have you been thinking about implementing the listed-incremental in tarfile? :)12:40
openstackgerritFausto Marzi proposed openstack/freezer: WIP block based incremntal support - rsync  https://review.openstack.org/29046112:41
*** EinstCrazy has joined #openstack-freezer12:42
reldandaemontool: what’s about listed-incremental? I just not sure I understand12:42
daemontoolreldan,  do you remember the conversatino we had12:46
daemontoolfew days ago?12:46
daemontoolabout removing completely the tar and related binaries12:47
daemontooland do that in pure python?12:47
daemontoolit's not somethign super critical12:47
daemontoolbut it really is an interesting challenge12:47
reldanI remember :)12:47
daemontoollike this https://docs.python.org/3/library/tarfile.html12:47
daemontoolthe only lacking thing would be the12:48
daemontoollisted-incremental12:48
daemontoolbut it's not easy really12:48
daemontoolbecause the data structure changes12:48
daemontoolin the tar binary file and in the metadata file12:48
daemontoolas that is a gnu extention12:48
daemontoolwhile tarfile mostly implement posix format12:48
daemontools/extention/format/12:49
reldandaemontool: I suppose we can add python-tar engine.12:49
reldanBut probably not now12:49
reldanOr I can fully focus on this task and implement it12:49
reldanI just should reimplement tar-metadata12:50
reldanBut it should take some time12:50
daemontoolit will take big time12:50
daemontoolfor sure12:50
daemontooland yes it is not critical at all12:51
daemontoolor a priority12:51
daemontoolbut the challenge is amazing12:51
reldanYes, agree with you. I just have added —overwrite now12:51
reldanIt should help12:51
reldanBut tar-incremental should be easy than rsync12:51
*** ddieterly has joined #openstack-freezer12:52
daemontoolreldan,  yes, it's easier also because there's the tarfile module to rely on12:53
daemontoolddieterly, well done on the tempest stuff12:53
*** ddieterly is now known as ddieterly[away]12:53
*** reldan has quit IRC13:01
*** ddieterly[away] has quit IRC13:03
*** reldan has joined #openstack-freezer13:23
openstackgerritMemo Garcia proposed openstack/python-freezerclient: .gitreview updated to point new repo  https://review.openstack.org/29643613:31
m3m0please review :) https://review.openstack.org/29643613:32
*** daemontool_ has joined #openstack-freezer13:33
*** daemontool has quit IRC13:33
*** reldan has quit IRC13:44
*** reldan has joined #openstack-freezer13:47
openstackgerritFerhat Ozkasgarli proposed openstack/freezer: New Better & Well Formatted Docs with Sphinx  https://review.openstack.org/29644813:49
kelepirci_hello guys. I have stared with documentation. I would appreciate if you comment on documentation.13:50
openstackgerritFausto Marzi proposed openstack/freezer: Adds information for installation  https://review.openstack.org/29490313:50
*** reldan has quit IRC13:50
daemontool_kelepirci_, thanks, is this commit still valid?13:50
daemontool_https://review.openstack.org/#/c/294903/13:50
daemontool_or it is superseed by the other13:50
kelepirci_it still valid. after I have finished documentation. it will be suppressed.13:51
daemontool_ok brilliant13:51
kelepirci_so it would be good to merge with master now13:51
daemontool_kelepirci_,  is there a comment here https://review.openstack.org/#/c/294903/ ?13:52
kelepirci_actually there is not any comment from my side.13:53
kelepirci_the commit was only contains some important warning for new installation13:54
kelepirci_is*13:54
*** reldan has joined #openstack-freezer13:59
openstackgerritFerhat Ozkasgarli proposed openstack/freezer: New Better & Well Formatted Docs with Sphinx  https://review.openstack.org/29644814:01
kelepirci_have just updated missing files14:01
daemontool_kelepirci_,  Jin Nan Zhang gave -114:01
daemontool_for a too long line14:01
daemontool_in https://review.openstack.org/#/c/294903/14:01
daemontool_ok14:02
kelepirci_let me check14:03
kelepirci_by the way. I am quite noob to this development process. so please correct me if I am doing something wrong14:03
*** openstack has joined #openstack-freezer14:24
*** ddieterly is now known as ddieterly[away]14:25
daemontool_ddieterly[away],  ah...14:29
daemontool_all, unless this change is backported, not patches can be sent to stable/mitaka https://review.openstack.org/#/c/296361/14:35
slashmereviewed.14:37
slashmeJust require +A14:37
daemontool_slashme,  I'm not sure about the versioning there14:37
daemontool_cause the version is not bumped14:37
daemontool_it shouldn't be bumped probably until mitaka is fully released14:38
slashmeI'd think the same14:39
daemontool_let's hope we are not going to have conflicts14:39
daemontool_but I'm not sure either14:39
daemontool_what I'm saying is right14:39
daemontool_cause I've seen other projects14:39
daemontool_releasing other versions14:39
slashmeUnsualy gerrit -1 when there is a version issue. But I'm not sure at all either14:39
daemontool_ok14:39
*** dschroeder has joined #openstack-freezer14:43
slashmeI guess we also need to backport it to liberty ? No ?14:44
*** ddieterly[away] is now known as ddieterly14:49
daemontool_mmhhhh I'm not sure15:01
*** EinstCrazy has quit IRC15:03
daemontool_reldan, ping15:29
reldandaemontool: yes15:30
daemontool_in Kilo... do you remember the supported backups for vms and volumes?15:30
daemontool_like do we support both15:30
daemontool_cindernative15:30
daemontool_and the other approach of downloading the volumes and process it by the agent?15:31
reldandaemontool_: I suppose yes15:31
daemontool_or for volumes backup only cindernatives are supported15:31
reldandaemontool_: I suppose it contains the same code as master have15:31
daemontool_ok15:31
daemontool_yes but in kilo, it's not possible to execute snapshots while the volume is mounted, right?15:32
reldandaemontool_: yes in kilo we don’t have —force for cindernative15:33
daemontool_I can't remember15:33
daemontool_if we provide any way15:33
daemontool_to do backups of volumes without umounting the volume in kilo15:34
reldandaemontool_: Cinder through glance15:34
reldanbut non-incremental15:34
daemontool_ok no prob for incremental15:34
reldanCinder throught glance15:34
daemontool_so we can snapshot a volume without having the volume unmounted?15:34
reldanYes, for snapshotting we have —force in kilo15:35
daemontool_ah ok15:35
daemontool_brilliant15:35
daemontool_ok so15:36
daemontool_we can snapshot the volume, upload it to glance15:36
daemontool_download it with the agent and upload it to swift?15:36
daemontool_in stream15:36
daemontool_?15:36
daemontool_can't rember sorry...15:37
daemontool_I'm going to try it anyway15:37
reldandaemontool_: Yes, we should be able to do this15:38
daemontool_what's the difference between Kilo and Liberty15:42
daemontool_in the features we use15:42
daemontool_for volumes backup15:42
daemontool_it's just the use of the backup endpoint15:42
daemontool_in cinder15:42
daemontool_without downtime as in backup there's no --force15:42
daemontool_right?15:42
reldandaemontool_: In liberty they have added —force for backupk15:44
reldanit is all15:44
daemontool_ok15:44
daemontool_so I've been asked to do volumes and vms backup in kilo with freezer, without downtime15:45
daemontool_it does not matter if the incrementals are not available15:45
daemontool_if yes, at least 1 person more will be allocated full time to freezer15:45
daemontool_I think15:46
daemontool_we could even use15:46
daemontool_newer version of freezer15:46
daemontool_like mitaka or liberty, while the rest of the infrastructure is kilo15:46
daemontool_as we really do not use other fancy features15:46
daemontool_from other services, other than that --force thing on cinder backups api endpoints15:47
daemontool_reldan, we could use the new code, with rsync to compute the incremental15:50
daemontool_while downloading the image from glance15:50
reldandaemontool_: Probably, but it should be a lot of work. Because in this case we should support incremental restore15:51
daemontool_incremental restore is not that difficult15:51
daemontool_because15:51
reldandaemontool_: We should download zero level image, then patch it with increments15:51
daemontool_the vms and volumes15:51
daemontool_are single files15:51
daemontool_yes15:52
reldanthen upload this image on glance15:52
daemontool_yes15:52
daemontool_that was the original idea15:52
daemontool_:D15:52
daemontool_do you rember? :)15:52
reldanNope :) But it will be increment only for storage15:52
reldanand no increment for backup15:52
reldanso if you have 1TB data15:52
daemontool_why?15:53
reldaneach increment should - be full backup, full download15:53
daemontool_well yes15:53
daemontool_to glance yes15:53
reldanthen calculate diff and upload15:53
daemontool_yes15:53
daemontool_but in the use case I've been asked15:53
daemontool_it does not matter15:53
daemontool_as long they can do it in Kilo15:53
reldanSo we can have economy only for terms of storage, but big requirements for cpu and the same requirements for network15:54
reldanFrom my point of view cpu is more expensive, but probably I’m wrong :)15:54
daemontool_the problem is where you do the restore?15:55
daemontool_because the image needs to be prepared15:55
daemontool_so it cannot be done in the same VM15:56
reldanI can do restore on any machine that have credentials to OpenStack15:57
daemontool_I think we can make it happen..16:32
daemontool_:)16:32
*** ddieterly is now known as ddieterly[away]16:38
*** ddieterly[away] is now known as ddieterly16:41
*** reldan has quit IRC17:33
*** ddieterly is now known as ddieterly[away]17:42
*** ddieterly[away] has quit IRC18:43
*** openstack has joined #openstack-freezer19:24
*** DuncanT_ is now known as DuncanT19:24
*** arobase has joined #openstack-freezer19:29
*** reldan has joined #openstack-freezer19:31
*** dims_ has joined #openstack-freezer19:43
*** reldan has quit IRC19:49
*** dims_ has quit IRC19:53
*** dims has joined #openstack-freezer19:56
*** openstack has joined #openstack-freezer20:34
*** reldan has joined #openstack-freezer20:35
*** arobase has quit IRC20:53
*** ddieterly has joined #openstack-freezer21:22
*** daemontool_ has quit IRC21:34
*** ddieterly is now known as ddieterly[away]21:36
*** daemontool_ has joined #openstack-freezer21:38
*** ddieterly[away] is now known as ddieterly21:40
*** reldan has quit IRC21:59
*** reldan has joined #openstack-freezer22:17
*** daemontool_ has quit IRC22:31
*** ddieterly has quit IRC23:02
*** reldan has quit IRC23:09
*** openstack has joined #openstack-freezer23:25
*** yangyapeng has quit IRC23:34

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!