Wednesday, 2017-07-05

*** liujiong has joined #openstack-karbor01:14
*** jiaopengju has joined #openstack-karbor01:38
*** yamamoto has joined #openstack-karbor02:33
*** dixiaoli has joined #openstack-karbor02:52
*** openstackgerrit has joined #openstack-karbor03:49
openstackgerritSpencer Yu proposed openstack/python-karborclient master: Add OpenStackClient plugin for triggers  https://review.openstack.org/48034003:49
*** dixiaoli has quit IRC05:00
*** dixiaoli has joined #openstack-karbor05:27
liujiongchenying, yuval: we've finished openstackclient plugin for karborclient, waiting for your review!06:05
chenyingliujiong  Thanks for your contributions.06:14
openstackgerritliyanhang proposed openstack/python-karborclient master: Drop MANIFEST.in - it's not needed by pbr  https://review.openstack.org/48036206:15
liujiongchenying: yeah, you're welcome! Actually, Spencer Yu did most of the work06:19
chenying Spencer Yu:  Thanks. Welcome you to contribute other bp or features for karbor.06:31
chenyingliujiong  Spencer Yu  There are some plans and bp about karbor here. https://ethercalc.openstack.org/karbor-pike06:35
openstackgerritHuan Peng proposed openstack/karbor-dashboard master: Drop MANIFEST.in - it's not needed by pbr  https://review.openstack.org/48036606:35
liujiongchenying: OK, I see the list06:37
liujiongchenying: Are they all for Pike?06:38
chenyingliujiong most of them in pike.  Some may be in queen.06:39
liujiongchenying: I got confused with that list - I cannot find more detailed info with those items06:41
liujiongchenying: Like status(completed or not)06:42
chenyingliujiong Maybe I need add a field about the status.06:42
jiaopengjuI think create these bps in launchpad will be better06:43
liujiongchenying: That's essential - especially for newbi like me06:43
*** Natanbro has joined #openstack-karbor06:43
liujiongyeah, launchpad or storyboard06:44
liujiongchenying: I see an item about deployment - RPM package06:45
liujiongchenying: I suffer a lot when I wanted to install karbor in my CentOS system06:46
chenyingliujiong: Yes  To support rpm and deb package.06:46
chenyingliujiong: Do you have any interests to do this work?06:47
liujiongDo you know how could we request for that? I just know we have some repos on github/rdo-packages06:47
liujiongchenying: I know redhat guys will make these RPMs based on every repo there06:48
liujiongchenying: And I don't see karbor or karborclient or karbor-dashboard there06:49
chenyingliujiong I have no idea about it. You could ask yuval about it. IMO, do we need add some rpm packeage script and config for karbor?06:50
chenyingliujiong: Yuval may be online at 4:00.06:50
chenyingliujiong Do you know how cinder or nova project to support rpm or deb package.06:51
yuvalhey, I'm here06:51
yuvalhey chenying and liujiong06:51
liujionghi yuval06:51
yuvalliujiong: thanks for you contributions, great work06:51
chenyingyuval Good morning!06:51
liujiongyuval: my please06:51
yuvalliujiong: is Spencer Yu on irc as well?06:51
liujiongyuval: no, not now06:52
yuvalliujiong: ok :)06:52
yuvalliujiong: regarding your question about rpm06:52
liujiongchenying: this is how cinder package an RPM  -> https://github.com/rdo-packages/cinder-distgit06:52
yuvalliujiong: https://wiki.openstack.org/wiki/Rpm-packaging06:53
yuvalliujiong: the ones in https://github.com/rdo-packages are maintained by red hat06:53
liujiongyuval: yeah, I need to know how could we request packaging RPMs for a new project in OpenStack06:54
liujiongyuval: I'm reading the wiki06:54
yuvalin OpenStack's rpm-packaging repo, there is already a spec for python-karborclient https://github.com/openstack/rpm-packaging/tree/master/openstack/python-karborclient06:55
liujiongyuval: yes, I see it there06:57
liujiongyuval: Looks like we only need to add a template for karbor to that repo06:58
*** yusb has joined #openstack-karbor06:59
liujionghi yusb, welcome06:59
yuvalliujiong: yes, but in contrast to karborclient, karbor needs systemd services and apache config files as well06:59
yuvalhey yusb :)06:59
yusbhi, everyone :)07:01
liujiongyuval: yes, they are all needed, I just thought we got a template for apache config file in our own repo07:01
yuvalliujiong: we do, and we need to add it to the rpm-packaging07:02
liujiongyuval: OK, if anyone havn't done this work, I think I can help07:03
yuvalliujiong: great!07:03
yuvalliujiong: I was planning to do that, but I'm currently on the multiple operation engine nodes07:03
liujiongyuval: But you know I'm new to karbor, and I may need all your guys' help07:03
yuvalliujiong: we are here for you07:04
jiaopengjuhi yuval, I have some question to be confirmed in implementing the s3 bank plugin07:12
yuvaljiaopengju: sure07:12
jiaopengjus3 do not support object level expiration07:13
jiaopengjuso, the lease feature can not be implemented as swift07:14
*** gouthamr has joined #openstack-karbor07:15
jiaopengjuswift-object-expirer will auto delete the expired object with header 'X-Delete-After'07:16
jiaopengjubut s3 can only set the expires time to the bucket level (or some objects under the bucket)07:17
yuvalI see07:19
jiaopengjuI think we can add a metadata which contains the expire time to the s3 object, when use 'check_lease_existence', we can check it with the expire time, but not 'if object exist' in swift, and if the object is expired, we can delete it after the check07:19
yuvalLet me look into it for a second07:19
yuvaljiaopengju: you are suggesting to put a custom 'expiry' datetime into the object metadata on acquire_lease, update the datetime on renew_lease, and if on check_lease_validity the datetime has passed, delete the object?07:25
jiaopengjuyuval: yes07:26
yuvaljiaopengju: sounds very good07:27
yuvaljiaopengju: just one thing07:27
yuvaljiaopengju: nevermind. S3 used to have an eventually consistent model, where you didn't have 'read-your-writes' consistency. This seems to be not true now07:30
yuvalhttps://docs.aws.amazon.com/AmazonS3/latest/dev/Introduction.html#ConsistencyModel07:30
yuvaljiaopengju: actually, on a second glance, there is this problem07:33
yuvaljiaopengju: s3 is eventually consistent, and after updating an object, there is change of receiving the old data07:34
jiaopengjuyuval: I understand what you mean07:34
yuval*chance07:35
jiaopengjuyuval: I think this is depending on the storage media you use. If using AWS S3, the problem may happen. If using Ceph S3, it is strong consistency, and will not have the issue.07:37
yuval"Ceph S3" == S3 API for Ceph? ( http://docs.ceph.com/docs/master/radosgw/s3/ )07:43
jiaopengjuyuval: part of s3 api07:44
jiaopengjuyuval: ceph radosgw support S3 and Swift interface at the same time07:44
openstackgerritJeremy Liu proposed openstack/python-karborclient master: Add OpenStackClient plugin for scheduledoperations  https://review.openstack.org/48012007:48
yuvaljiaopengju: maybe, we can define a s3 bucket with expiry = lease_expire_window, and refresh the expiry with https://alestic.com/2013/09/s3-lifecycle-extend/#reset-s3-object-timestamp07:50
jiaopengjuyuval: it seems that it's use copy object to make the object as a new one07:55
openstackgerritSpencer Yu proposed openstack/python-karborclient master: Add OpenStackClient plugin for checkpoint  https://review.openstack.org/47989507:57
jiaopengjuyuval: there is another issue, the unit of swift's X-Delete-After is 'second', but the lifecycle in s3 use 'day'07:58
openstackgerritJeremy Liu proposed openstack/python-karborclient master: Fix bug in plan deletion when using osc plugin for karbor  https://review.openstack.org/48039707:59
jiaopengjuyuval: so I think use 'metadata with datetime' may be a valid solution08:01
openstackgerritSpencer Yu proposed openstack/python-karborclient master: Add OpenStackClient plugin for triggers  https://review.openstack.org/48034008:03
yuvaljiaopengju: I guess so. We will have to accept the eventual consistency issue08:05
jiaopengjuyuval: Maybe yes08:05
yuvaljiaopengju: you can see a nice summary of eventual consistency occurences in object stores: https://github.com/andrewgaul/are-we-consistent-yet08:05
jiaopengjuyuval: thanks08:06
yuvaljiaopengju: it speaks about read immediately after another action08:06
yuvaljiaopengju: thank you :)08:06
*** chenying has quit IRC08:19
*** chenying has joined #openstack-karbor08:19
openstackgerritMerged openstack/python-karborclient master: Fix bug in plan deletion when using osc plugin for karbor  https://review.openstack.org/48039708:43
openstackgerritMerged openstack/python-karborclient master: Add OpenStackClient plugin for triggers  https://review.openstack.org/48034008:43
openstackgerritJeremy Liu proposed openstack/python-karborclient master: Add OpenStackClient plugin for scheduledoperations  https://review.openstack.org/48012008:51
openstackgerritSpencer Yu proposed openstack/python-karborclient master: Add OpenStackClient plugin for checkpoint  https://review.openstack.org/47989508:52
chenyinghi yuval  Could you help to review the patches about operation_log API?  https://review.openstack.org/#/c/478459/08:56
openstackgerritMerged openstack/python-karborclient master: Drop MANIFEST.in - it's not needed by pbr  https://review.openstack.org/48036209:14
openstackgerritMerged openstack/python-karborclient master: Add OpenStackClient plugin for checkpoint  https://review.openstack.org/47989509:20
openstackgerritJeremy Liu proposed openstack/python-karborclient master: Add OpenStackClient plugin for scheduledoperations  https://review.openstack.org/48012009:28
openstackgerritchenying proposed openstack/karbor master: Integrate trove to karbor for test (don't merge)  https://review.openstack.org/48020409:34
*** dixiaoli has quit IRC09:38
openstackgerritKiran Totad proposed openstack/karbor master: Use yaml.safe_load instead of yaml.load  https://review.openstack.org/48049310:01
*** liujiong has quit IRC10:07
*** yusb has quit IRC10:21
*** yamamoto_ has joined #openstack-karbor10:46
*** yamamoto has quit IRC10:50
*** jiaopengju has quit IRC11:18
*** jiaopengju has joined #openstack-karbor11:44
*** yamamoto_ has quit IRC12:15
*** dims has quit IRC12:29
*** yamamoto has joined #openstack-karbor12:33
*** jiaopengju has quit IRC12:40
openstackgerritsudhir agarwal proposed openstack/python-karborclient master: Replace six.iteritems() with .items()  https://review.openstack.org/48056012:41
*** dims has joined #openstack-karbor12:44
openstackgerritsudhir agarwal proposed openstack/python-karborclient master: Replace six.iteritems() with .items()  https://review.openstack.org/48056012:53
*** jiaopengju has joined #openstack-karbor13:35
openstackgerritsudhir agarwal proposed openstack/python-karborclient master: Remove unused None from dict.get()  https://review.openstack.org/48058613:38
*** zhurong has joined #openstack-karbor13:44
*** zhurong has quit IRC14:09
*** jiaopengju has quit IRC14:13
*** jiaopengju has joined #openstack-karbor14:15
*** jiaopengju has quit IRC14:28
openstackgerritMerged openstack/python-karborclient master: Add OpenStackClient plugin for scheduledoperations  https://review.openstack.org/48012014:35
*** yamamoto_ has joined #openstack-karbor14:41
*** yamamoto has quit IRC14:44
*** liujiong has joined #openstack-karbor15:03
*** liujiong has quit IRC15:04
*** Natanbro has quit IRC15:05
*** jiaopengju has joined #openstack-karbor15:07
openstackgerritPengju Jiao proposed openstack/karbor master: Increase s3 bank plugin  https://review.openstack.org/48063915:13
*** jiaopengju has quit IRC15:19
*** jiaopengju has joined #openstack-karbor15:29
*** jiaopengju has quit IRC15:30
*** dixiaoli has joined #openstack-karbor15:39
*** dixiaoli has quit IRC15:44
*** yamamoto_ has quit IRC19:21
*** yamamoto has joined #openstack-karbor19:35
*** yamamoto has quit IRC19:40
*** yamamoto has joined #openstack-karbor20:38
*** yamamoto has quit IRC20:43

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!