Tuesday, 2017-07-18

*** itlinux has joined #openstack-swift00:01
claygI can't rebase on patch 484375 - it's hella old!?00:13
patchbothttps://review.openstack.org/#/c/484375/ - swift - Make dict deletion idempotent in dump_recon_cache00:13
openstackgerritClay Gerrard proposed openstack/swift master: Make dict deletion idempotent in dump_recon_cache  https://review.openstack.org/48437500:15
*** klamath has quit IRC00:19
*** frank_young has joined #openstack-swift00:22
*** frank_young has quit IRC00:26
openstackgerritClay Gerrard proposed openstack/swift master: Add multiple worker processes strategy to reconstructor  https://review.openstack.org/47841600:35
*** lucasxu has joined #openstack-swift00:45
*** lucasxu has quit IRC00:45
*** tovin07_ has joined #openstack-swift00:49
*** klrmn has quit IRC01:13
*** kiennt_ has joined #openstack-swift01:19
*** frank_young has joined #openstack-swift01:21
*** RayLei has joined #openstack-swift01:35
*** vint_bra has joined #openstack-swift01:39
*** bkopilov has quit IRC01:52
*** JimCheung has quit IRC01:52
kota_good morning01:54
kota_acoles: ack, will look at patch 47700001:57
patchbothttps://review.openstack.org/#/c/477000/ - swift - Ring rebalance respects co-builders' last_part_moves01:57
kota_timburke: it's a perspective that all of ec logic into c (i.e. liberasurecode actually) could make us easy to make a new golang bindings01:58
kota_on the other hand, in my understanding, the main purpose for StripingDriver is to reduce the python -> c translation overhead as possible.01:59
kota_hmmm02:01
*** clayg_ has joined #openstack-swift02:06
*** ChanServ sets mode: +v clayg_02:06
*** samueldmq_ has joined #openstack-swift02:06
*** kiennt_ has quit IRC02:10
*** kiennt_ has joined #openstack-swift02:10
*** _d34dh0r53_ has joined #openstack-swift02:12
*** tdasilva- has joined #openstack-swift02:13
*** dhellmann has quit IRC02:13
*** d34dh0r53 has quit IRC02:13
*** tdasilva has quit IRC02:13
*** clayg has quit IRC02:13
*** samueldmq has quit IRC02:13
*** glb has quit IRC02:13
*** clayg_ is now known as clayg02:14
*** samueldmq_ is now known as samueldmq02:14
*** klrmn has joined #openstack-swift02:14
*** dhellmann has joined #openstack-swift02:19
*** vint_bra has quit IRC02:26
openstackgerritTuan Luong-Anh proposed openstack/swift master: Update URL home-page in documents according to document migration  https://review.openstack.org/48375502:29
*** winggundamth has joined #openstack-swift02:35
*** winggundamth has quit IRC02:37
*** raginbajin has quit IRC02:41
*** winggundamth has joined #openstack-swift02:46
*** raginbajin has joined #openstack-swift03:00
timburkekota_: i could see that -- just have one copy from python string to python string instead of three (python string to c string, c string to c string, c string to python string) but something tells me we'd rarely if ever find ourselves bound by the in-memory copy speed03:03
*** RayLei has quit IRC03:04
timburkedoesn't really matter much to me, though -- i find the "k of k+m fragments" abstraction much more interesting03:04
timburke(which actually makes the flat_xor_hd backend a little annoying -- you need k+m-2 or k+m-3 [depending on hd] fragments to reconstruct)03:06
*** chlong has quit IRC03:11
*** bkopilov has joined #openstack-swift03:20
openstackgerritMerged openstack/swift master: Add Timestamp.now() helper  https://review.openstack.org/46075403:27
openstackgerritMerged openstack/swift master: Add tests for Recon's object replication_time time unit  https://review.openstack.org/28603203:28
openstackgerritMerged openstack/swift master: Fix StopIteration noise in obj/test_replicator.py  https://review.openstack.org/48248803:28
openstackgerritMerged openstack/swift master: Make dict deletion idempotent in dump_recon_cache  https://review.openstack.org/48437503:28
notmynameyay merges03:29
mattoliverauAfternoon03:30
notmynamehello mattoliverau03:30
mattoliverauSorry I'm a bit quiet, I sent the wife away on a break, so am full time Dading with the toddler. She's finally taking a nap :)03:31
notmyname:-)03:31
mattoliverau*this week03:31
*** RayLei has joined #openstack-swift03:42
*** OrionX has joined #openstack-swift03:51
*** OrionX_ has joined #openstack-swift03:52
*** links has joined #openstack-swift03:55
*** OrionX has quit IRC03:56
*** frank_young has quit IRC04:11
*** klrmn has quit IRC04:13
*** gkadam has joined #openstack-swift04:18
*** frank_young has joined #openstack-swift04:22
*** RayLei has quit IRC04:24
*** frank_young has quit IRC04:26
*** kiennt_ is now known as kiennt04:38
*** gyee has quit IRC04:44
*** cschwede_ has joined #openstack-swift04:44
*** psachin has joined #openstack-swift05:03
*** frank_young has joined #openstack-swift05:06
*** frank_young has quit IRC05:11
kota_hmm... exhausive tests for isa_l_cauchy k+m >= 25 seems too much expensive to run all cases.05:23
kota_i've been running the tests by k + m < 32 but around 24~25 = k + m patterns looks to be running for a week with aws ec2 m3.medium instance05:24
kota_so to run fast, i have to run for the bigger parameters in parallel but it seems expensive... :/05:25
*** frank_young has joined #openstack-swift05:27
*** rcernin has joined #openstack-swift05:29
*** cshastri has joined #openstack-swift05:40
*** kiennt has quit IRC05:43
*** kiennt has joined #openstack-swift06:00
*** OrionX_ has quit IRC06:15
*** OrionX has joined #openstack-swift06:15
*** OrionX has quit IRC06:20
*** SkyRocknRoll has joined #openstack-swift06:21
*** xrb has joined #openstack-swift06:26
*** ChubYann has quit IRC06:36
*** itlinux has quit IRC06:57
*** frank_young has quit IRC07:00
*** frank_young has joined #openstack-swift07:00
openstackgerritM V P Nitesh proposed openstack/swift master: Fix doc generation for Python3  https://review.openstack.org/45722007:04
*** nathaniel has joined #openstack-swift07:15
*** nathaniel is now known as Guest1916107:16
*** tesseract has joined #openstack-swift07:18
Guest19161Does the object node run a caching process that uses main memory instead of operating system caching?07:27
kota_Guest19161: AFAIK, Swift object node doesn't cache the object in the main memory, basically. Especially, swift works to run avoid os caching as possible.07:44
openstackgerritjunbo.li proposed openstack/swift master: [Api-ref] fix response status  https://review.openstack.org/48425407:44
*** oshritf has joined #openstack-swift07:51
openstackgerritGábor Antal proposed openstack/swift master: Use more specific asserts in test/unit/account tests  https://review.openstack.org/34276607:56
*** geaaru has joined #openstack-swift08:26
*** mvk has quit IRC08:27
* kota_ is on patch 47700008:35
patchbothttps://review.openstack.org/#/c/477000/ - swift - Ring rebalance respects co-builders' last_part_moves08:35
*** mvk has joined #openstack-swift08:55
*** cbartz has joined #openstack-swift09:00
*** oshritf has quit IRC09:08
*** oshritf has joined #openstack-swift09:09
*** oshritf has quit IRC09:09
*** ma9_1 has joined #openstack-swift09:12
*** frank_young has quit IRC09:16
*** frank_young has joined #openstack-swift09:20
*** oshritf has joined #openstack-swift09:26
xrbhi all,09:28
xrbtrying to restrict Swift's container access to other users of the same tenant..09:28
xrbNot sure if it is possible (e.g. using ACLs, I thought ACLs are rather a mean to extend access)..09:29
*** mvk has quit IRC09:33
kota_xrb: I'm not an expert on ACL but, AFAIK, operators can manage the access via Swift ACL in the tenant09:40
kota_xrb: the expected access control works as tested in https://github.com/openstack/swift/blob/master/test/functional/test_access_control.py09:41
kota_so that, you could see the condition of the account management and the expected ACL result there09:41
kota_the condition for the test is at https://github.com/openstack/swift/blob/master/test/functional/test_access_control.py#L75-L89 which includes "a same project but different role'ed users"09:43
*** mvk has joined #openstack-swift09:47
*** Dinesh_Bhor has quit IRC09:50
xrbkota_: thx! Looking at the link. There even seem to be a role (ResellerAdmin) who gets cross-account access...09:53
xrbkota_: does this mean cross tenant access?09:53
kota_xrb: true, AFAIK.09:56
kota_xrb: ResellerAdmin can access whole account/container/objects in the Swift system like as super user.09:56
*** tovin07_ has quit IRC09:57
*** kei_yama has quit IRC10:16
*** Dinesh_Bhor has joined #openstack-swift10:21
*** kei_yama has joined #openstack-swift10:22
*** kei_yama has quit IRC10:24
*** frank_young has quit IRC10:38
*** bkopilov has quit IRC10:46
*** frank_young has joined #openstack-swift10:48
*** winggundamth has quit IRC10:52
*** frank_young has quit IRC10:52
*** tonanhngo has joined #openstack-swift10:55
*** tonanhngo has quit IRC10:56
*** tonanhngo has joined #openstack-swift10:57
*** frank_young has joined #openstack-swift11:02
*** jistr is now known as jistr|tpb11:05
*** OrionX has joined #openstack-swift11:16
*** OrionX has quit IRC11:20
*** jistr|tpb is now known as jistr11:28
kota_acoles: I added my thought on patch 477000, please see and comments your idea on that. Thanks for working on that.11:34
patchbothttps://review.openstack.org/#/c/477000/ - swift - Ring rebalance respects co-builders' last_part_moves11:34
*** saint_ has joined #openstack-swift11:39
*** RayLei has joined #openstack-swift11:58
RayLeiIf there are two data centers, how is swift accurate and timely aware that one of the data centers has been down and the data is temporarily written to the hand-off node? When the swap out of the data center recovery, swift how accurate and timely know that the data center has been restored?11:59
*** chlong has joined #openstack-swift11:59
*** kiennt has quit IRC12:14
*** JimCheung has joined #openstack-swift12:20
*** JimCheung has quit IRC12:24
*** RayLei has quit IRC12:24
*** MVenesio has joined #openstack-swift12:29
*** frank_young has quit IRC12:29
*** caiobrentano has joined #openstack-swift12:31
*** bkopilov has joined #openstack-swift12:46
*** gkadam has quit IRC12:47
*** catintheroof has joined #openstack-swift12:51
*** catintheroof has quit IRC12:58
*** catintheroof has joined #openstack-swift13:06
*** catintheroof has quit IRC13:11
*** frank_young has joined #openstack-swift13:13
*** frank_young has quit IRC13:17
*** frank_young has joined #openstack-swift13:19
*** lucasxu has joined #openstack-swift13:31
*** JimCheung has joined #openstack-swift13:32
*** ma9_ has joined #openstack-swift13:35
*** JimCheung has quit IRC13:36
*** links has quit IRC13:38
*** ma9_1 has quit IRC13:38
*** ma9_ has quit IRC13:40
*** ma9_ has joined #openstack-swift13:41
*** ma9_ has quit IRC13:44
*** ntt has joined #openstack-swift13:45
nttHi, I have a swift cluster with 3 zones and 3 different servers (with replica=3). One of my servers goes down and now I have to restart after 10 days of inactivity. Should I do some particular operation or can I simply restart services on the node and resync starts automatically?13:47
*** ma9_ has joined #openstack-swift13:48
*** ma9_1 has joined #openstack-swift13:51
*** catintheroof has joined #openstack-swift13:51
*** ma9_ has quit IRC13:55
openstackgerritjunbo.li proposed openstack/swift master: [Api-ref] fix response status  https://review.openstack.org/48425413:59
*** klamath has joined #openstack-swift13:59
*** klamath has quit IRC14:00
*** klamath has joined #openstack-swift14:00
*** ma9_1 has quit IRC14:00
*** Guest19161 has quit IRC14:05
*** vint_bra has joined #openstack-swift14:17
*** vint_bra has quit IRC14:24
*** vint_bra has joined #openstack-swift14:27
caiobrentanontt You can simply restart services. Swift will do all the necessary sync14:36
nttcaiobrentano: thank you14:37
openstackgerritjunbo.li proposed openstack/swift master: [Api-ref] fix response status  https://review.openstack.org/48425414:39
*** frank_young has quit IRC14:44
*** frank_young has joined #openstack-swift14:54
xrbRe cross-tenant access with reseller-admin role: it works (using Swift API). I needed to add a proper user-role 'reseller-admin' specifying the target tenant (not the original tenant), and now I can access the bucket data..14:57
xrbOnly caveat: is works only with the Swift API and not using S3 API...14:58
*** frank_young has quit IRC14:59
*** cshastri has quit IRC15:01
*** gkadam has joined #openstack-swift15:03
*** ukaynar has joined #openstack-swift15:03
*** tovin07 has joined #openstack-swift15:04
notmynamegood morning15:08
notmynamekota_: thanks for the cauchy info. let me know if you need anything (another server?)15:10
*** vinsh has joined #openstack-swift15:11
xrbOk, found a way: working also with S3. I just need to generate a new set of ec2-credentials for the other tenant.15:11
xrbThe only drawback: using the reseller-admin role with S3: I cannot access at once cross tenant containers. I need another ec2-credential for each one (hence separate access)..15:13
notmynamentt: it depends on your replication cycle time and your reclaim age setting. if the server has been off for 10 days, but you're replicating quickly and have a reclaim age of 1 week, then you shouldn't plug in the old data drives. if you do, you have a chance of having previously-deleted data be resurrected (without being referenced in any container listing).15:13
notmynamentt: instead of plugging in the old data drives, it's better to plug in empty drives and let the replicator make sure the data is durable15:14
notmynamentt: of course, my first comment depends a little on your use case (how many DELETEs you have, what the settings in the cluster are, etc)15:14
*** OrionX has joined #openstack-swift15:30
*** rcernin has quit IRC15:32
*** logan- has joined #openstack-swift15:32
*** mvk has quit IRC15:34
tovin07notmyname: hello15:35
tovin07recently, cschwede_ said that he will review this patch https://review.openstack.org/#/c/468316/15:36
patchbotpatch 468316 - swift - OSprofiler in OpenStack Swift15:36
*** OrionX has quit IRC15:36
tovin07sadly, there was only one comment from timburke for a long time ago15:36
*** itlinux has joined #openstack-swift15:36
notmynametovin07: have you talked to cschwede_ in here about it?15:38
tovin07yes15:40
tovin07and in recent 0700 meeting15:40
cschwede_tovin07, i'm still working on it15:42
tovin07cschwede_: whao, thanks :D15:42
*** frank_young has joined #openstack-swift15:43
*** logan- has left #openstack-swift15:44
*** frank_young has quit IRC15:48
notmynamethis is interesting http://www.anandtech.com/show/11639/viking-ships-uhcsilo-ssds-50-tb-capacity-emlc-sas15:50
*** frank_young has joined #openstack-swift15:52
*** cbartz has quit IRC16:01
*** rcernin has joined #openstack-swift16:02
timburkegood morning16:09
*** tovin07 has left #openstack-swift16:20
*** JimCheung has joined #openstack-swift16:22
*** JimCheung has quit IRC16:22
*** JimCheung has joined #openstack-swift16:23
*** oshritf has quit IRC16:42
*** frank_young has quit IRC16:59
*** psachin has quit IRC16:59
*** jistr is now known as jistr|off17:06
*** ukaynar has quit IRC17:10
*** frank_young has joined #openstack-swift17:14
*** frank_young has quit IRC17:18
*** ChubYann has joined #openstack-swift17:20
*** klrmn has joined #openstack-swift17:20
*** cschwede_ has quit IRC17:26
*** gkadam has quit IRC17:42
*** ukaynar has joined #openstack-swift17:52
*** klamath has quit IRC17:55
*** klamath has joined #openstack-swift17:56
notmynameI'm working on some mostly internal stuff today, but I'm planning on starting on release stuff for swift and swift client tomorrow.17:56
notmynameplease continue to look at the patches on https://wiki.openstack.org/wiki/Swift/PriorityReviews17:56
*** klamath has quit IRC17:57
*** tesseract has quit IRC17:58
*** klamath has joined #openstack-swift17:58
*** frank_young has joined #openstack-swift18:00
*** frank_young has quit IRC18:04
*** deep-book-gk_ has joined #openstack-swift18:11
*** deep-book-gk_ has left #openstack-swift18:12
*** klamath has quit IRC18:27
*** geaaru has quit IRC18:28
*** ukaynar has quit IRC18:37
*** frank_young has joined #openstack-swift18:40
*** frank_young has quit IRC18:44
*** ukaynar has joined #openstack-swift18:46
*** chlong_ has joined #openstack-swift19:03
*** chlong has quit IRC19:05
*** Renich has joined #openstack-swift19:15
*** gyee has joined #openstack-swift19:17
*** SkyRocknRoll has quit IRC19:25
*** oshritf has joined #openstack-swift19:44
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873619:46
*** remix_tj has quit IRC19:49
*** remix_tj has joined #openstack-swift19:51
*** oshritf has quit IRC19:56
*** tdasilva- is now known as tdasilva20:09
*** ChanServ sets mode: +v tdasilva20:09
*** Dinesh_Bhor has quit IRC20:17
*** frank_young has joined #openstack-swift20:49
*** frank_young has quit IRC20:53
*** rcernin has quit IRC20:57
*** lucasxu has quit IRC21:02
*** lucasxu has joined #openstack-swift21:06
*** MVenesio has quit IRC21:09
*** lucasxu has quit IRC21:17
*** Renich has quit IRC21:18
*** caiobrentano has quit IRC21:30
*** ChubYann has quit IRC21:34
*** MVenesio has joined #openstack-swift21:50
*** MVenesio has quit IRC21:50
*** frank_young has joined #openstack-swift21:58
*** frank_young has quit IRC22:02
timburkekota_: notmyname: fwiw, i've checked `k+m <= 28` and `k <= 12, k+m <= 32` for cauchy using something like https://gist.github.com/tipabu/7d7c50dd02f557e30e38c8ebc46bcfca22:17
timburkeit's fun pinning 5 or 6 cores for a while!22:18
*** gyee has quit IRC22:20
*** vint_bra has quit IRC22:26
*** itlinux has quit IRC22:37
*** gyee has joined #openstack-swift22:38
*** ukaynar_ has joined #openstack-swift22:49
*** ukaynar has quit IRC22:51
*** JimCheung has quit IRC23:01
*** JimCheung has joined #openstack-swift23:01
*** catintheroof has quit IRC23:25
openstackgerritAkihiro Motoki proposed openstack/swift master: Turn on warning-is-error in doc build  https://review.openstack.org/48498123:33
*** itlinux has joined #openstack-swift23:54
*** lucasxu has joined #openstack-swift23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!