Wednesday, 2016-01-13

notmynameI think we can all appreciate this https://twitter.com/majorhayden/status/68705547114906009600:02
*** diogogmt has quit IRC00:04
ho_notmyname: lol00:08
openstackgerritTim Burke proposed openstack/swift: Make object-auditor storage-policy-aware  https://review.openstack.org/26659900:11
*** dimasot has quit IRC00:19
mattoliverauho_: morning00:23
mattoliveraunotmyname: o/00:23
ho_mattoliverau: morning!00:23
*** lcurtis has quit IRC00:23
*** tongli has joined #openstack-swift00:30
*** garthb has quit IRC00:30
*** garthb has joined #openstack-swift00:30
kota_good morning00:37
*** dmorita has quit IRC00:38
ho_kota_: morning!00:38
kota_ho: o/00:38
*** tongli has quit IRC00:40
*** dmorita has joined #openstack-swift00:40
*** tongli has joined #openstack-swift00:40
*** m_kazuhiro has joined #openstack-swift00:41
openstackgerritSamuel Merritt proposed openstack/swift: Install liberasurecode packages in SAIO.  https://review.openstack.org/26661800:42
*** dmorita has quit IRC00:44
mattoliveraukota_: o/00:46
kota_mattoliverau: o/00:46
*** dmorita has joined #openstack-swift00:49
*** dmorita has quit IRC00:54
*** dimasot has joined #openstack-swift01:01
*** Jeffrey4l has joined #openstack-swift01:03
*** dmorita has joined #openstack-swift01:08
*** itlinux has quit IRC01:10
*** tongli has quit IRC01:10
*** ekarlso has quit IRC01:10
*** tongli has joined #openstack-swift01:11
*** tongli has quit IRC01:11
*** tongli has joined #openstack-swift01:11
*** garthb has quit IRC01:25
*** zhill has quit IRC01:25
*** haomaiwang has joined #openstack-swift01:29
*** badari has quit IRC01:34
*** badari has joined #openstack-swift01:34
*** dmorita has quit IRC01:35
*** dmorita has joined #openstack-swift01:41
*** zhill has joined #openstack-swift01:41
*** zhill has quit IRC01:46
*** haomaiwang has quit IRC01:48
*** 7JTABI1K9 has joined #openstack-swift01:49
*** chlong is now known as chlong-afk01:53
*** thumpba has joined #openstack-swift01:55
*** thumpba_ has joined #openstack-swift01:58
*** dmorita has quit IRC01:58
*** thumpba has quit IRC01:58
*** thumpba_ has quit IRC02:01
*** thumpba has joined #openstack-swift02:01
*** badari has quit IRC02:02
*** diogogmt has joined #openstack-swift02:02
*** thumpba has quit IRC02:03
*** thumpba has joined #openstack-swift02:07
*** mingdang1 has joined #openstack-swift02:08
*** tongli has quit IRC02:09
*** tongli has joined #openstack-swift02:10
*** badari has joined #openstack-swift02:10
*** tongli has quit IRC02:15
*** dmorita has joined #openstack-swift02:16
*** badari has quit IRC02:19
*** dmorita has quit IRC02:20
*** thumpba has quit IRC02:31
*** thumpba has joined #openstack-swift02:31
*** thumpba has quit IRC02:32
*** asettle has quit IRC02:34
*** asettle has joined #openstack-swift02:35
*** thumpba has joined #openstack-swift02:38
*** thumpba has quit IRC02:40
*** thumpba has joined #openstack-swift02:42
*** dewsday has joined #openstack-swift02:49
*** dewsday has quit IRC02:50
*** dewsday has joined #openstack-swift02:51
*** asettle has quit IRC02:51
*** dewsday is now known as asettle02:51
openstackgerritMerged openstack/swift: swift-init: New option kill-after-timeout  https://review.openstack.org/22953202:53
openstackgerritTristan Cacqueray proposed openstack/swift: Get better at closing WSGI iterables.  https://review.openstack.org/21775002:56
*** sanchitmalhotra has joined #openstack-swift02:59
*** lcurtis has joined #openstack-swift03:05
openstackgerritMerged openstack/swift: Print min_part_hours lockout time remaining  https://review.openstack.org/25757703:07
*** nadeem has joined #openstack-swift03:07
*** thumpba has quit IRC03:08
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925003:13
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873603:13
*** sudorandom has quit IRC03:14
*** thumpba has joined #openstack-swift03:16
*** sudorandom has joined #openstack-swift03:16
*** ekarlso has joined #openstack-swift03:19
*** links has joined #openstack-swift03:23
*** nadeem has quit IRC03:28
*** gyee has quit IRC03:34
*** Jeffrey4l has quit IRC03:40
*** thumpba has quit IRC03:44
*** thumpba has joined #openstack-swift03:45
*** thumpba has quit IRC03:50
*** Jeffrey4l has joined #openstack-swift03:53
*** m_kazuhiro has quit IRC03:56
*** zhill has joined #openstack-swift03:57
*** m_kazuhiro has joined #openstack-swift03:58
*** zhill has quit IRC04:02
*** itlinux has joined #openstack-swift04:03
*** kei_yama_ has joined #openstack-swift04:03
*** kei_yama has quit IRC04:04
*** zhill has joined #openstack-swift04:06
*** tongli has joined #openstack-swift04:10
*** zhill has quit IRC04:10
*** venkat has joined #openstack-swift04:10
*** Jeffrey4l has quit IRC04:11
*** trifon has joined #openstack-swift04:21
*** tongli has quit IRC04:23
*** Jeffrey4l has joined #openstack-swift04:23
venkatHi all04:24
*** tongli has joined #openstack-swift04:24
venkatHow to use EC PUTs?04:24
kota_vanket: config your ec policy in /etc/swift/swift.conf04:26
*** tongli has quit IRC04:26
*** tongli has joined #openstack-swift04:26
kota_vanket: and make your ec containers with X-Storage-Policy: <your ec policy name>04:27
kota_X-Storage-Policy is a header available on PUT container04:27
kota_PUTing all objects in the container will be handled as EC PUTs (i hope that would be what you expected)04:29
venkatkota_: Ok, Thanks04:29
*** nadeem has joined #openstack-swift04:30
*** tongli has quit IRC04:30
*** tongli has joined #openstack-swift04:31
*** kei_yama_ has quit IRC04:34
mahaticgood morning04:35
*** kei_yama has joined #openstack-swift04:35
*** tongli has quit IRC04:35
*** tongli has joined #openstack-swift04:36
*** tongli has quit IRC04:40
*** sudorandom has quit IRC04:45
*** sudorandom has joined #openstack-swift04:45
*** trifon has quit IRC04:48
*** thumpba has joined #openstack-swift04:55
*** sudorandom has quit IRC04:56
*** sudorandom has joined #openstack-swift05:00
*** thumpba has quit IRC05:01
*** zhill has joined #openstack-swift05:06
*** zhill has quit IRC05:10
openstackgerritTimur Alperovich proposed openstack/swift: Make _get_addr() method a function in utils.  https://review.openstack.org/26550105:11
openstackgerritTimur Alperovich proposed openstack/swift: fixups for ipv6 memcache_servers docs  https://review.openstack.org/26548205:11
openstackgerritTimur Alperovich proposed openstack/swift: Fail early if the memcache address is invalid.  https://review.openstack.org/26546505:11
*** wer has quit IRC05:11
*** wer has joined #openstack-swift05:11
timur^^^ rebasing to fix a merge issue05:14
*** nadeem has quit IRC05:17
*** klrmn has quit IRC05:20
*** zhill has joined #openstack-swift05:25
*** zhill has quit IRC05:33
*** asettle has quit IRC05:34
*** lcurtis has quit IRC05:38
timurI bumped into a failure which appears unrelated to the change: Failed building wheel for PyECLib. Is this a known issue?05:51
timurspecifically: Can not locate liberasurecode.so.105:53
timurI bumped into the same issue with SAIO build (liberasurecode-dev had to be installed), I wonder if that is related?05:56
*** trifon has joined #openstack-swift05:58
mattoliverautimur: could be, the latest pyeclib doesn't bundle liberasurecode anymore.06:01
timurthat would make sense06:10
*** janonymous has joined #openstack-swift06:23
*** silor has joined #openstack-swift06:24
*** asettle has joined #openstack-swift06:28
*** ChubYann has quit IRC06:31
*** silor1 has joined #openstack-swift06:33
*** silor has quit IRC06:34
*** silor1 is now known as silor06:34
*** amit213 has quit IRC06:35
*** amit213 has joined #openstack-swift06:35
*** asettle has quit IRC06:40
*** mrmoje has joined #openstack-swift06:49
*** eranrom has joined #openstack-swift07:02
*** venkat has quit IRC07:05
*** silor has quit IRC07:32
*** silor has joined #openstack-swift07:34
*** silor1 has joined #openstack-swift07:37
*** silor has quit IRC07:39
*** silor1 is now known as silor07:39
*** SkyRocknRoll has joined #openstack-swift07:45
*** ntt has joined #openstack-swift07:51
*** arnox has joined #openstack-swift07:58
*** jistr has joined #openstack-swift08:07
*** 7JTABI1K9 has quit IRC08:07
*** jistr is now known as jistr|doc08:07
*** 21WAARZWA has joined #openstack-swift08:07
*** zaitcev has quit IRC08:09
*** mrmoje has quit IRC08:12
*** Jeffrey4l has quit IRC08:12
*** rledisez has joined #openstack-swift08:15
*** hseipp has joined #openstack-swift08:16
*** geaaru has joined #openstack-swift08:22
*** Jeffrey4l has joined #openstack-swift08:29
*** daemontool has joined #openstack-swift08:40
*** daemontool_ has joined #openstack-swift08:43
*** daemontool has quit IRC08:43
ho_takashi: if you don't have a time to rebase your patch, may i rebase it?08:43
*** kei_yama has quit IRC08:44
*** daemontool_ is now known as daemontool08:44
*** jmccarthy1 has joined #openstack-swift08:49
*** jmccarthy has quit IRC08:49
*** jmccarthy has joined #openstack-swift08:50
*** jmccarthy1 has quit IRC08:55
*** jmccarthy has quit IRC08:56
*** jmccarthy has joined #openstack-swift08:56
*** MVenesio has quit IRC08:56
*** [1]eranrom has joined #openstack-swift08:58
*** eranrom has quit IRC08:58
*** [1]eranrom is now known as eranrom08:58
*** 21WAARZWA has quit IRC09:01
*** 17WABJGSS has joined #openstack-swift09:01
*** venkatesh has joined #openstack-swift09:13
venkateshliberasurecode[6663]: liberasurecode_backend_open: dynamic linking error libJerasure.so.2: cannot open shared object file: No such file or directory09:15
venkateshERROR: Invalid Storage Policy Configuration in /etc/swift/swift.conf (Error creating EC policy (pyeclib_c_init ERROR: Invalid arguments. Please inspect syslog for liberasurecode error report.), for index 2)09:15
venkateshHi all, I am getting the above error09:15
*** joeljwright has joined #openstack-swift09:28
*** ChanServ sets mode: +v joeljwright09:28
ho_venkatesh: try to execute sudo  /sbin/ldconfig ?09:30
venkateshok Thanks09:30
venkateshho_: still same problem ...09:33
ho_venkatesh: sorry.. fyi my saio works with procedure of sam's patch09:34
*** acoles_ is now known as acoles09:36
*** proteusguy has quit IRC09:40
*** proteusguy has joined #openstack-swift09:53
*** 17WABJGSS has quit IRC10:01
*** haomaiwang has joined #openstack-swift10:01
*** dimasot has quit IRC10:05
*** dimasot has joined #openstack-swift10:06
venkateshHi all10:10
venkateshwhat is usage of the following headers,10:10
venkateshX-Backend-Ssync-Frag-Index10:10
venkateshX-Backend-Replication-Headers10:10
venkateshany documentation is available for it10:11
venkatesh?10:11
venkateshI know these are internal headers10:11
openstackgerritHisashi Osanai proposed openstack/swift: Fix deleting containers behavior when half of container servers downed  https://review.openstack.org/26619910:17
*** jistr|doc is now known as jistr10:19
*** jistr has quit IRC10:26
venkateshwhat is usage of the following headers: X-Backend-Ssync-Frag-Index, X-Backend-Replication-Headers10:37
ho_takashi: i can't upload rebased patch (no permission???) do we need to submit new patch?10:37
*** mingdang1 has quit IRC10:41
openstackgerritOndřej Nový proposed openstack/swift: Allow to change auditor sleep interval in config  https://review.openstack.org/26656110:49
*** jistr has joined #openstack-swift10:51
*** haomaiwang has quit IRC11:01
*** haomaiwang has joined #openstack-swift11:01
*** daemontool_ has joined #openstack-swift11:01
*** daemontool has quit IRC11:05
*** hseipp has quit IRC11:07
*** kaleta has quit IRC11:08
*** zackmdavis_ has quit IRC11:09
*** alpha_ori has quit IRC11:09
*** kaleta has joined #openstack-swift11:13
*** zackmdavis has joined #openstack-swift11:13
*** alpha_ori has joined #openstack-swift11:14
ho_all, is it possible to upload new patch set on abandoned patch?11:14
*** ho_ has quit IRC11:22
*** silor has quit IRC11:23
*** aix has joined #openstack-swift11:28
*** sanchitmalhotra has quit IRC11:34
*** venkatesh has quit IRC11:41
*** m_kazuhiro has quit IRC11:42
*** aix has quit IRC11:43
*** haomaiwang has quit IRC11:44
*** haomaiwang has joined #openstack-swift11:48
*** daemontool_ has quit IRC11:54
*** MVenesio has joined #openstack-swift11:56
*** daemontool has joined #openstack-swift11:57
*** hseipp has joined #openstack-swift11:58
*** hseipp has quit IRC11:58
*** hseipp has joined #openstack-swift11:58
*** haomaiwang has quit IRC12:01
*** aix has joined #openstack-swift12:01
*** haomaiwang has joined #openstack-swift12:01
*** wasmum- has quit IRC12:03
*** silor has joined #openstack-swift12:04
*** takashi has joined #openstack-swift12:07
*** lcurtis has joined #openstack-swift12:09
*** silor1 has joined #openstack-swift12:09
*** silor has quit IRC12:10
*** silor1 is now known as silor12:10
*** silor has quit IRC12:13
*** silor has joined #openstack-swift12:15
*** ho_away has joined #openstack-swift12:17
*** takashi has quit IRC12:17
*** silor1 has joined #openstack-swift12:18
*** lcurtis has quit IRC12:19
*** silor has quit IRC12:19
*** silor1 is now known as silor12:19
*** takashi has joined #openstack-swift12:20
*** takashi has quit IRC12:29
*** takashi has joined #openstack-swift12:34
acolesho_away: you can "restore" an abandoned patch then upload new version12:37
acolesho_away: at least, that was possible in the old gerrit interface12:38
ho_awayacoles: thanks! one more question. how to restore a patch?12:39
acolesho_away: on gerrit, under the section with Owner/Reviewers etc there is a button 'Restore'12:41
acolesho_away: ah, but it seems you need to be the review owner to see that button12:42
acoleswhich makes sense12:42
ho_awayacoles: thanks! yeah, it makes sense.12:42
*** km_ has quit IRC12:44
acoleseranrom: are you planning to propose your probe test for the container sync 404 to master?12:48
acoleseranrom: https://gist.github.com/eranrom/9b7a6ec3b16212c1259012:48
takashiho_away: I restored my patch, because that can deal with some more situations as you commented on your patch.12:58
takashiho_away:  I'm going to rebase that patch later, but now something is wrong with my virtualbox... :-(12:58
*** haomaiwang has quit IRC13:01
*** 16WAAJ6X5 has joined #openstack-swift13:01
*** links has quit IRC13:04
*** ho_away has quit IRC13:07
*** rcernin has joined #openstack-swift13:09
*** dslevin has quit IRC13:15
openstackgerritVishal kumar mahajan proposed openstack/python-swiftclient: Replace assertEqual(*, None) with assertIsNone in tests.  https://review.openstack.org/26690613:19
*** mingdang1 has joined #openstack-swift13:23
*** dustins has joined #openstack-swift13:23
*** dimasot has quit IRC13:36
openstackgerritMerged openstack/swift: Install liberasurecode packages in SAIO.  https://review.openstack.org/26661813:38
*** ho_away has joined #openstack-swift13:39
openstackgerritMerged openstack/swift: fixups for ipv6 memcache_servers docs  https://review.openstack.org/26548213:41
ho_awaytakashi: i already prepared rebased patch so is it ok to upload it?13:42
takashiho_away: no problem, thanks!13:42
ho_awaytakashi: thanks! i will do it :)13:43
*** 16WAAJ6X5 has quit IRC13:44
*** jistr has quit IRC13:48
*** jistr has joined #openstack-swift13:49
openstackgerritHisashi Osanai proposed openstack/swift: Allow asynchronous update to account in container PUT/DELETE  https://review.openstack.org/8788213:50
*** m_kazuhiro has joined #openstack-swift13:53
*** takashi has quit IRC13:56
*** jordanP has joined #openstack-swift13:57
*** m_kazuhiro has quit IRC14:03
*** links has joined #openstack-swift14:04
*** links has quit IRC14:09
*** links has joined #openstack-swift14:09
*** thumpba has joined #openstack-swift14:15
*** dimasot has joined #openstack-swift14:21
*** haomaiwang has joined #openstack-swift14:22
*** dimasot has quit IRC14:22
*** dimasot has joined #openstack-swift14:23
mahaticacoles: jlhinson, jrichli :hi, would you happen to know the etherpad where there was a discussion on conditional GETs for encryption?14:24
*** haomaiwang has quit IRC14:24
*** 21WAAR2TX has joined #openstack-swift14:24
*** links has quit IRC14:25
*** links has joined #openstack-swift14:25
*** diogogmt has quit IRC14:26
*** fthiagogv has joined #openstack-swift14:27
*** links has quit IRC14:29
*** links has joined #openstack-swift14:30
*** esker has quit IRC14:32
*** thumpba has quit IRC14:33
mahaticI found it14:36
*** dslevin has joined #openstack-swift14:38
*** SkyRocknRoll has quit IRC14:38
*** badari has joined #openstack-swift14:38
*** thumpba has joined #openstack-swift14:39
openstackgerritMerged openstack/swift: Fix ClientException handling in Container Sync  https://review.openstack.org/25630614:44
*** lpabon has joined #openstack-swift14:45
*** blmartin has joined #openstack-swift14:50
*** SkyRocknRoll has joined #openstack-swift14:50
*** itlinux has quit IRC14:56
*** petertr7_away is now known as petertr714:56
acolestimburke: (when you are awake...) i'm trying to grok the transfer_encoding condition in patch 265417? as in, i am trying but failing to see where dlo sets it when it does not set content-length?14:58
patchbotacoles: https://review.openstack.org/#/c/265417/ - _RetryBody doesn't need to take explicit etag/cont...14:58
*** 21WAAR2TX has quit IRC15:01
*** haomaiwang has joined #openstack-swift15:01
*** links has quit IRC15:07
*** lcurtis has joined #openstack-swift15:12
*** zaitcev has joined #openstack-swift15:12
*** ChanServ sets mode: +v zaitcev15:12
*** breitz has quit IRC15:19
*** diazjf has joined #openstack-swift15:31
mahaticacoles: I think it is set here instead: https://github.com/openstack/swift/blob/2.5.0/swift/proxy/controllers/obj.py#L176815:32
mahaticNot sure if that helps15:32
*** mingdang1 has quit IRC15:33
acolesmahatic: thanks. that's the PUT path to object server, i am looking for it in the GET path15:34
mahaticah15:35
*** nadeem has joined #openstack-swift15:38
mahatichmm, I can only see it PUT so far..15:38
*** mrmoje has joined #openstack-swift15:41
*** ho_away has quit IRC15:46
*** silor has quit IRC15:47
*** mragupat has joined #openstack-swift15:50
*** diogogmt has joined #openstack-swift15:55
*** nadeem has quit IRC15:57
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873615:57
*** nadeem has joined #openstack-swift15:58
*** haomaiwang has quit IRC16:01
*** haomaiwang has joined #openstack-swift16:01
*** klrmn has joined #openstack-swift16:02
jrichlimahatic: Hello!  hope you are doing well.  glad you found what you were looking for.  :-)16:07
mahaticjrichli: hello, good morning. yup :)16:08
*** eranrom has quit IRC16:14
*** blmartin has quit IRC16:20
*** blmartin has joined #openstack-swift16:21
lcurtisgood morning all...trying to understand the swift code better. Could someone point out where the logic is that factors in weight in determining how many partitions a device should receive?16:33
notmynamegood morning. lcurtis, in https://github.com/openstack/swift/blob/master/swift/common/ring/builder.py16:34
*** petertr7 is now known as petertr7_away16:35
lcurtisnotmyname: thank you16:35
lcurtisis there the possibility that increasing weight several times could cause a partition to have to move several times as well?16:36
*** mrmoje has quit IRC16:36
notmynamea partition can move once per rebalance16:37
*** diazjf has quit IRC16:38
lcurtisbut say if you just change weight on a device...is it possible that a partition would move several times due to increasing weight?16:38
lcurtisi was under impression that a partition would not move until weight was such that it forced partition to be placed elsewhere16:39
lcurtiswe are getting short on space and adding new nodes...rebalancing is taking extremely long time16:39
lcurtisso thought is next addition of nodes we want to add in one fell swoop16:39
lcurtisin a large chunk16:40
lcurtisbut just bring weight up gradually16:40
lcurtisargument is that will just cause moving of partitions several times16:40
notmynamethat's generally the best practice16:40
notmynamering updates work like a state machine (stick with me here)16:42
notmynameyou set info about the ring via adding devices, removing devices, setting weights16:43
*** trifon has quit IRC16:43
notmynamethen the rebalance operation is the "turing the crank" that computes on everything to get you to your next ring state16:43
notmynameyou deploy that new ring state, and the process repeats16:44
notmynameso just doing multiple calls to change the weight of devices doesn't do anything until you rebalance and deploy16:44
lcurtisokay..got it16:44
notmynameand, in general, a partition (or one replica of a partition) will change devices one time per rebalance16:44
notmynameand you want to make sure you've had a replication cycle complete before doing another ring rebalance/deploy so that you keep availability of all the data16:46
lcurtisso in that case, adding full weight could potentially cause horrible performance, but things will move only once?16:46
lcurtisokay..makes sense16:46
hurricanerixI just submitted a small PR if anybody is bored and would like to take a look: https://review.openstack.org/#/c/267016/16:46
*** cdelatte has joined #openstack-swift16:47
notmynameadding a bunch of capacity at once will (1) likely cause a lot of data movement that can impact end-user performance (2) likely won't result in a final balanced state because it will only move one replica of a partition per rebalance. it will likely take several rebalances to get the cluster balanced16:47
lcurtisbam..okay16:48
notmynamehurricanerix: that looks like one of those things that has a funny story about it. also, it has no tests, so won't there be a regression at some point if left as-is?16:48
lcurtisand really best way to know if rebalance is finished is to look in logs for "replication complete"16:48
lcurtis?16:49
notmynamelcurtis: exactly16:49
lcurtisgot it16:49
notmynamewell, sorof16:49
lcurtisman ..thank you so much16:49
notmynamea rebalance is an offline operation that you do on the ring. you know when it's done because the command completes16:49
hurricanerixnotmyname: yeah, i figured someone would ask for tests, but I figured I would submit the patch first to see if people liked the change to begin with.16:49
notmynamethe replication is what you're looking for16:49
*** yatin has joined #openstack-swift16:50
notmyname(IMO it's pretty important here to be specific about replication and rebalancing and to not confuse the words)16:50
lcurtisyes..agreed16:50
hurricanerixnotmyname: as for the story, i was working on a change to staticweb that involved container level metadata.  the first time the page loads it worked, but subsequent page loads crashed because the first time it loaded it was getting something of type str, and the second time it was getting something of type unicode16:50
hurricanerixnotmyname: so I considered it a bug that data would get returned as different types based on if it was cached or not.16:51
lcurtiserrrm..so that leads me thinking about handoff partitions...how is a handoff partition flagged versus a partition that is marked to be moved during a rebalance?16:51
hurricanerixi guess i should have wrote more of that and maybe submitted it as a actual bug...16:51
notmynamehurricanerix: hilarious!16:51
*** rcernin has quit IRC16:51
*** diazjf has joined #openstack-swift16:51
hurricanerixnotmyname you want me to create a bug for it, and re-submit with a ref to it?16:52
notmynamelcurtis: "handoff" is only a thing defined by the results of the call to get_more_nodes(). it's not a concept that means anything with regards to rebalancing. ie it's not "flagged" or anything. handoffs are just an ordered walk through the ring16:53
*** petertr7_away is now known as petertr716:55
notmynamehurricanerix: it's not like I wouldn't approve the patch if it doesn't reference a LP bug, but having the bug is nice for tracking purposes. so yeah, if you make a LP bug for it, that would be good16:55
lcurtisnotmyname: thanks again for your guidance16:56
notmynamehappy to help16:56
* notmyname steps away for a bit16:56
pdardeaunotmyname: keep those insights coming. don't leave the keyboard!!16:56
*** yatin has quit IRC16:57
hurricanerixnotmyname: ok, i will create a LP bug for it then16:57
*** dustins has quit IRC16:59
*** haomaiwang has quit IRC17:01
*** haomaiwang has joined #openstack-swift17:01
*** jistr has quit IRC17:08
*** klrmn has quit IRC17:18
*** mragupat has quit IRC17:20
*** yatin has joined #openstack-swift17:20
*** mragupat has joined #openstack-swift17:20
*** thumpba has quit IRC17:22
*** thumpba has joined #openstack-swift17:22
*** mragupat_ has joined #openstack-swift17:23
*** yatin has quit IRC17:25
*** ssrikant has joined #openstack-swift17:26
*** mragupat has quit IRC17:26
*** ssrikant has left #openstack-swift17:26
hurricanerixnotmyname: https://bugs.launchpad.net/swift/+bug/1533768 and I re-submitted it adding "Closes-Bug: 1533768" to the commit message.17:27
openstackLaunchpad bug 1533768 in OpenStack Object Storage (swift) "inconsistent types returned for metadata " [Undecided,In progress] - Assigned to Richard Hawkins (richard-hawkins)17:27
*** fesp has joined #openstack-swift17:33
*** fesp has quit IRC17:34
*** MVenesio has quit IRC17:38
*** joeljwright has quit IRC17:43
*** diazjf has quit IRC17:46
*** ChubYann has joined #openstack-swift17:46
*** rledisez has quit IRC17:49
*** jordanP has quit IRC17:55
*** petertr7 is now known as petertr7_away17:56
*** haomaiwang has quit IRC18:01
openstackgerritMerged openstack/swift: Functional tests for if-match with multiple etags  https://review.openstack.org/26651618:01
*** haomaiwang has joined #openstack-swift18:01
dimasothi18:02
*** briancurtin has quit IRC18:08
*** cppforlife_ has quit IRC18:08
*** serverascode has quit IRC18:08
*** zhiyan has quit IRC18:08
*** nottrobin has quit IRC18:08
* notmyname back18:09
notmynamehurricanerix: thanks18:09
*** CaioBren_ has joined #openstack-swift18:12
*** hseipp has quit IRC18:14
*** CaioBrentano has quit IRC18:15
*** CaioBren_ has quit IRC18:17
*** serverascode has joined #openstack-swift18:17
*** CaioBrentano has joined #openstack-swift18:17
*** gyee has joined #openstack-swift18:18
*** nottrobin has joined #openstack-swift18:19
notmynamethe container sync exception patch landed. yay18:21
*** dustins has joined #openstack-swift18:21
*** fthiagogv_ has joined #openstack-swift18:22
notmynamepeterlisak: did you add patch 238799 to the meeting agenda?18:23
patchbotnotmyname: https://review.openstack.org/#/c/238799/ - Change schedule priority of daemon/server in config18:23
*** zhiyan has joined #openstack-swift18:24
*** fthiagogv has quit IRC18:24
*** Jeffrey4l has quit IRC18:25
*** arnox has quit IRC18:25
*** garthb has joined #openstack-swift18:25
*** briancurtin has joined #openstack-swift18:25
*** klrmn has joined #openstack-swift18:27
*** fthiagogv_ has quit IRC18:27
*** cppforlife_ has joined #openstack-swift18:29
*** rcernin has joined #openstack-swift18:30
notmynameI tried to summarize the gerrit discussion on that patch in the meeting agenda https://wiki.openstack.org/wiki/Meetings/Swift18:33
timburkeacoles: DLO won't set it; it just explicitly *doesn't* include a content-length (https://github.com/openstack/swift/blob/2.5.0/swift/common/middleware/dlo.py#L174-L176) and relies on WSGI to turn its iterator into a chunked response. and from the rfc (http://tools.ietf.org/html/rfc7230#section-3.3.3), "If a message is received with both a Transfer-Encoding and a Content-Length header field, the Transfer-Encoding overrides the Content-18:37
timburkeLength." so we even if we get both, we can't trust the length18:37
acolestimburke: ok, so swift doesn't need to explicitly set transfer-encoding, it is sufficient to just not set content-length and wsgi will set a tranfer-encoding response header?18:40
acolestimburke: i could see how dlo does not set content-length, just didn't know how transfer-encoding got set18:41
*** diazjf has joined #openstack-swift18:42
*** ig0r_ has joined #openstack-swift18:43
*** barker has joined #openstack-swift18:50
*** diazjf has quit IRC18:52
*** daemontool has quit IRC18:54
*** daemontool has joined #openstack-swift18:54
*** diazjf has joined #openstack-swift18:56
*** haomaiwang has quit IRC19:01
*** 5EXAAP39W has joined #openstack-swift19:01
*** garthb_ has joined #openstack-swift19:02
*** garthb has quit IRC19:03
*** fthiagogv has joined #openstack-swift19:04
*** zhill has joined #openstack-swift19:06
*** diazjf has quit IRC19:07
*** jmccarthy has quit IRC19:09
*** petertr7_away is now known as petertr719:19
openstackgerritRichard Hawkins proposed openstack/swift: Add option for label to static web listings  https://review.openstack.org/26712319:21
*** geaaru has quit IRC19:22
*** eranrom has joined #openstack-swift19:25
*** tsg has joined #openstack-swift19:42
*** diazjf has joined #openstack-swift19:46
*** petertr7 is now known as petertr7_away19:47
tsgtorgomatic_, notmyname: thanks for getting the SAIO/liberasurecode-dev change in!  did you need to enable to trusty/precise-backports repo to get the pkg in ubuntu?19:49
*** petertr7_away is now known as petertr719:50
tsgtorgomatic_, notmyname: if yes, perhaps we should add a note to that effect to SAIO docs19:51
dimasotclayg: do you think that there is a place to add the data_mover that I am working on as part of swift related scripts?19:55
*** acoles is now known as acoles_19:56
dimasotshould I add it as topic to the IRC meeting? or you think it is too raw ?19:56
*** 5EXAAP39W has quit IRC20:01
notmynamedimasot: what would you want to get out of adding it to the meeting agenda?20:01
*** haomaiwang has joined #openstack-swift20:01
ZyricGood Morning20:03
*** eranrom has quit IRC20:03
*** wer has quit IRC20:04
*** wer has joined #openstack-swift20:04
*** diazjf has quit IRC20:07
claygtimburke: I'm sorry - I did *not* see patch 266599 come in yesterday afternoon20:07
patchbotclayg: https://review.openstack.org/#/c/266599/ - Make object-auditor storage-policy-aware20:07
timburkeno worries20:08
timburkei suppose i should have just added you as a reviewer...next time.20:08
*** diazjf has joined #openstack-swift20:10
*** diazjf has quit IRC20:11
*** rcernin has quit IRC20:20
*** albertom has quit IRC20:20
*** garthb_ has quit IRC20:22
*** garthb_ has joined #openstack-swift20:22
*** diazjf has joined #openstack-swift20:28
claygdid anyone ever make that "things you can't have until you start using python3" web page?  datetime.timestamp() for the love of god!20:29
*** diazjf has quit IRC20:30
clayga'int nobody got time to figure out how many parts of timetuple to send into mktime!20:30
*** andrew__ has joined #openstack-swift20:34
*** diazjf has joined #openstack-swift20:36
*** daemontool has quit IRC20:37
*** barker has quit IRC20:37
*** daemontool has joined #openstack-swift20:38
*** forcebanana has joined #openstack-swift20:43
*** joeljwright has joined #openstack-swift20:47
*** ChanServ sets mode: +v joeljwright20:47
*** rcernin has joined #openstack-swift20:49
lcurtisall, is there a way to tell how many partitions might be left to move in a rebalance?20:49
lcurtislike compare ring against existing partitions?20:50
openstackgerritTim Burke proposed openstack/swift: Make object-auditor storage-policy-aware  https://review.openstack.org/26659920:50
openstackgerritRichard Hawkins proposed openstack/swift: Add option for label to static web listings  https://review.openstack.org/26712320:54
*** diazjf has quit IRC20:54
*** aix has quit IRC20:56
*** ho_away has joined #openstack-swift20:56
*** minwoob_ has joined #openstack-swift20:58
notmynamejust about meeting time (in #openstack-meeting)20:58
kota_good morning20:58
*** acoles_ is now known as acoles20:59
mattoliveraumorning20:59
mattoliveraukota_: o/20:59
gmmahagood morning kota_ mattoliverau20:59
kota_mattoiverau, gmmaha: o/20:59
mattoliveraugmmaha: o/20:59
acolesmattoliverau: kota_ good morning21:00
kota_acoles: o/21:00
*** haomaiwang has quit IRC21:01
mattoliverauyay its acoles!21:01
*** haomaiwang has joined #openstack-swift21:01
*** ekarlso has quit IRC21:01
*** ekarlso has joined #openstack-swift21:01
torgomatic_.21:02
torgomatic_oh waqit21:02
torgomatic_too many channels21:02
*** badari has quit IRC21:02
*** dustins has quit IRC21:03
*** rcernin has quit IRC21:04
*** bjkeller has joined #openstack-swift21:05
notmynameclayg: courtesy ping. we're discussing patch 238799 in the meeting right now21:06
patchbotnotmyname: https://review.openstack.org/#/c/238799/ - Change schedule priority of daemon/server in config21:06
notmynameand onovy ^21:06
*** sarafraj has joined #openstack-swift21:07
*** asettle has joined #openstack-swift21:08
*** diazjf has joined #openstack-swift21:13
*** ig0r_ has quit IRC21:14
*** admin0 has joined #openstack-swift21:18
*** badari has joined #openstack-swift21:21
*** ig0r_ has joined #openstack-swift21:22
*** forcebanana has quit IRC21:27
*** admin0 has quit IRC21:28
*** ig0r_ has quit IRC21:31
*** lpabon has quit IRC21:35
acolestimburke: i still could not track down exactly where transfer-encoding is set? am i being dumb?21:35
onovynotmyname: big sorry21:35
notmynameno worries21:36
timburkeacoles: https://github.com/eventlet/eventlet/blob/master/eventlet/wsgi.py#L417-L42021:36
acolestimburke: thank you!21:37
acolestimburke: i feel better about my +2 now :)21:37
timburkehehe. i suppose i should maybe check for the presence of content-length as well (to cover the HTTP/1.0 case), but i think we can trust requests to use 1.121:38
*** lpabon has joined #openstack-swift21:39
*** lpabon has quit IRC21:41
acoleszaitcev: mattoliverau thanks for your reviews on the fast-post patch BTW. I finally got time to work on it this week so will update soon.21:41
*** lpabon has joined #openstack-swift21:41
*** barker has joined #openstack-swift21:41
zaitcevacoles: it's nowhere near done yet, I only looked briefly, sorry. I mean to complete it soon.21:41
mattoliverauacoles: make sure you ping me when you do. I want to help get it in :)21:41
*** lpabon has left #openstack-swift21:41
zaitcevacoles: if you upload new version, all the better. Don't wait for any groundbreaking insights from me.21:42
mattoliveraualso I can't remember where I was up to on it either, so my bad for letting it fall outta my brain :)21:42
acolesmattoliverau: zaitcev no worries. i had an ugly merge conflict in diskfile (of my own making) but I think it has simplified some things21:43
*** ig0r_ has joined #openstack-swift21:44
*** thumpba has quit IRC21:44
*** ig0r_ has quit IRC21:45
*** mrmoje has joined #openstack-swift21:47
notmynameonovy: you got your answer about UTC then?21:50
*** joeljwright has quit IRC21:51
*** ho_away has quit IRC21:51
*** ChanServ changes topic to "Review Dashboard: https://goo.gl/mtEv1C | Hackathon: https://www.eventbrite.com/e/swift-hackathon-bristol-sponsored-by-hpe-tickets-19994495073 | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | Meetings: https://wiki.openstack.org/wiki/Meetings/Swift | What's going on survey: https://gist.github.com/notmyname/be49b04165928fd6662f"21:52
notmynamelink to https://gist.github.com/notmyname/be49b04165928fd6662f in the topic now21:53
*** rcernin has joined #openstack-swift21:54
onovynotmyname: yep, UTC.21:57
*** garthb__ has joined #openstack-swift21:58
*** acoles is now known as acoles_21:59
*** barker has quit IRC22:00
*** garthb__ has quit IRC22:00
*** haomaiwang has quit IRC22:01
*** garthb__ has joined #openstack-swift22:01
*** haomaiwang has joined #openstack-swift22:01
*** garthb_ has quit IRC22:01
lcurtisnotmyname or onovy, all, is there a way to tell how many partitions might be left to move in a rebalance?22:05
lcurtisas in comparing ring against existing partitions22:06
*** rcernin has quit IRC22:10
torgomatic_lcurtis: when you say "a way", what sort of way are you talking about? I can tell you how to do it with Python code, but there's no support for this sort of thing in any of the existing command-line tools.22:15
lcurtistorgomatic..understood...22:15
lcurtisor maybe the logic behind how to do22:16
onovylcurtis: you can backup ring and call it with --force22:16
onovyif there is any change, i should wait another min_part_interval22:16
onovyit=ring-builder22:16
onovybut it's hack :)22:16
torgomatic_oh, good point... when you say "partitions left to move", do you mean partition assignments that move from one rebalance to the next, or do you mean partition directories that get moved from one host to another?22:17
lcurtisie, would i crawl partitions on a host and then compare against ring?22:17
torgomatic_I assumed the latter22:17
lcurtisthe latter22:17
onovyah22:18
onovyswift-dispersion-report?22:18
torgomatic_for that, you'd figure out what the local device is, query the ring for partitions with a replica on that device, and then compare that against a listdir of /srv/node/<disk>/objects22:20
torgomatic_or objects-N, depending on the policy index22:20
onovylcurtis: http://docs.openstack.org/developer/swift/admin_guide.html#cluster-health22:20
lcurtisyes okay...perfect...i really thank you guys for your help22:21
onovytorgomatic_: or call dispersion-populate before rebalance and then dispersion-report22:21
onovywhich do (almost) the same as you suggests22:21
torgomatic_onovy: that would probably work too :)22:21
onovybut without python code22:21
onovy:)22:21
lcurtisyou all are life-savers22:22
onovybut to be sure, use 100% coverage22:22
lcurtisthank you22:22
*** daemontool has quit IRC22:22
onovynp22:22
onovygood night22:22
lcurtisgood night onovy22:23
*** daemontool has joined #openstack-swift22:23
dimasotlcurtis: I have some come that creates a mapping between the old and new ring -> so you can get from it how manny partitions should be moved22:32
dimasothttps://github.com/DmitrySot/data_mover22:32
lcurtisdimasot: Thanks!!!22:33
*** mingdang1 has joined #openstack-swift22:34
*** diazjf has quit IRC22:36
dimasotlcurtis: by th eway why you need this info?22:36
dimasotis clayg here?22:38
lcurtisdimasot: going through large rebalance now and trying to figure out when it will finish22:40
*** petertr7 is now known as petertr7_away22:41
*** bsdkurt has joined #openstack-swift22:49
*** minwoob_ has quit IRC22:50
*** bsdkurt has left #openstack-swift22:52
*** bsdkurt has joined #openstack-swift22:52
*** andrew__ has quit IRC22:54
*** badari has quit IRC22:58
*** haomaiwang has quit IRC23:01
*** haomaiwang has joined #openstack-swift23:01
*** bjkeller has left #openstack-swift23:03
*** zhill has quit IRC23:04
*** barker has joined #openstack-swift23:08
*** zhill has joined #openstack-swift23:18
*** km__ has joined #openstack-swift23:20
*** barker has quit IRC23:21
*** nadeem has quit IRC23:23
*** dimasot has quit IRC23:24
*** mingdang1 has quit IRC23:35
*** lcurtis has quit IRC23:38
*** chlong-afk has quit IRC23:40
*** mragupat_ has quit IRC23:41
*** diogogmt has quit IRC23:49
*** blmartin has quit IRC23:51
*** mrmoje has quit IRC23:56
*** ho has joined #openstack-swift23:56
*** ho is now known as Guest1399823:57
*** Guest13998 is now known as ho_23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!