Thursday, 2017-06-15

*** vint_bra has joined #openstack-swift00:05
*** itlinux_ has joined #openstack-swift00:26
*** itlinux_ has quit IRC00:32
*** zhurong has joined #openstack-swift00:39
*** vint_bra has quit IRC00:54
*** tovin07_ has joined #openstack-swift00:59
*** klrmn has quit IRC01:05
*** zhengyin has joined #openstack-swift01:10
*** lucasxu has joined #openstack-swift01:19
*** lucasxu has quit IRC01:21
openstackgerritLingxian Kong proposed openstack/swift master: Write-affinity aware object deletion  https://review.openstack.org/47015801:29
*** bkopilov has quit IRC01:32
*** vint_bra has joined #openstack-swift02:13
tdasilvamattoliverau, clayg: changing the IP worked for me02:15
clayg🎉02:16
*** klrmn has joined #openstack-swift02:18
tdasilvavagrant halt02:29
* tdasilva is falling asleep02:30
*** vint_bra has quit IRC02:46
*** bkopilov has joined #openstack-swift02:49
*** vinsh has quit IRC03:05
*** itlinux_ has joined #openstack-swift03:10
*** catintheroof has joined #openstack-swift03:15
mattoliverautdasilva: nice, so that's it then :) maybe the makerings should use 127.0.0.* in the SAIO docs then03:16
mattoliverauOr remakerings03:16
*** sanchitmalhotra has quit IRC03:19
*** kei_yama has quit IRC03:35
*** catintheroof has quit IRC03:47
*** kei_yama has joined #openstack-swift03:48
mahaticgood morning03:53
mahaticnotmyname: thanks for the info on UpgradeImpact flag (yup acoles said the same :)03:57
notmynamemahatic: I think timburke is the one who had the real help ;-)03:58
mahaticnotmyname: hehe, sure03:58
*** klrmn has quit IRC04:03
*** tonanhngo has joined #openstack-swift04:15
*** gkadam has joined #openstack-swift04:21
*** psachin has joined #openstack-swift04:22
*** zhurong has quit IRC04:28
*** tonanhngo has quit IRC04:37
*** zhurong has joined #openstack-swift04:40
*** tonanhngo has joined #openstack-swift04:41
*** itlinux_ has quit IRC04:44
*** aselius has quit IRC04:45
*** tonanhngo_ has joined #openstack-swift04:56
*** tonanhngo has quit IRC04:59
*** jaosorior has quit IRC05:00
mattoliveraumahatic: morning05:01
mahaticmattoliverau: o/05:02
*** tonanhngo_ has quit IRC05:17
openstackgerritM V P Nitesh proposed openstack/swift master: Fix doc generation for Python3  https://review.openstack.org/45722005:17
*** tonanhngo has joined #openstack-swift05:18
*** tonanhngo has quit IRC05:23
*** skudlik has joined #openstack-swift05:29
*** gyee has quit IRC05:39
*** abhitechie has joined #openstack-swift05:42
*** cshastri has joined #openstack-swift05:43
*** silor has joined #openstack-swift06:02
*** ChubYann has quit IRC06:03
*** rcernin has quit IRC06:11
*** tonanhngo has joined #openstack-swift06:28
*** rcernin has joined #openstack-swift06:37
*** tesseract has joined #openstack-swift06:43
*** silor has quit IRC06:44
*** silor has joined #openstack-swift06:45
*** pcaruana has joined #openstack-swift06:58
*** aselius has joined #openstack-swift07:08
*** jaosorior has joined #openstack-swift07:12
*** tonanhngo has quit IRC07:23
*** abhitechie has quit IRC07:33
*** hoonetorg has joined #openstack-swift07:34
*** abhitechie has joined #openstack-swift07:34
*** geaaru has joined #openstack-swift07:41
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Eliminate node_index in Putter  https://review.openstack.org/44307207:43
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Prepare iter_nodes_local_fist able to take parimary nodes in args  https://review.openstack.org/47447207:43
*** gkadam is now known as gkadam-brb07:48
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Eliminate node_index in Putter  https://review.openstack.org/44307207:58
*** hseipp has joined #openstack-swift08:04
*** dosaboy has quit IRC08:11
*** dosaboy has joined #openstack-swift08:19
*** oshritf_ has joined #openstack-swift08:32
*** psachin has quit IRC08:40
*** psachin has joined #openstack-swift08:41
*** psachin has quit IRC08:43
*** psachin has joined #openstack-swift08:43
*** zhengyin has quit IRC08:48
*** zhengyin has joined #openstack-swift08:48
*** dosaboy has quit IRC08:50
*** abhitechie has quit IRC08:51
*** dosaboy has joined #openstack-swift08:51
*** dosaboy has quit IRC08:53
openstackgerritVan Hung Pham proposed openstack/swift master: Add 'rm -f .testrepository/times.dbm' command in testenv  https://review.openstack.org/47450109:03
*** dosaboy has joined #openstack-swift09:08
*** silor has quit IRC09:16
*** aselius has quit IRC09:18
*** hseipp has quit IRC09:26
*** psachin has quit IRC09:29
*** ujjain has joined #openstack-swift09:30
*** ujjain has joined #openstack-swift09:30
*** kei_yama has quit IRC09:36
*** abhitechie has joined #openstack-swift09:43
*** abhinavtechie has joined #openstack-swift09:45
*** abhitechie has quit IRC09:47
*** abhitechie has joined #openstack-swift09:47
*** abhinavtechie has quit IRC09:47
*** d0ugal has quit IRC09:48
*** d0ugal has joined #openstack-swift09:49
*** abhitechie has quit IRC09:50
*** abhitechie has joined #openstack-swift09:50
*** mvk has quit IRC09:54
*** tovin07_ has quit IRC09:58
*** abhitechie has quit IRC09:59
*** abhitechie has joined #openstack-swift09:59
*** mvk has joined #openstack-swift10:23
*** abhitechie has quit IRC10:34
*** abhitechie has joined #openstack-swift10:45
*** gkadam-brb is now known as gkadam11:00
*** torgomatic has quit IRC11:01
*** bkopilov has quit IRC11:02
*** chlong has joined #openstack-swift11:31
*** bkopilov has joined #openstack-swift12:24
*** zhurong has quit IRC12:26
*** zhurong has joined #openstack-swift12:28
openstackgerritjunbo.li proposed openstack/swift master: Using assertIsNone instead of assertEqual(None)  https://review.openstack.org/47456212:32
*** vinsh has joined #openstack-swift12:32
*** zhurong has quit IRC12:36
*** zhengyin has quit IRC12:41
*** oshritf_ has quit IRC12:52
*** oshritf_ has joined #openstack-swift12:56
*** catintheroof has joined #openstack-swift13:07
*** catinthe_ has joined #openstack-swift13:21
*** hseipp has joined #openstack-swift13:21
*** catintheroof has quit IRC13:24
*** catintheroof has joined #openstack-swift13:25
*** catinthe_ has quit IRC13:25
*** catinthe_ has joined #openstack-swift13:26
*** catinth__ has joined #openstack-swift13:26
*** catintheroof has quit IRC13:26
*** lucasxu has joined #openstack-swift13:26
*** klamath has joined #openstack-swift13:29
*** klamath has joined #openstack-swift13:29
*** catintheroof has joined #openstack-swift13:29
*** catinthe_ has quit IRC13:30
*** mariusv has quit IRC13:30
*** catinth__ has quit IRC13:33
*** dancn has quit IRC13:33
*** silor has joined #openstack-swift13:49
*** zhurong has joined #openstack-swift13:50
*** vinsh has quit IRC13:50
*** abhitechie has quit IRC13:53
*** jistr is now known as jistr|mtg13:59
*** tonanhngo has joined #openstack-swift14:11
*** tonanhngo has quit IRC14:15
*** zhurong has quit IRC14:22
*** aselius has joined #openstack-swift14:29
*** silor1 has joined #openstack-swift14:41
*** silor has quit IRC14:44
*** silor1 is now known as silor14:44
*** vinsh has joined #openstack-swift14:45
*** silor1 has joined #openstack-swift14:49
*** cshastri has quit IRC14:51
*** silor has quit IRC14:52
*** silor1 is now known as silor14:52
*** jistr|mtg is now known as jistr14:59
*** MVenesio has joined #openstack-swift15:01
*** skudlik has quit IRC15:02
*** gkadam has quit IRC15:04
*** mvk has quit IRC15:05
*** rcernin has quit IRC15:09
*** gyee has joined #openstack-swift15:10
*** oshritf_ has quit IRC15:15
*** silor1 has joined #openstack-swift15:18
*** silor has quit IRC15:22
*** silor1 is now known as silor15:22
*** silor1 has joined #openstack-swift15:27
*** silor has quit IRC15:29
*** silor1 is now known as silor15:29
*** vint_bra has joined #openstack-swift15:31
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient master: Updated from global requirements  https://review.openstack.org/8925015:34
*** silor1 has joined #openstack-swift15:34
*** silor has quit IRC15:35
*** silor1 is now known as silor15:35
*** rcernin has joined #openstack-swift15:44
*** cshastri has joined #openstack-swift15:45
*** rcernin has quit IRC16:12
*** MVenesio has quit IRC16:16
*** itlinux has joined #openstack-swift16:26
*** MVenesio has joined #openstack-swift16:31
*** silor has quit IRC16:34
*** silor has joined #openstack-swift16:41
timurtimburke: I wrote up a patch to do a streaming upload from stdin using SwiftService and then bumped into a comment in service.py on 1903, where the stream uploads are never uploaded as an SLO. I'm thinking of doing this change in two steps: the patch to do stdin single object uploads and then a follow on change to not use SwiftService for the upload and do the SLO part ourselves16:44
*** silor has quit IRC16:45
*** tesseract has quit IRC16:46
*** chsc has joined #openstack-swift16:52
*** chsc has joined #openstack-swift16:52
*** MVenesio has quit IRC16:56
*** klrmn has joined #openstack-swift17:05
timburketimur: " do the SLO part ourselves" -> start using the client.py API from shell.py? hmm... maybe?17:09
timburkemaybe we could plumb in some "no, seriously, i know I have a stream but i *want an SLO*" param? idk, to the extent that i've thought much about it, that was a while ago, so you've probably got more of the details loaded into your head than me17:09
timurtimburke: right, using the client.py API in shell.py. I can look into the override of the service.py thing, but I think it'd be a little tricky -- I'll try to see how much of a change it would be, although the fact that it's a filesystem path seems to be a baked in assumption passed that check17:13
*** pcaruana has quit IRC17:16
timburkeah...hmm... yeah, might be more trouble than it's worth then. i mean, the big problem (as i see it) is that service really wants to open multiple readers so it can do parallel uploads, which just isn't going to work for stdin. client from shell may well be easier17:18
*** hseipp has quit IRC17:25
*** cshastri has quit IRC17:35
*** geaaru has quit IRC17:41
*** ChubYann has joined #openstack-swift17:56
timurtimburke: I also noticed that swiftclient doesn't remove segments on error during an SLO upload. That seems like a desirable behavior?17:56
timur(cleaning them up, that is)17:56
timburketimur: agreed -- see also, bug 152701717:57
openstackbug 1527017 in python-swiftclient "Segment upload failures should abort other segment jobs" [Medium,Confirmed] https://launchpad.net/bugs/1527017 - Assigned to Joel Wright (joel-wright-k)17:57
timuroh, good pointer17:57
timburke(slightly different bad behavior, but certainly related)17:58
*** skudlik has joined #openstack-swift17:58
timurright17:58
notmynamegood morning17:58
*** cshastri has joined #openstack-swift18:02
*** mvk has joined #openstack-swift18:03
*** MVenesio has joined #openstack-swift18:17
*** mwheckmann has joined #openstack-swift18:27
mwheckmannhello everyone. Simple questions: Are there any precautions or know caveats when using 512e advanced format drives with Swift?18:28
mwheckmannknown caveats I meant18:28
notmynamemwheckmann: emulated 512b sector sizes?18:29
notmynameI'm not sure what "advance format" means in this case18:29
notmyname*advanced18:29
mwheckmannyes. exactly. 4kiB native on platter, but 512 logical18:29
notmynamemwheckmann: I've seen issues where a misalignment of physical and logical sector size (not account for in firmware) has caused issues (ie very slow performance) because most reads/writes werent' aligned properly18:30
notmynamemwheckmann: but if the drive firmware is handling that, it shouldn't be a problem18:30
notmynamemwheckmann: or more generally, there's nothing in swift that cares. it's more of a question of the XFS you put on it18:31
notmynamethat is, swift isn't doing direct IO or anything like that which would require certain buffer sizes aligned a certain way18:31
mwheckmannnotmyname: so if partition alignment is good, which frankly it should be on any modern distro, we're less likely to encounter issues?18:31
notmynamehowever, I have also seen performance improvements when the buffer sizes line up all the way from the client to the network to the drives18:32
mwheckmannok.18:32
notmynamemwheckmann: I wouldn't expect you to see any issues when using emulated sector sizes. please do your due diligence of testing first, of course :-)18:32
mwheckmannI'm asking because I noticed that TripleO have validations tests to ensure that you are *not* using 512e due to problems uploading Glance images. There are no other explanations given however. It's seems really odd.18:33
notmynameI think it would depend on how the emulation is working. is the drive managing some table of virtual sub-sectors? how is it handling writes of less than 4k?18:34
notmynamemwheckmann: that does sound really odd18:34
mwheckmannhttps://github.com/openstack/tripleo-validations/commit/2e1a198c6b5b39cc8dddcc7097696e9e0b22b00e18:34
*** cshastri has quit IRC18:34
mwheckmannI guess I should take it up with them. We don't use TripleO, but it got me scared for Swift. We do have some 512e drives in prod on Swift and I haven't noticed any particular issues.18:35
notmynamecschwede does some tripleO stuff. I wonder if he knows anything about that18:36
clarkbalso they may not use swift to back glance18:36
clarkbso could be related to something else entirely?18:36
mwheckmannagreed, but it still got me scared.18:37
tdasilvaclarkb: i believe swift the default backend for glance in tripleo, unless they are deploying ceph18:38
notmynamemwheckmann: for a fuller picture, I'd strongly recommend that swift not be deployed on SMR drives (commonly marketed as "archive" drives). not because things "break" so much as everything just gets really really slow18:39
notmynameso while there aren't any restrictions per-se in swift as to what kind of drives you can use, there are certainly ways that the cluster is impacted based on the drives18:40
notmynamebut I don't think that 512/4096/512e matters18:40
mwheckmannnotmyname: I'll be watchful for SMR drives. Thanks for the heads up and the tips as usual.18:52
mwheckmannIf I get more info from the tripleo team, I'll share it here.18:52
*** catinthe_ has joined #openstack-swift19:07
*** jaosorior is now known as jaosorior_away19:08
*** Renich has joined #openstack-swift19:10
*** lucasxu has quit IRC19:10
*** catintheroof has quit IRC19:11
*** lucasxu has joined #openstack-swift19:11
*** catintheroof has joined #openstack-swift19:22
*** catinthe_ has quit IRC19:25
*** Sukhdev has joined #openstack-swift19:26
*** vinsh has quit IRC19:36
*** MVenesio has quit IRC19:48
*** itlinux has quit IRC19:59
*** itlinux has joined #openstack-swift20:12
*** joeljwright has joined #openstack-swift20:12
*** ChanServ sets mode: +v joeljwright20:12
openstackgerritRomain LE DISEZ proposed openstack/swift master: Fix a socket leak in copy middleware  https://review.openstack.org/47476720:14
*** joeljwright has quit IRC20:15
openstackgerritRomain LE DISEZ proposed openstack/swift master: Fix a socket leak in copy middleware  https://review.openstack.org/47476720:54
*** lucasxu has quit IRC20:55
*** klamath has quit IRC21:01
openstackgerritTim Burke proposed openstack/swift master: Close all versioned_writes subrequests' app_iters  https://review.openstack.org/30793721:03
timburkerledisez: thanks for using self.app.unclosed_requests! i was looking for a way to test ^^ -- part of why i never got around to following up on it21:04
timburkeTIL21:05
*** catinthe_ has joined #openstack-swift21:06
rlediseztimburke: lots of new close() in versioned_writes now :)21:06
rledisezi didn't check who wrote this helper first, but this is brilliant!21:06
timburkeso much closing! it'll be great21:06
*** skudlik has quit IRC21:07
*** catintheroof has quit IRC21:09
*** catinthe_ has quit IRC21:28
openstackgerritTim Burke proposed openstack/swift master: Close all versioned_writes subrequests' app_iters  https://review.openstack.org/30793721:34
*** vinsh has joined #openstack-swift21:51
openstackgerritTim Burke proposed openstack/swift master: Add support to increase object ring partition power  https://review.openstack.org/33729722:11
*** SkyRocknRoll has joined #openstack-swift22:51
*** itlinux has quit IRC23:00
*** itlinux_ has joined #openstack-swift23:09
*** hoonetorg has quit IRC23:10
openstackgerritTim Burke proposed openstack/swift master: Ignore all auditor_status_*.json files in reconstructor  https://review.openstack.org/47480123:10
*** itlinux_ has quit IRC23:10

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!