Monday, 2015-04-27

*** dmorita has joined #openstack-swift00:29
*** haigang has joined #openstack-swift00:56
*** sandywalsh has joined #openstack-swift01:15
*** Trozz_ has quit IRC01:16
*** Trozz has joined #openstack-swift01:17
*** haigang has quit IRC01:18
*** sandywalsh_ has quit IRC01:19
*** imkarrer has joined #openstack-swift01:26
*** imkarrer_ has quit IRC01:28
*** imkarrer_ has joined #openstack-swift01:37
*** haigang has joined #openstack-swift01:38
*** haigang has quit IRC01:40
*** haigang has joined #openstack-swift01:41
*** imkarrer has quit IRC01:41
*** imkarrer_ has quit IRC01:42
*** haigang has quit IRC01:49
*** haigang has joined #openstack-swift01:53
*** asettle is now known as asettle-afk02:02
*** breitz has quit IRC02:05
*** breitz has joined #openstack-swift02:05
*** haigang has quit IRC02:56
*** haigang has joined #openstack-swift02:57
*** asettle-afk is now known as asettle02:59
mattoliverauWow, quiet channel today.03:00
notmynamehello mandarin103:12
notmynamemattoliverau:03:12
notmynametab-complete fail.03:12
mattoliveraunotmyname: hey man, having a good weekend?03:23
notmynamemeh. been fighting a cold or something03:24
mattoliveraunotmyname: :( I guesss that happens to us all, even PTLs03:25
*** sudorando has quit IRC03:48
*** sudorandom has joined #openstack-swift03:50
notmynamewheee...setting up EC tests and reviewing content for a book. fun sunday night04:10
mattoliveraunotmyname: sounds like it :) I've submitted a patch to add EC support to os-ansible-deployment, next is to trick rackspace private cloud to test it in the lab so I'll have a bigger test cluster to test EC with ;)04:14
*** kota_ has joined #openstack-swift04:47
*** SkyRocknRoll has joined #openstack-swift05:06
*** Trozz has quit IRC05:11
*** Trozz has joined #openstack-swift05:12
*** ppai has joined #openstack-swift05:28
*** ppai has quit IRC05:33
*** wolsen_ is now known as wolsen05:33
*** proteusguy has quit IRC05:40
*** early` has quit IRC05:44
*** bkopilov has quit IRC05:44
*** early has joined #openstack-swift05:47
*** remix_auei has joined #openstack-swift05:53
*** remix_tj has quit IRC05:56
*** silor has joined #openstack-swift05:59
*** ktsuyuzaki has joined #openstack-swift06:03
*** bkopilov has joined #openstack-swift06:03
*** kota_ has quit IRC06:04
*** zul has joined #openstack-swift06:11
*** haomaiwang has quit IRC06:16
*** haigang has quit IRC06:21
*** zul has quit IRC06:40
*** foexle has quit IRC06:40
*** haomaiwa_ has joined #openstack-swift06:51
*** haomaiw__ has joined #openstack-swift06:54
*** haomaiwa_ has quit IRC06:54
*** Bsony has joined #openstack-swift06:56
*** haomaiwa_ has joined #openstack-swift06:59
*** haomaiw__ has quit IRC07:02
*** CrackerJackMack has quit IRC07:15
*** joeljwright has joined #openstack-swift07:16
*** CrackerJackMack has joined #openstack-swift07:18
*** krykowski has joined #openstack-swift07:24
*** mmcardle has joined #openstack-swift07:26
*** Bsony has quit IRC07:46
*** geaaru has joined #openstack-swift07:47
*** SkyRocknRoll has quit IRC07:57
*** jistr has joined #openstack-swift07:57
*** zul has joined #openstack-swift08:00
*** SkyRocknRoll has joined #openstack-swift08:05
*** openstackstatus has joined #openstack-swift08:07
*** ChanServ sets mode: +v openstackstatus08:07
*** CrackerJackMack has quit IRC08:08
*** zul has quit IRC08:08
-openstackstatus- NOTICE: Restarting gerrit because it stopped sending events (ETA 15 mins)08:10
*** CrackerJackMack has joined #openstack-swift08:11
*** jordanP has joined #openstack-swift08:12
*** openstackgerrit has quit IRC08:13
*** acoles_away is now known as acoles08:16
*** openstackgerrit has joined #openstack-swift08:16
openstackgerritAlistair Coles proposed openstack/swift: WIP - working on the encryption feature.  https://review.openstack.org/15790708:19
*** zul has joined #openstack-swift08:38
*** zul has quit IRC08:41
*** zul has joined #openstack-swift08:41
*** aix has joined #openstack-swift08:58
*** fanyaohong has joined #openstack-swift09:22
*** zul has quit IRC09:30
*** zul has joined #openstack-swift09:33
*** mandarin1 is now known as mandarine09:39
*** foexle has joined #openstack-swift09:43
*** haomaiwa_ has quit IRC10:31
*** zul has quit IRC10:41
*** ujjain- has quit IRC10:52
*** ujjain- has joined #openstack-swift10:52
*** Anticimex has quit IRC11:13
*** a1|away is now known as AbyssOne__11:22
*** zul has joined #openstack-swift11:32
*** dencaval has joined #openstack-swift11:36
*** chmouel has quit IRC11:48
*** dmorita has quit IRC11:49
*** chmouel has joined #openstack-swift11:50
*** chmouel_ has joined #openstack-swift11:57
*** chmouel has quit IRC11:57
*** sileht has quit IRC11:59
openstackgerritKota Tsuyuzaki proposed openstack/swift: Don't show the query string for inner usage  https://review.openstack.org/17713212:00
*** krykowski has quit IRC12:02
*** krykowski has joined #openstack-swift12:03
*** krykowski has quit IRC12:05
*** krykowski has joined #openstack-swift12:05
*** proteusguy has joined #openstack-swift12:05
*** openstackgerrit has quit IRC12:06
*** openstackgerrit has joined #openstack-swift12:06
*** sileht has joined #openstack-swift12:09
*** fanyaohong has quit IRC12:09
*** haomaiwang has joined #openstack-swift12:13
*** kei_yama has quit IRC12:13
*** km has quit IRC12:14
*** esker has quit IRC12:15
*** SkyRocknRoll has quit IRC12:20
*** chmouel_ is now known as chmouel12:33
*** SkyRocknRoll has joined #openstack-swift12:33
*** openstackgerrit has quit IRC12:37
*** openstackgerrit has joined #openstack-swift12:37
*** SkyRocknRoll has quit IRC12:50
*** sileht has quit IRC12:52
*** Anticimex has joined #openstack-swift13:00
*** Guest__ has joined #openstack-swift13:04
*** openstackgerrit has quit IRC13:21
*** openstackgerrit has joined #openstack-swift13:22
*** esker has joined #openstack-swift13:22
*** krykowski has quit IRC13:29
*** sileht has joined #openstack-swift13:32
*** krykowski has joined #openstack-swift13:38
*** morganfainberg has quit IRC13:44
*** jroll has quit IRC13:44
*** jroll has joined #openstack-swift13:44
*** xianghui has quit IRC13:45
*** xianghui has joined #openstack-swift13:46
*** morganfainberg has joined #openstack-swift13:47
-openstackstatus- NOTICE: gerrit has been restarted to clear a problem with its event stream. change events between 13:09 and 13:36 utc should be rechecked or have approval votes reapplied as needed to trigger jobs13:47
*** mahatic has joined #openstack-swift13:48
*** vishy has quit IRC13:55
*** vishy has joined #openstack-swift13:58
*** themadcanudist has joined #openstack-swift14:02
themadcanudistHey guys, what causes container.dbs to grow? I assume the more entries for objects in there the larger it will be. I have one that's a couple gig in size and it seems to be causing lock timeouts a lot14:03
themadcanudistand is there any way to split/compact these?14:04
*** NM has joined #openstack-swift14:06
*** mahatic has quit IRC14:16
*** thumpba has joined #openstack-swift14:18
ctennisthemadcanudist: any idea how many objects are in the container?14:18
themadcanudisthow can i resolve container -> account based on filesystem hash of the container.db in question14:19
themadcanudisti can find that number out quick if I can do that14:19
glangethemadcanudist: do you delete a lot of objects from that container?14:19
themadcanudistglange: likely14:19
*** mahatic has joined #openstack-swift14:19
themadcanudisti don't, it's another user, but i know there app behaviour14:19
glangehttp://sqlite.org/lang_vacuum.html <-- maybe it's not getting vacuumed14:20
*** vinsh_ has quit IRC14:20
*** thumpba has quit IRC14:23
hurricanerixmorning14:26
*** jrichli has joined #openstack-swift14:28
themadcanudistglange: shouldn't swift automatically take care of the vacuuming, etc?14:28
glangeI don't think auto_vacuum is on for container db's and I can't find the word "vacuum" anywhere in the code base14:32
glangehttp://www.sqlite.org/faq.html <-- look at 12 -- the free space is reused on the next insert, but say you insert way fewer objects than you've deleted, you'll still have that extra space hanging around14:33
glangeif you copy your db somewhere and run vacuum on it, you can see if this is what you are seeing -- just check the size of the file after vacuuming14:34
themadcanudistyep14:35
themadcanudistglange: can you tell me how to find out what account a container.db belongs to?14:35
*** vinsh has joined #openstack-swift14:40
glangedo sqlite3 cont.db14:40
glangeand then select account from container_info;14:40
themadcanudistah brilliant =)14:40
themadcanudistthx14:40
glangenp14:41
*** foexle has quit IRC14:41
*** krykowski has quit IRC14:48
*** proteusguy has quit IRC14:48
*** Guest__ has quit IRC14:48
*** Guest__ has joined #openstack-swift14:50
*** annegentle has joined #openstack-swift14:51
*** zul has quit IRC14:59
*** marcusvrn_ has joined #openstack-swift14:59
*** zul has joined #openstack-swift14:59
*** Guest__ has quit IRC15:04
*** breitz has quit IRC15:04
*** Guest__ has joined #openstack-swift15:05
*** breitz has joined #openstack-swift15:05
*** proteusguy has joined #openstack-swift15:07
*** aix has quit IRC15:09
*** annegentle has quit IRC15:12
*** timburke_ is now known as timburke15:14
*** minwoob has joined #openstack-swift15:27
*** foexle has joined #openstack-swift15:37
*** thumpba has joined #openstack-swift15:40
*** pberis has joined #openstack-swift15:41
*** jroll has quit IRC15:44
*** jroll has joined #openstack-swift15:46
*** Guest__ has quit IRC15:48
*** thumpba has quit IRC15:49
*** Guest__ has joined #openstack-swift15:50
*** bkopilov has quit IRC15:52
openstackgerritAlistair Coles proposed openstack/swift: WIP Revert to another handoff when primary is unavailable  https://review.openstack.org/17640315:52
openstackgerritAlistair Coles proposed openstack/swift: Make SSYNC receiver return 5xx when initial checks fail  https://review.openstack.org/17783615:52
openstackgerritAlistair Coles proposed openstack/swift: Remove _ensure_flush() from SSYNC receiver  https://review.openstack.org/17783715:52
*** jroll has quit IRC15:53
*** jroll has joined #openstack-swift15:53
acolesdfg: if you have chance could you take a quick look at that review 177837 ^^ ? - i saw you did the eventlet patch for minimum_write_chunk_size so I'm guessing you know that ssync code better than me15:55
*** gyee has joined #openstack-swift15:55
*** acoles is now known as acoles_away15:57
*** bkopilov has joined #openstack-swift15:58
*** jordanP has quit IRC15:59
*** david-ly_ is now known as david-lyle16:01
*** Guest__ has quit IRC16:02
dfg_acoles_away: i actually added that for bulk requests because eventlet buffers stuff and the white spaces that bulk requsts yields to keep the connection alive wouldn't get through otherwise16:04
themadcanudistctennis: glange: # of objects in container is 8.5 million, the vacuum didn't do much, trimmed 70 megs from 2.2G, so it's efficient16:07
themadcanudistI'm thinking of putting the container ring on SSD only, that should allow me to scale significantly more, right?16:07
ctennisthemadcanudist: we generally recommend only about 1 million objects in a contaienr unless your container DB is backed by an SSD16:07
ctennisyes exactly16:07
themadcanudistwhat's teh recommended upper limit for SSD?16:07
ctennisin the 10ish million range16:07
ctennisit depends on how frequently you do PUTs or DELETEs16:08
themadcanudistaye16:08
ctennisor you can shard any use multiple containers16:09
themadcanudistyeah, we'd need to do this behind the scenes16:12
themadcanudistIs there any fix in future versions of swift to do internal sharding?16:13
notmynamegood morning16:13
*** zul has quit IRC16:16
ctennisthemadcanudist: it's something that will probably be looked at again once the erasure code features are done, later this year perhaps16:17
notmynamethemadcanudist: yup. see mattoliverau's work at https://review.openstack.org/#/c/139921/ (/cc ctennis)16:18
*** jistr has quit IRC16:21
mattoliverauI've been working on sharding a lot since EC release. I hope to have a POC very soon.. And I really need to update that spec. But first... Back to sleep ;)16:26
notmynameI'm thinking mattoliverau must have his alarm tied to IRC notifications16:52
notmynamein which case, I should stop using mattoliverau's nick so that his IRC client doesn't keep beeing16:52
notmyname*beeping16:53
notmynamemattoliverau would probably appreciate that16:53
*** Guest___ has joined #openstack-swift16:56
mattoliverauLol, may have to disconnect my phone from my irc forwarder, while sleeping ;)16:57
*** erlon has joined #openstack-swift16:58
*** Guest___ has quit IRC16:59
*** Guest___ has joined #openstack-swift16:59
*** foexle has quit IRC17:01
themadcanudist=D17:03
*** logan2 has quit IRC17:05
*** Guest___ has quit IRC17:07
*** mahatic has quit IRC17:08
*** mahatic has joined #openstack-swift17:10
*** Guest__ has joined #openstack-swift17:12
*** EmilienM is now known as EmilienM|afk17:17
*** zhill has joined #openstack-swift17:40
*** marcusvrn_ has quit IRC17:49
*** zaitcev has joined #openstack-swift17:54
*** ChanServ sets mode: +v zaitcev17:54
*** peluse has joined #openstack-swift18:03
*** ChanServ sets mode: +v peluse18:03
notmynameI just got the shipments of swift shirts for the summit18:03
notmynamethye look good18:03
pelusehey, good morning/afternoonish18:03
notmynamehello18:04
*** EmilienM|afk is now known as EmilienM18:06
*** cdelatte has joined #openstack-swift18:07
jrichlinotmyname: do we get to hear what's on them now, or is it a surprise?18:12
notmynamehttp://d.not.mn/vancouver_T_shirt_mockup.png18:15
*** geaaru has quit IRC18:24
*** bkopilov has quit IRC18:25
pelusesweet18:25
*** bkopilov has joined #openstack-swift18:26
jrichlicool!  I will take a small red ;-)18:28
*** jlk has joined #openstack-swift18:31
jlkHey all, I need some help figuring out why swift-proxy is 401ing my tempurl requests. These requests are being generated by tempest. I'm seeing the 401 in the swift-proxy logs but not really any reason behind the 401, and I could really use some help.18:32
notmynamejlk: how are you generating the tempurl?18:33
jlknotmyname: tempest is doing it, I"d have to read up on that I suppose18:34
*** thumpba has joined #openstack-swift18:34
jlkhttps://github.com/openstack/tempest/blob/master/tempest/api/object_storage/test_object_temp_url.py#L7818:34
*** thumpba has quit IRC18:39
jlknotmyname: looks like tempest sets metadata for the temp url key, and then uses that key to construct a temp url to post to, and attempts the post18:41
notmynamejlk: that looks correct18:41
jlkswift logs show a 401 on that post, without reason.18:41
jlkswift-proxy logs that is18:41
jlkthe tempest client does get this back in the body:18:42
jlkDetails: 401 Unauthorized: Temp URL invalid18:42
*** themadcanudist has left #openstack-swift18:42
notmynamejlk: which test is failing?18:43
jlkhttps://github.com/openstack/tempest/blob/master/tempest/api/object_storage/test_object_temp_url.py#L14318:43
jlkput_object_using_temp_url18:44
jlkget_object_using_temp_url fails too18:44
jlkwhich is https://github.com/openstack/tempest/blob/master/tempest/api/object_storage/test_object_temp_url.py#L9818:45
jlkI can see in the swift proxy logs the object it's trying to get is created18:46
jlkbefore the attempt to get it18:46
claygmorning18:46
pelusehey what up man?18:47
*** cdelatte has quit IRC18:49
*** cdelatte has joined #openstack-swift18:49
glangeclayg: nice video on EC :)19:04
*** proteusguy has quit IRC19:04
notmynamejlk: since _get_expiry_date() is returning something 1000 seconds in the future, I wouldn't think that would be the problem, but time issues are possible19:05
notmynamejlk: check to make sure the local clock is the same as the clock for swift19:06
jlknotmyname: yeah, I just ntp synced both of them. They're within tiny seconds of each other19:06
notmynamejlk: next is to check that the account tempurl key is set to the value you expect19:07
jlkthat may be... interesting. The key gets created as set up for the test, and then deleted after the test is done19:07
notmynamewell the setUp() seems to check that it's there19:08
notmynamebut I don't know the order of resource_setup and resource_cleanup (when they are called)19:08
jlksetup at first, cleanup when existing19:09
notmynamejlk: do you also see failures for the tempurl2 tests? are you seeing errors for every test that's run here?19:10
jlkI don't think the second one ever runs19:10
jlkthe only ones that run are the GET and the PUT19:10
notmynamejlk: is this a new test? or has it been there and just now started failing?19:12
jlkwell, it's a new cluster, and I"ve never seen this test pass in this cluster, but it could absolutely be something wrong with my cluster19:12
jlkthis test passes in the gate I think19:12
notmynamehmmm19:12
notmynameany chance you have odd things in the URL path? I'm comparing it to https://github.com/openstack/swift/blob/master/test/functional/tests.py#L269319:14
*** proteusguy has joined #openstack-swift19:17
notmynamejlk: I've got to step away for an appointment19:19
jlkalright, thanks for the help so far19:19
notmynamejlk: I'm hoping you can make some progress, or maybe someone else can help19:19
*** ChanServ sets mode: +v torgomatic19:21
*** annegentle has joined #openstack-swift19:27
*** remix_auei has quit IRC19:31
*** remix_tj has joined #openstack-swift19:31
*** remix_tj has quit IRC19:35
*** remix_tj has joined #openstack-swift19:36
MooingLemurhow does object-expirer use memcache?  What does it store/retrieve?19:45
*** geaaru has joined #openstack-swift19:47
*** Guest__ has quit IRC19:55
*** silor has quit IRC19:57
*** dencaval has quit IRC20:01
*** Guest__ has joined #openstack-swift20:05
claygMooingLemur: just normal account/container existance check stuff20:06
MooingLemurclayg: Separate question: I'm not breaking anything by having separate memcache pools for different groups of proxies, right?  Since the Swift cache code appears to only support IPv4 but the proxies are only globally reachable to each other on IPv6, I can in theory point each proxy to its own memcache and things will still work as expected, albeit less efficiently.20:10
MooingLemurConsidering I've been running this way for quite some time, I suspect it's not detrimental :P  But I just want to make sure I understand the ramifications.20:12
claygheh - are you using keystone or some other authoritive backing auth store?20:13
MooingLemurswauth20:13
claygyeah you're fine :)   seperate memcache pools for proxies will work fine in that case20:14
claygat least... I also am not aware of any issues with that topology20:14
MooingLemurI think swauth actually PUTs tokens as objects20:15
MooingLemurwith X-Delete-At20:15
claygMooingLemur: that's true about how swauth stores tokens - yes20:15
swifterdarrellkudos to python-swiftclient for auto-creating the *_segments container in the same SP as the manifest for DLO uploads!20:32
*** mahatic has quit IRC20:35
*** annegentle has quit IRC20:36
notmynameclayg: MooingLemur: there is one possibility of a pathological case where separate memcache pools are bad20:55
notmynameif you have a load balancer in front of 2 proxies. auth to proxy A, get token. request with token to proxy B. proxy B returns 401, so you reauth to proxy A. repeat20:56
claygnotmyname: well that's why an authoritive backing store for the auth request is a win20:56
claygnotmyname: in swauth's case the token will be stored in swift - so even if it's not in proxy B's memcache pool - it will fall back to asking swift - then set it in the memcache pool for the next guy20:57
claygnotmyname: same basically goes for keystone20:57
notmynameright20:57
notmynameit's a weird edge case20:57
morganfainbergnotmyname: hm. i actually need to make sure i catch you in vancouver20:58
notmynamemorganfainberg: great. looking at my calendar now, I think I have a slot from 1:45am to 2:30am on tuesday. ;-)20:58
morganfainbergnotmyname: hehe20:58
notmyname(I'm sure your schedule is the same)20:58
morganfainbergnotmyname: yeah20:58
morganfainbergnotmyname: maybe just grab a lunch sometime20:59
* notmyname hopes he gets a chance to eat lunch...20:59
morganfainbergnotmyname: if you don't get a chance to eat lunch, you need to block off lunch and tell people to fly kites when they harass you20:59
morganfainberg;)20:59
notmynameheh. yeah, I've done that before20:59
openstackgerritClay Gerrard proposed openstack/swift: Fix account replication during pre-storage-policy upgrade  https://review.openstack.org/17796421:01
*** Guest__ has quit IRC21:01
*** annegent_ has joined #openstack-swift21:07
*** esker has quit IRC21:12
*** foexle has joined #openstack-swift21:18
*** esker has joined #openstack-swift21:18
*** gyee has quit IRC21:20
*** zhill has quit IRC21:50
*** jrichli has quit IRC21:58
mattoliverauMorning22:03
*** delattec has joined #openstack-swift22:08
*** vishy has quit IRC22:17
*** vishy has joined #openstack-swift22:19
*** esker has quit IRC22:23
torgomaticdoes anyone have any thoughts on python 2.6 support after the kilo release?22:27
torgomaticjust to kick things off, my thoughts are "kill it with fire"22:27
* clayg likes the way torgomatic thinks22:28
swifterdarrelltorgomatic: +2, but if someone was running Swift on, like, whatever that old Ubuntu is, Lucid?  Or CentOS system python (2.6)... they might... not like that22:28
torgomaticswifterdarrell: true, but Lucid goes EOL on Thursday, so I don't really care about it any more22:28
swifterdarrelltorgomatic: but I have enough trouble thinking for myself, I'd hate to try thinking for others...22:29
swifterdarrelltorgomatic: hahahahahaha, EOL...22:29
torgomaticswifterdarrell: technically correct is the best kind of correct ;)22:29
swifterdarrelltorgomatic: (of course that doesn't mean all the systems running it magically upgrade if their operators haven't done that yet)22:29
torgomaticand it's not like existing clusters will fall over, just that the Llama release won't run on them until they get up to python 2.722:30
swifterdarrelltorgomatic: I'll give it +2.7 then22:31
claygtorgomatic: not true - the moment *you* say you don't care about python 2.6 the entire world falls over22:31
torgomaticswifterdarrell: 👍22:31
swifterdarrelltorgomatic: haha, my font's real small and I thought that was a middle finger22:32
*** foexle has quit IRC22:32
* torgomatic wishes there were an emoji for that22:32
torgomaticUnicode 7.0 to the rescue! http://emojipedia.org/reversed-hand-with-middle-finger-extended/22:32
openstackgerritDenis Cavalcante proposed openstack/swift: Add storage policy support for sorting method  https://review.openstack.org/16087722:34
*** km has joined #openstack-swift22:37
*** annegent_ has quit IRC22:51
*** mmcardle has quit IRC23:15
*** NM has quit IRC23:19
*** AbyssOne__ is now known as a1|away23:23
*** kei_yama has joined #openstack-swift23:27
*** geaaru has quit IRC23:28
*** annegentle has joined #openstack-swift23:33
*** annegentle has quit IRC23:35
*** erlon has quit IRC23:41
*** theanalyst has quit IRC23:50
*** ho has joined #openstack-swift23:52
hogood morning!23:53
*** theanalyst has joined #openstack-swift23:53

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!