Monday, 2015-03-09

*** ho has joined #openstack-swift00:22
hogood morning guys!00:23
*** bill_az has joined #openstack-swift00:50
*** abhirc has quit IRC00:51
*** abhirc has joined #openstack-swift00:51
*** abhirc has quit IRC00:55
*** abhirc has joined #openstack-swift00:55
*** abhirc has quit IRC00:57
*** abhirc has joined #openstack-swift00:57
*** abhirc has quit IRC00:58
*** abhirc has joined #openstack-swift00:58
*** abhirc has quit IRC01:05
*** yuan has joined #openstack-swift01:24
*** bill_az has quit IRC01:37
*** abhirc has joined #openstack-swift01:40
*** haomaiwang has joined #openstack-swift02:26
*** Krast has joined #openstack-swift02:32
*** echevemaster has quit IRC02:54
*** sandywalsh has quit IRC03:45
*** kota_ has joined #openstack-swift04:35
*** ppai has joined #openstack-swift04:42
*** SkyRocknRoll has joined #openstack-swift05:44
*** ktsuyuzaki has joined #openstack-swift06:09
openstackgerritPrashanth Pai proposed openstack/swift: Make object creation more atomic in Linux  https://review.openstack.org/16224306:10
*** kota_ has quit IRC06:11
*** kota_ has joined #openstack-swift06:14
*** ktsuyuzaki has quit IRC06:15
*** ktsuyuzaki has joined #openstack-swift06:16
*** zhill has joined #openstack-swift06:18
*** kota_ has quit IRC06:18
*** kota_ has joined #openstack-swift06:19
*** ktsuyuzaki has quit IRC06:21
*** ktsuyuzaki has joined #openstack-swift06:21
*** kota_ has quit IRC06:23
*** kota_ has joined #openstack-swift06:24
*** ktsuyuzaki has quit IRC06:26
*** zhill has quit IRC06:26
*** ktsuyuzaki has joined #openstack-swift06:26
*** kota_ has quit IRC06:28
*** kota_ has joined #openstack-swift06:31
*** ktsuyuzaki has quit IRC06:32
*** ktsuyuzaki has joined #openstack-swift06:35
*** kota_ has quit IRC06:37
*** kota_ has joined #openstack-swift06:40
*** ktsuyuzaki has quit IRC06:42
*** ktsuyuzaki has joined #openstack-swift06:42
*** kota_ has quit IRC06:44
*** kota_ has joined #openstack-swift06:45
*** silor has joined #openstack-swift06:45
*** ktsuyuzaki has quit IRC06:46
*** ktsuyuzaki has joined #openstack-swift06:49
*** bkopilov has quit IRC06:50
*** kota_ has quit IRC06:51
*** kota_ has joined #openstack-swift06:54
*** ktsuyuzaki has quit IRC06:56
*** ktsuyuzaki has joined #openstack-swift06:56
*** kota_ has quit IRC06:58
*** kota_ has joined #openstack-swift07:01
*** ktsuyuzaki has quit IRC07:03
*** ktsuyuzaki has joined #openstack-swift07:04
*** kota_ has quit IRC07:06
*** kota_ has joined #openstack-swift07:07
*** ktsuyuzaki has quit IRC07:08
*** bkopilov has joined #openstack-swift07:45
*** bkopilov has quit IRC07:50
*** bkopilov has joined #openstack-swift07:50
*** bkopilov has quit IRC07:53
*** bkopilov has joined #openstack-swift07:54
*** nellysmitt has joined #openstack-swift08:00
*** mmcardle has joined #openstack-swift08:07
*** chlong has quit IRC08:07
*** nellysmitt has quit IRC08:12
*** rledisez has joined #openstack-swift08:12
*** nellysmitt has joined #openstack-swift08:12
*** geaaru has joined #openstack-swift08:27
*** bkopilov has quit IRC08:31
*** jordanP has joined #openstack-swift08:48
*** InAnimaTe has quit IRC08:57
*** briancline has quit IRC09:00
*** early has quit IRC09:04
*** briancline has joined #openstack-swift09:06
*** InAnimaTe has joined #openstack-swift09:06
*** early has joined #openstack-swift09:06
*** jistr has joined #openstack-swift09:13
*** haomaiwang has quit IRC10:09
*** abhirc has quit IRC10:16
openstackgerritKota Tsuyuzaki proposed openstack/swift: Fix param description on _make_request  https://review.openstack.org/16259210:24
*** kota_ has quit IRC10:33
*** bkopilov has joined #openstack-swift10:38
*** ppai has quit IRC11:02
*** chlong has joined #openstack-swift11:03
*** SkyRocknRoll has quit IRC11:03
openstackgerritAlistair Coles proposed openstack/swift-specs: Updates to encryption spec  https://review.openstack.org/15431811:09
*** MrHanachoo has joined #openstack-swift11:10
*** MrHanachoo has quit IRC11:11
notmynamegood morning11:14
*** ppai has joined #openstack-swift11:16
notmynameI'd like to draw your attention to http://lists.openstack.org/pipermail/openstack-dev/2015-March/058164.html11:20
notmynameI don't like where that thread is now. the linked bug is https://bugs.launchpad.net/horizon/+bug/129717311:21
openstackLaunchpad bug 1297173 in OpenStack Dashboard (Horizon) "Cannot view object details with Ceph backend" [Medium,Confirmed] - Assigned to Rohit Karajgi (rohitk)11:21
*** ho has quit IRC11:24
portantenotmyname: We talked about removing X-Timestamp from headers a long time ago, right?11:42
notmynameJay mentions my name in that thread. when he and I talked, I didn't know the context, and said that it's used in container-sync. but I'm not sure how/why horizon is using it (for reads?)11:43
*** ppai has quit IRC11:43
notmynameI dont' think it can be removed because of container sync, right?11:44
portanteRight, but it can be removed when the API is not for container sync11:45
*** ppai has joined #openstack-swift11:45
portanteadditionally, the bug talks about using the X-Timestamp in the response, and not in the API request, so this sounds like the Ceph RadosGW implementation not handling responses the same way11:46
portanteI am not sure we document response headers fully, but it was my understanding (now probably way outdated) that X-Timestamp headers in responses are "part" of the API11:47
portantepart of the metadata of an object11:47
portanteThe Ceph implementation uses mtime11:48
portanteAnd finally, Horizon has a UI for viewing individual objects?  fascinating11:48
notmynameI think that's all horizon does for swift: shows a dashboard11:49
portanteah, probably container timestamps then11:49
notmynamethe first issue is getting horizon to work properly (should it even care about x-timestamp)11:49
portantesounds useful, last modification of a container11:50
notmynamebut I don't want a third-party reimplementation of part of swift to start dictating what sort of swift support is in other openstack projects11:50
notmynameok, I gotta get breakfast before the ops meetup starts11:51
notmynameI'll be back later11:51
portantenotmyname: okay, when you get back ...11:52
notmynameyes?11:52
portanteThe patch referenced in the bug, 82801 (openstack gerrit), appears to be code for getting object details11:52
portanteoy11:52
portantenot container details11:52
portanteand the ceph bug tracked was opened 8 mos ago, updated 27 days ago, assigned to lpabon (http://tracker.ceph.com/issues/8911)11:54
portanteand it looks like it was fixed in the firefly release of ceph, awaiting backport to giant11:56
*** Anticimex has quit IRC11:57
*** Anticimex has joined #openstack-swift11:57
*** panbalag has joined #openstack-swift12:06
*** yuanz has joined #openstack-swift12:25
*** yuan has quit IRC12:25
acolesI created a trello board to track crypto work https://trello.com/b/63l5zQhq/swift-encryption12:32
acolesjrichli: ^^ please add yourself as a member and then add stuff12:33
acolestorgomatic: ^^12:33
acolesnotmyname: ^^ can you add link from the trello swift organization?12:34
*** annegentle has joined #openstack-swift12:36
*** aix has joined #openstack-swift12:43
*** mmcardle has quit IRC12:49
*** mahatic has joined #openstack-swift12:51
*** Tahmina has joined #openstack-swift12:58
*** chlong has quit IRC13:04
*** mmcardle has joined #openstack-swift13:07
*** ppai has quit IRC13:12
*** chlong has joined #openstack-swift13:17
tdasilvagood morning13:20
openstackgerritpaul luse proposed openstack/swift: Merge master to feature/ec  https://review.openstack.org/16263013:23
*** ppai has joined #openstack-swift13:24
*** wshao has joined #openstack-swift13:26
wshaohi, what is the mailing list for questions?13:28
*** wshao has left #openstack-swift13:30
*** ppai has quit IRC13:38
openstackgerritMerged openstack/swift: Small optimization to ring builder.  https://review.openstack.org/16233513:55
notmynametsg: I just heard from mordred (in person) that liberasure code is straightened out13:57
notmynameacoles: cool (trello board)13:58
*** reed has joined #openstack-swift13:58
notmynameacoles: I don't think I can link it, but maybe you can move it into the swift org?13:59
notmynamehttp://webapps.stackexchange.com/questions/19271/move-trello-boards-between-organizations13:59
acolesnotmyname: i like that it has so many fewer features than jira ;)13:59
notmyname:-)13:59
notmynamefor all: I propose we skip this week's meeting14:00
acolesnotmyname: i already noticed the next agenda is for 18th :)14:02
acolesnotmyname: "Note: You'll need to own the board that you're modifying, and you'll need to be a member of the organization that you're transferring the board to"14:02
acolesnotmyname: so you need to add me to openstack swift org (i couldn;t see how to self-subscribe)14:02
notmynameacoles: you've now been added to the swift org14:02
notmynameassuming you are acoles on trello14:03
acolesnotmyname: dadaa!! (i am)14:03
acolesnotmyname: are you further east than usual?14:04
notmynameyes. I'm on the US east coast right now (Pliadelphia)14:04
notmynamePhiladelphia14:05
notmynameops meetup today and tomorrow. then company business on wednesday and home on wed pm14:05
acolesnotmyname: ah, not just waking early then. have a good trip.14:06
notmynameya, I think it will be good14:06
notmynameI like the ops summits since it's a good place to listen to what people are saying14:07
*** Anticimex has quit IRC14:07
notmynamegranted, there's not a ton of swift content compared to other ones, but it's good to listen to what people are asking for14:07
*** Anticimex has joined #openstack-swift14:08
notmynameanyone know the updates to http://docs.openstack.org/developer/swift/deployment_guide.html#general-system-tuning14:09
notmynameahale: ^14:09
*** annegentle has quit IRC14:10
ahalenot off top of my head14:10
ahalethere was something recently about some of those needing changing or something wasnt there14:10
notmynameyes14:11
notmynameand I wanted to link to it in reply to http://lists.openstack.org/pipermail/openstack/2015-March/011824.html14:11
notmynameahale: could you take a few minutes any reply there, please?14:11
notmynamehmm..looks like he's already tried those settings14:11
ahalehm yeah thats a weird error14:12
*** annegentle has joined #openstack-swift14:15
openstackgerritMerged openstack/swift: Minor cleanup in proxy obj controller  https://review.openstack.org/16098514:18
notmynamethese ops summits are fun. sysadmins are not shy about speaking up about what's broken :-)14:19
*** nellysmitt has quit IRC14:24
eikkenotmyname: I can confirm :-)14:26
*** Anayag has joined #openstack-swift14:29
AnayagHi I need some help to understand how PUT request flow. Could you please tell why a PUT request waits at conns = [conn for conn in pile if conn] even the quorum is smaller than the number of connections?14:32
notmynameAnayag: because it's better to cleanly let connections close instead of dropping them on the floor14:35
notmynameAnayag: so once quorum is reached, then there is a secondary (short) delay to allow the other connections to finish, but it will actually drop connections if they don't finish very quickly14:36
openstackgerritMerged openstack/swift: Ssync fix for EC PUT path  https://review.openstack.org/16105714:37
notmynamelol "anyone have any useful one line debugging tools?"    "apt-get update"14:39
*** corvus is now known as jeblair14:41
Anayag+notmyname: Ahh ok, but a scenario I faced was for instance when I have a write quorum of 1, and replication degree is 3. If there is a delay in any one of those 3 replicas it affect for the PUT request its is using a buffered connection?14:41
notmynameif you have 3 replicas, your quorum is 214:41
Anayagya But I changed my the code so it will have read quorum 3 and write quorum 1 to get strong consistency14:42
notmynamethat doesn't get you strong consistency14:43
Anayagahh then how could I achieve strong consistency? Beacause I need to check the system behaviour with strong consistency14:44
acolespeluse: you here?14:45
peluse_for a bit, yes14:45
*** peluse_ is now known as peluse14:45
*** ChanServ sets mode: +v peluse14:45
notmynameAnayag: use something other than swift if you need strong consistency.14:45
notmynameAnayag: but I'm curious about what you mean by "check the system behaviour..."14:46
notmynamewhat are you looking for? what are you trying to do?14:46
peluseacoles, what's a hapenin?14:46
acolespeluse: ok just looking at comments on multi frag patch, and concern about if policy ends up being None because policy-index doesn't resolve to a policy...14:46
acolespeluse: seems like an early check raising ann err response would be useful?14:46
notmynamepeluse: did you see that the packaging looks like it's taken care of (for liberasurecode)?14:47
peluseacoles, yeah... I'd have to walk back through the scenarios and see if that's an error or not.  There are several places where we expect None and assume 0 when that happens but there are a few places where None can never happen.  Not sure about this one off the top of my head14:47
pelusenotmyname, yeah, just read the scrollback - that's GREAT14:47
notmynamepeluse: please check with tsg if there are other outstanding issues. I want to jump on them asap14:47
peluseacoles, for now maybe raising an error is best and we'll find out pretty quick :)14:48
acolespeluse - yep, when index==None we default to 0, thats OK. Its when index = 99, say, and there is no policy 9914:48
AnayagNo I am doing my thesis based on quorum changes and I am checking swift to check at which read/write quorums and which workload scenarios system give best throughput14:48
pelusenotmyname, will do14:48
tsgnotmyname: ack on liberasurecode .. have been following up with Scott Kitterman (Ubuntu) on that - SpamapS is the one to thank for14:48
acolesbecause i guess proxy and obj server swift.conf are out of sync??14:48
peluseahh, there he is :)14:48
AnayagSo my assignment is to find out how swift work for strong consistant situations14:49
tsggood morning! - still waiting on backports for liberasurecode, jerasure and gf-complete for ubuntu 14.0414:49
peluseacoles, that's one case that got highlighted recently in a few patchs from NT&T, yes.  I'm stil a bit ify on coding for miconfigured swift.conf files between servers14:49
notmynametsg: pypi now has 1.0?14:50
notmynametsg: and there's no reason to do the frankenstine release where they are all bundled together right?14:50
tsgnotmyname: finished that last night - have a call with Kevin at 9am PDT - should be up right after that14:50
pelusetsg, yeah I saw a bunch of commits this weekend, maybe you should take next Sun off (but just one) :)14:50
tsgnotmyname: that's correct14:50
notmynametsg: yay. thanks a ton for that14:50
tsgnotmyname: have been following up on zigo and SpamapS on https://bugs.launchpad.net/trusty-backports/+bug/1428834, https://bugs.launchpad.net/trusty-backports/+bug/142837714:51
openstackLaunchpad bug 1428834 in trusty-backports "[FFE] Please backport jerasure and lib-gf-complete from from Ubuntu 14.10 to 14.04 LTS" [Undecided,New]14:51
openstackLaunchpad bug 1428377 in liberasurecode (Ubuntu) "[FFE] Sync new package liberasurecode (for vivid) Backport for Ubuntu 14.04 LTS)" [Wishlist,Triaged]14:51
tsgwhich made this possible:  https://launchpad.net/debian/+source/liberasurecode14:51
acolespeluse: ok so shall i add a check for POLICIES.get_by_index(policy_idx) != None in obj server?14:51
tsgnotmyname: and yes, I am thinking the bundled version should be good to have for centos6.5 (not sure when the packages will make their way into that distro)14:52
peluseacoles, specficially where?14:52
Anayag+notmyname: I posted my question in Openstack community web as well https://ask.openstack.org/en/question/62348/why-the-bufferedhttpresponse-stops-proceeding-requests/. I am stuck here not understanding why this happenes? Could you please help?14:52
tsgpeluse, notmyname: will post an update to Trello later this morning14:52
notmynameAnayag: it doesn't. swift is AP (in the CAP theorem sense). to do strong consistency (ie CP), there's a lot of changes you'd have to make, including lots of fundamental assumptions in the code14:53
mahaticnotmyname, hi! around now. I dozed off the other night (my night). Could you answer that now please? (I'll repost the question)14:53
mahaticnotmyname, In validate servers scenario in the recon, the rings would have the info from the config. In which scenario would the ring info be wrong? In other words, why do we need to validate?14:54
*** annegentle has quit IRC14:54
acolespeluse: well, it could go early in each of GET/HEAD/PUT/POST/DELETE or it could go in DiskFile constructor, but then I think we'd need to catch it to return a sanitised error response14:54
acolespeluse: idk!14:54
peluseacoles, maybe we should tackle that in an independent patch?  small/compact, single purpose14:55
acolespeluse: sure, i agree, too much changing in one patch otherwise. i'll do that.14:56
peluseacoles, hmmm, get_name_and_placement() will default policy to 0 if None and I think is already in al the entry points14:56
notmynamemahatic: bad info could have been added to the rings, right? that's the whole reason for your project :-)14:56
*** glange has joined #openstack-swift14:57
*** ChanServ sets mode: +v glange14:57
mahaticnotmyname, yeah. I'm aware that's the reason :) But I couldn't fit all the things in, now that I read about config info.14:58
acolespeluse: yup that would be a good place to add a check14:58
notmynamemahatic: so I'm not sure I understand the question14:58
peluseacoles, yup, just check against what local POLICIES thinks right there15:00
peluseacoles, versus what came in from the header15:00
acolespeluse: ok will do.15:01
notmynameAnayag: I think that's normal. as in, the proxy will attempt to get a response from each server it's sending data to. and if it gets a quorum of responses, then it will wait just a little bit longer for any other connections to finish15:01
mahaticnotmyname, it's more of a config question I believe(the whole paste deploy thing). I'm reading on that. I think I'm fine for now. Will post back if I need to. Sorry to bother :)15:01
notmynamemahatic: no bother at all :-)15:01
notmynameplease continue to ask15:01
Anayag+notmyname: Thanks a lot. One last thing Please check whether I have understood correctly, forgetting strong consistency, still lets say we need to do two put requests sequentially. Then 2 of 3 replicas replies and it satisfies the quorum and lets assume 3rd replica is slow (eg: 3 seconds) then at the initiation of the 2nd put request it has to wait until the 3rd replica returns from the previous request. Is this the correct15:02
mahatic:) sure, thanks!15:02
notmynameAnayag: all of the writes are done concurrently (from the proxy to the storage nodes)15:02
*** jrichli has joined #openstack-swift15:04
* peluse out for a bit....15:04
*** Fin1te has joined #openstack-swift15:07
*** nellysmitt has joined #openstack-swift15:08
notmynameacoles: so i've been thinking about meeting times15:08
notmynamehttp://www.timeanddate.com/worldclock/meetingtime.html?iso=20150325&p1=224&p2=136&p3=240&p4=248&p5=17915:08
Anayag+notmyname: Yes, but for  3 replicas, 2 out of the 3 concurrent writes are fine. But if the 3rd write had not yet returned and the next put request is already on the fly. The 2nd put request waits at conns = [conn for conn in pile if conn] line. I need to confirm whether this is the correct behaviour? Or I have understood it wrongly?15:09
*** Fin1te has quit IRC15:10
*** Fin1te has joined #openstack-swift15:11
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873615:11
*** mahatic has quit IRC15:14
notmynameAnayag: what do you mean by "next put request"? the next segment of the current session? or just some other request15:17
*** annegentle has joined #openstack-swift15:23
Anayag+notmyname : I am running 2 put requests sequentially. For the first request everything works fine. But when second request start storage node is delayed to return response.15:24
notmynameAnayag: any chance you're using the proxy server's support for ssl?15:24
Anayagno its not using ssl15:25
notmynameok (good)15:25
*** mahatic has joined #openstack-swift15:25
notmynameerr...good that you aren't using the proxy server's ssl15:26
acolesnotmyname: reach any conclusion?15:28
*** rdaly2 has joined #openstack-swift15:28
notmynameacoles: "it's hard"15:30
notmynameacoles: actually, though, you can help. what are acceptable times for you?15:30
acolesnotmyname: right :)15:30
acolesnotmyname: selfish preference would be start time between 8am and 9pm start time. NB cschwede is one hour later than me15:33
notmynameah, good call. I thought you were both CET15:33
acolesnotmyname: No CET is London+115:34
acolesnotmyname: daylight savings is a pain because I think mattoliverau gets earlier while europe gets later for northern hemisphere summer15:35
cschwedeyou’re thinking to reschedule meeting time?15:35
*** hurricanerix has joined #openstack-swift15:36
notmynamecschwede: thinking. not deciding yet. acoles expressed displeasure about the current meeting time. and with (the US) time change yesterday, it's come to mind again15:36
notmynamecschwede: so yeah, your input is greatly appreciated here15:37
acolesnotmyname: seriously, current time is not a problem for me given other participants, i was most likely being tongue in cheek15:37
notmyname:-)15:37
*** david-lyle_afk is now known as david-lyle15:38
notmynameit's painful for mattoliverau too. and just flat impossible for ho, kota, dmorita, etc15:38
notmynamehttp://www.timeanddate.com/worldclock/meetingtime.html?iso=20150325&p1=224&p2=136&p3=240&p4=248&p5=179&p6=37 (added Berlin)15:38
cschwedewell, unfortunately there is always someone who needs to get up early/stay awake late15:39
notmynamewith one meeting time, perhaps 2100UTC is better. late for cschwede and early for japan15:39
notmynamebut maybe the least painful overall15:39
cschwedenotmyname: that’s fine with me, because then the chance is lower that i’m bringing my kids to bed and i miss the meeting like last time ;)15:40
notmynamecschwede: acoles: hmm...at least until your time change. at which point it gets _really_ late for you15:44
notmynamehere's a random day in june15:44
notmynamehttp://www.timeanddate.com/worldclock/meetingtime.html?month=7&day=25&year=2015&p1=224&p2=136&p3=152&p4=248&p5=179&p6=37&iv=015:44
acolesnotmyname:  thats a very random day in *june* :D15:45
notmynamewhatever. I just picked something that starts with a J ;-)15:45
Anayag+notmyname: Could you tell me whether BufferedHttpResponse block a request until a previous connection response return?15:46
cschwede11pm sounds better than 4am/5am ;)15:46
*** nellysmitt has quit IRC15:49
tdasilvanotmyname: what time was last summer? 2000UTC?15:49
*** Tahmina has quit IRC15:52
*** nellysmitt has joined #openstack-swift15:52
*** reed has quit IRC15:55
Anayag+notmyname: Yes It stops until the previous connection response returns16:03
*** annegentle has quit IRC16:06
*** tab__ has joined #openstack-swift16:07
*** nellysmitt has quit IRC16:11
openstackgerritMerged openstack/swift: Merge master to feature/ec  https://review.openstack.org/16263016:15
*** nellysmitt has joined #openstack-swift16:21
*** tab__ has quit IRC16:24
*** wshao has joined #openstack-swift16:24
*** geaaru has quit IRC16:27
*** Trixboxer has quit IRC16:29
*** Trixboxer has joined #openstack-swift16:29
*** wshao has quit IRC16:31
*** wshao has joined #openstack-swift16:33
*** geaaru has joined #openstack-swift16:40
*** zhill has joined #openstack-swift16:41
*** Fin1te has quit IRC16:42
*** reed has joined #openstack-swift16:47
*** dfg has joined #openstack-swift16:53
*** ChanServ sets mode: +v dfg16:53
*** rdaly2 has quit IRC16:54
*** wshao has quit IRC16:54
*** wshao has joined #openstack-swift16:55
*** Krast has quit IRC16:55
*** Krast has joined #openstack-swift16:56
*** Anayag has quit IRC16:56
*** gyee has joined #openstack-swift17:02
*** tsg_ has joined #openstack-swift17:04
*** tsg_ has quit IRC17:05
*** tsg_ has joined #openstack-swift17:06
*** tgohad has joined #openstack-swift17:06
*** tgohad has quit IRC17:06
*** annegentle has joined #openstack-swift17:07
*** tsg has quit IRC17:07
*** nellysmitt has quit IRC17:11
*** nellysmitt has joined #openstack-swift17:13
*** nellysmitt has quit IRC17:17
*** thumpba has joined #openstack-swift17:20
openstackgerritAlistair Coles proposed openstack/swift: Return 400 from object server if policy does not exist  https://review.openstack.org/16269617:24
acolespeluse: clayg: ^^ trying to catch any possibility of policy == None early and handle gracefully17:25
*** rledisez has quit IRC17:29
notmynametdasilva: the meeting time has always been 1900utc17:36
tdasilvanotmyname: ok17:38
*** rdaly2 has joined #openstack-swift17:41
*** wshao has quit IRC17:48
*** reed has quit IRC17:49
notmynametalking about logs here17:51
*** annegentle has quit IRC17:55
*** annegentle has joined #openstack-swift17:55
notmynamethe operator view is that we could take tokens (format strings) for each value and put that in a config17:56
notmynamemaybe oslo.log has defined some of these17:56
notmynameand the default (for swift) would be the current log format17:57
notmynameI guess the trick would be to get the necessary tokens defined in oslo.log17:57
*** jistr has quit IRC17:59
*** mmcardle has quit IRC18:00
*** chlong has quit IRC18:05
*** mahatic has quit IRC18:08
*** annegentle has quit IRC18:08
*** lcurtis has joined #openstack-swift18:15
*** Fin1te has joined #openstack-swift18:25
*** jordanP has quit IRC18:31
openstackgerritAlistair Coles proposed openstack/swift: Multiple fragment Archive Index Support  https://review.openstack.org/15963718:55
openstackgerritAlistair Coles proposed openstack/swift: Diskfile decides if durable is written based on policy  https://review.openstack.org/16271718:55
*** geaaru has quit IRC18:56
acolesclayg: peluse : ^^ sorry guys i guess i rebased https://review.openstack.org/159637 on latest feature/ec so created a new patchset :/18:57
*** acoles is now known as acoles_away18:59
claygthat's fine19:00
*** wshao has joined #openstack-swift19:13
*** silor1 has joined #openstack-swift19:14
*** silor has quit IRC19:16
*** bkopilov has quit IRC19:17
*** wshao has quit IRC19:29
*** thumpba has quit IRC19:37
*** thumpba has joined #openstack-swift19:38
*** annegentle has joined #openstack-swift19:46
*** os1 has joined #openstack-swift19:51
os1Hi19:51
os1Has anyone run into19:51
os1LookupError: No section 'cache' (prefixed by 'filter') found in config /etc/swift/object-expirer.conf19:51
os1when creating a separate /etc/swift/memcache.conf file?19:52
os1And the [filter:cache] sections are still there in proxy-server.conf and object-expirer.conf19:53
*** bgmccollum has joined #openstack-swift19:56
*** silor1 has quit IRC19:58
bgmccollumis there any functional difference between presenting swift a whole block device, vs. a single partition on said block device?19:58
notmynamebgmccollum: filesystem partition?19:59
bgmccollummkfs /dev/device vs. paritioning, then formatting the partition19:59
notmynameos1: I don't know. I'm hoping someone (not at a conference) can spin up a server and test it20:00
notmynamebgmccollum: no semantic difference. swift defines a "node" by IP:port/mountpoint.20:01
notmynamebgmccollum: of course, I don't htink that's a good idea, in general :-)20:01
bgmccollumright...just wondering in the docs, it says to partition the disk, then format the partition, then mount the partition and build ring...20:01
bgmccollumcan you expand on why its a bad idea?20:02
bgmccollumor is this fundamentally below swift20:02
claygbgmccollum: it's just below what swift cares about, you don't need a partition - just a mounted file system20:03
claygI totally put the fs on the whole device20:03
bgmccollumjust wondering if there was something i was missing to why someone would want to create a single partition for the whole device...20:03
bgmccollumi mkfs the whole device myself as well20:03
notmynamebgmccollum: and since, as clayg it's below what swift cares about, you don't want to have 2 partitions as different "devices" where one hardware failure can cause more than one replica loss20:04
bgmccollumnotmyname yeah i got that :) which brings up the whole...why even partition in the first place20:04
bgmccollumnotmyname: sorry probably misinterpreted your "i dont think that's a good idea"...thought you were saying not a good idea to *not* partition...20:06
claygbgmccollum: i'm not sure what docs you're looking it - it may be specific to one way of doing a swift-all-in-one where you're just using a single device for four file-systems - or maybe the practice was lifted from there and put somewhere else where it's just not useful20:06
bgmccollumclayg: http://docs.openstack.org/juno/install-guide/install/apt/content/swift-install-storage-node.html - which has been copypasta'd into the RPC docs...im trying to clear up this minconception20:08
bgmccollum"Each of the devices, /dev/sdb and /dev/sdc, must contain a suitable partition table with one partition occupying the entire device."20:08
openstackgerritDenis Cavalcante proposed openstack/swift: Add storage policy support for sorting method  https://review.openstack.org/16274320:09
claygyeah that wording is overly dramatic, i'm not sure the history on that line...20:09
bgmccollumso its bunk...thanks for the confirmation20:10
clayglooks new in juno, icehouse just described the process with an example using a partition and made no specific claims as to why -> http://docs.openstack.org/icehouse/install-guide/install/apt/content/installing-and-configuring-storage-nodes.html20:11
claygwell it still said "should be partitioned" - so yeah, urban myth ;)20:12
bgmccollum*massive eye roll*20:15
bgmccollumthanks20:15
*** rdaly2 has quit IRC20:25
*** wshao has joined #openstack-swift20:30
*** aix has quit IRC20:31
*** tab has joined #openstack-swift20:33
*** tab is now known as Guest4065520:33
*** wshao has quit IRC20:35
*** zaitcev has joined #openstack-swift20:59
*** ChanServ sets mode: +v zaitcev20:59
mattoliverauMorning21:05
*** Tahmina has joined #openstack-swift21:09
os1notmyname : Are you suggesting that memcached.conf hasn't been tested before?21:17
openstackgerritpaul luse proposed openstack/swift: Erasure Code Reconstructor  https://review.openstack.org/13187221:17
*** Fin1te has quit IRC21:27
jrichlimattoliverau: morning!21:28
*** chlong has joined #openstack-swift21:45
openstackgerritClay Gerrard proposed openstack/swift: wip: just use policy everywhere  https://review.openstack.org/16277521:49
*** chlong has quit IRC21:57
*** chlong has joined #openstack-swift21:57
*** wshao has joined #openstack-swift22:01
*** chlong has quit IRC22:04
*** wshao has quit IRC22:06
*** jrichli has quit IRC22:10
openstackgerritClay Gerrard proposed openstack/swift: Return 400 from object server if policy does not exist  https://review.openstack.org/16269622:16
openstackgerritClay Gerrard proposed openstack/swift: wip: just use policy everywhere  https://review.openstack.org/16277522:16
*** wshao has joined #openstack-swift22:16
*** annegentle has quit IRC22:19
*** annegentle has joined #openstack-swift22:21
*** theanalyst has quit IRC22:21
*** openstack has joined #openstack-swift22:25
*** annegentle has quit IRC22:26
*** annegentle has joined #openstack-swift22:27
*** rdaly2 has joined #openstack-swift22:29
*** rdaly2 has quit IRC22:33
peluseclayg, you there?22:45
claygyessir22:45
peluseso I'm wasting just tons of time in rebase hell... if I need to rebase *my* patch that is already dependent on someone else's and they update theirs, I just git rebase -i <hash> of their latest right?22:46
claygso it's "theirs -> yours" and you still want that, but "theirs" has just moved?22:47
claygthe only trick is that when you "git rebase -i new-sha-of-theirs" you have to delete "old-sha-of-theirs" from your "list of shas to rebase ontop of new-sha-of-theirs"22:48
claygI have pretty good luck with that anwyay...22:48
peluseclayg, ahhh, yes I was forgetting to do that.  so the only thing in the pick list should be mine then right?22:49
claygyup22:50
pelusecrap, OK, thanks!22:50
*** lcurtis has quit IRC22:51
pelusegood grief.... much better22:52
pelusenow I'm wondering if I can add a 2nd dependency that happens to also be a dependency of my parent?  Or maybe I should quit while I'm ahead and just cherry pick the code that I want on over...22:53
mattoliverauLol22:53
claygso it's "theirs -> yours1 -> yours2" - do the same thing; but start @ yours2 and rebase on "new-sha-of-theirs" and delete "old-shaw-of-theirs"22:54
claygrebase -i will stop along the way and let you clean up conflicts22:54
claygthe only thing I struggle with going that route is when there's a symatic conflict in yours1 that git does see (like a unused import or failing unittest)22:55
claygpeluse: sometimes it is easier to get yours1 where you're happy - then checkout yours2 and rebase it on yours1 same as you did for "their-new-sha -> yours1"22:56
claygYMMV22:56
claygmattoliverau: don't laugh - use DCS they said, it's better they said, makes branching easy they said, phffft22:57
peluseclayg, yeah that might be a better stepwise approach for things that are all entagled22:57
mattoliverauSorry, I'm just happy to see it isn't just me who gets himself into these messes :p22:58
claygI think I'm going to just have to make the call to change the kwarg signature on get_diskfile - master passes in policy_idx, but we should pass in the policy22:58
claygheh22:58
peluseI'll get the recon fully rebased and working tomorrow if it kills me. yeah, that's be one more thing that will throw me a a beer - I mean a loop :)22:58
claygoh god - no peluse don't *die*22:58
claygdrinking is ok tho22:59
peluseheh... allright time to commute the other way.... later22:59
mattoliveraupeluse: o/22:59
*** annegentle has quit IRC23:03
*** os1 has left #openstack-swift23:03
*** Guest40655 has quit IRC23:10
*** km has joined #openstack-swift23:21
*** openstack has joined #openstack-swift23:25
*** chlong has joined #openstack-swift23:43
*** Tahmina has quit IRC23:52

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!