Wednesday, 2015-03-11

claygbah, I think the hope of regression is out the window - it's been like that since it was added in 156f27c900:04
claygi'm going to go back and see if I can get a pipeline that works just to be sure00:05
*** thumpba_ has quit IRC00:06
claygbah - no conf.d support :\00:07
*** ho has joined #openstack-swift00:09
homorning!00:09
claygImportError: No module named webob -> wow this is getting silly quickly :\00:12
*** kota_ has joined #openstack-swift00:16
tdasilvaclayg: started this etherpad just to help out get all scenarios listed out: https://etherpad.openstack.org/p/object_version_and_ACL_use_cases00:17
*** bgmccollum has left #openstack-swift00:23
clayggood idea00:24
tdasilvamight be helpful to others to understand whatever solution we come up with :)00:25
*** david-lyle_afk has quit IRC00:34
*** zhill has quit IRC00:34
mattoliverauho: morning00:35
homattoliverau: morning00:40
claygtdasilva: that was helpful I think00:41
tdasilvaclayg: +100:41
tdasilvaclayg: mind if I clear authorship colors?00:42
claygyou can do that!00:44
tdasilvajust find them annoying to read00:44
claygtdasilva: in general, if there is ever any oppertunity to make something better and the only downside is that "it might make clayg mad" - DO IT - without giving it a second thought; I'll get over it00:45
*** Nadeem has quit IRC00:45
tdasilvahaha00:45
claygso much better - thanks00:45
claygso i like that we have four states - and we're only using three of them00:46
claygi also like that the only state that makes sense is if you have full access00:46
claygI also like that either the write-only or read-only states both have some nice property and some bad property00:46
tdasilvai guess that would be the fifth state00:47
claygi see no-access, read-only, write-only, read-write00:47
claygno I think it's fair to ignore read access to the container because versioned writes just doesn't even come into play with those requests00:49
tdasilvaoh true true00:49
claygit only modifies behavior on put or delete00:49
yuanztorgomatic, clayg, so swift actuall does not fully support the if-match/if-none-match, only if-none-match * supported right now?00:52
torgomaticyuanz: on PUT, yes; on GET, it's got full support00:52
*** zul has joined #openstack-swift00:54
yuanztorgomatic, thx, got it. I didn't know this. In obj-server PUT looks like it's supported00:55
torgomaticyeah, it kind of does, but I think it's only * because of eventual-consistency issues making it really hard to do otherwise00:55
claygtorgomatic: I think eventual-consistency means it's best effort regardless00:58
claygtorgomatic: which is sorta weird because the use-case it was intended for and the only one it really works with is when you have multiple actors that can potentially generate the same content - but you want to save the bandwidth if someone beat you to it - but re-uploading (and over-writing any previous contents) will never be *wrong* it's just inefficent01:00
yuanzright, thx for the education. Question on the x-newest for EC: do we still need to query each FA in EC, or just return the timestamp of ts.durable?01:05
*** david-lyle_afk has joined #openstack-swift01:21
dmoritapeluse: are you around?01:21
*** lcurtis has joined #openstack-swift01:26
claygyuanz: x-newest currently goes 2 * replica count into handoffs, hitting every primary node on EC X-Newest is the least of our worries01:29
*** devlaps has joined #openstack-swift01:31
*** cdelatte has quit IRC01:49
*** devlaps has quit IRC01:51
clayghow did tdasilva make the colors go away on https://etherpad.openstack.org/p/object_version_and_ACL_use_cases01:55
claygdoes anyone in here know how to etherpad?01:55
kota_seems to press the bottun at the center of the page header.02:00
kota_clayg: the icon consists of circle and colors02:01
pelusedmorita, I'm around for just a few minutes but will be available almost all of tomorrow - what's up?02:03
dmoritapeluse: I updated a patch https://review.openstack.org/#/c/141252/ . I just would like you to remove -2 of this patch because I separated out codes relating to replicator.02:04
claygkota_: you the man!02:05
claygoh if peluse -2'd something I *definately* want to see it ;)02:05
kota_clayg: :)02:05
peluseha!02:06
peluseOK, will looks right now02:06
dmoritapeluse: thanks :)02:06
claygdmorita: peluse: so i was acctually going the other way with the auditor to be more like the updater/replicator02:09
claygit turns out that if an object-replicator ever ran against an EC policies datadir we won't be happy - and the EC auditor will probably have to do something to reap old .data files that don't have a .durable02:10
claygso really if you see an objects dir for a policy that's not listed in your swift.conf it's best to raise a warning and stay the fuck out before you make things worse02:11
peluseclayg, sure, we could have the auditor do some cleanup however we had sorta planned on reconstructor doing that (but still up in the air)02:11
peluseclayg, but agree on your fuck comment :)02:11
pelusedmorita, I'm still having some heartburn with the whole conf_check thing and I'm not sure that pepcis AC will fix it02:12
claygpeluse: oh maybe it does reclaiming - either way acoles and I are pretty keen on going with a EcPolicy diskfile (for all the same reasons the EcObjectController is a good idea) and if you have a per-policy diskfile no one gets to pretend they know what to do with some policy that's not in their swift.conf02:13
claygobject-server has to 400, consistency daemons need to skip that datadir - and everyone complains about not having swift.conf up-to-date02:13
peluseclayg, yeah I'm very interested in hearing more about the ECPolicy diskfile on Thu afternoon02:14
claygencryption is another example - torgomatic keeps pointing out that if you let unencrypted objects sit in the same datadir as encrypted objects an attacker can replace your encrypted data with unencrypted data and you'd never know - so an encrypted policy specific diskfile might have some auditing behaviors that are different02:15
pelusedmorita, are you cool if we just keep your patch "on hold" until we sort out some of the EC things we're working through now?  Tey do have material impact on your patch (may solve your issues without needing an additional change)?02:15
peluseclayg, good point - or torgomatic I guess02:15
pelusedmorita, and the timeframe I'm talking about is just another week or sop02:16
pelusesop=so02:16
claygwell it's all a pipe dream atm - we *need* to get the EcObjectController squared - and do something about internal routing requests (COPY and object versions) getting their controllers right (yuan has an idea on this) - THEN I *want* to see if we can make diskfile better with per policy diskfile routing02:16
dmoritapeluse: No problem. I do not rush for it and we should fix EC related patches first :)02:17
peluseclayg, did you say something about a pipe?02:17
pelusedmorita, great. thanks.  Feel free to bring it up again end of next week if we don't - would appreciate the reminder02:18
peluseOK, the chef needs to go make dinner for the family.... later folks02:19
*** jrichli has joined #openstack-swift02:24
*** haomaiwang has joined #openstack-swift02:28
*** haomaiwang has quit IRC02:29
*** haomaiwang has joined #openstack-swift02:29
*** haomaiwang has quit IRC02:29
*** haomaiwa_ has joined #openstack-swift02:30
*** haomaiwa_ has quit IRC02:30
*** haomaiwang has joined #openstack-swift02:31
*** david-lyle_afk has quit IRC02:36
*** anticw has quit IRC03:09
*** anticw has joined #openstack-swift03:09
*** NM has joined #openstack-swift03:12
*** thumpba has joined #openstack-swift03:17
*** david-lyle_afk has joined #openstack-swift03:17
*** NM has quit IRC03:20
*** donagh has quit IRC03:26
*** thumpba_ has joined #openstack-swift03:30
*** thumpba has quit IRC03:34
*** donagh has joined #openstack-swift03:34
*** ppai has joined #openstack-swift03:47
*** lcurtis has quit IRC04:01
*** thumpba_ has quit IRC04:02
*** jrichli has quit IRC04:05
*** thumpba has joined #openstack-swift04:43
*** thumpba has quit IRC04:47
*** thumpba has joined #openstack-swift04:57
*** thumpba has quit IRC05:03
*** thumpba has joined #openstack-swift05:08
*** thumpba has quit IRC05:18
claygtdasilva: what is Marula Kruger?05:35
*** panbalag has quit IRC05:46
*** bkopilov has quit IRC06:08
*** bkopilov has joined #openstack-swift06:09
*** panbalag has joined #openstack-swift06:20
*** silor has joined #openstack-swift06:27
*** silor has quit IRC06:37
*** bkopilov has quit IRC07:38
*** bkopilov has joined #openstack-swift07:45
*** bkopilov has quit IRC07:50
*** chlong has quit IRC08:01
*** bkopilov has joined #openstack-swift08:02
openstackgerritYuan Zhou proposed openstack/swift: Update contianer sync to use internal client  https://review.openstack.org/14379108:04
*** rledisez has joined #openstack-swift08:09
*** thumpba has joined #openstack-swift08:19
*** thumpba has quit IRC08:23
*** geaaru has joined #openstack-swift08:27
*** bkopilov has quit IRC08:49
*** bkopilov has joined #openstack-swift08:51
*** acoles_away is now known as acoles08:58
claygyawn - i gotta turn in09:01
claygg'night09:01
acolesclayg: whoa, you still around? good night!09:02
*** ho has quit IRC09:15
openstackgerritYuan Zhou proposed openstack/swift: List valid EC types in error  https://review.openstack.org/14231109:21
*** jistr has joined #openstack-swift09:25
*** jistr has quit IRC09:50
*** jistr has joined #openstack-swift09:52
*** nshaikh has joined #openstack-swift09:56
*** SkyRocknRoll has joined #openstack-swift10:11
*** chlong has joined #openstack-swift10:23
*** jistr has quit IRC10:38
*** knl has joined #openstack-swift10:38
*** jistr has joined #openstack-swift10:39
*** knl has quit IRC10:39
*** haomaiwang has quit IRC10:49
straycatDoes the proxy-server auto create accounts, or the account server?10:53
straycatMy instance is creating accounts but failing to create containers and I'm trying to figure out why.10:54
kota_straycat: that behavior is configurabe10:59
kota_straycat: when you set account_autocreate to be true, proxy-sever will create the account automatically.11:00
kota_straycat: but it is false in default.11:00
straycatRight, yes I have that set.11:00
kota_straycat: what response code did you get as the failure?11:01
kota_straycat: the response code would be helpful to figure out where the failure comes from.11:03
straycatkota_, swift upload gives a 40411:04
kota_straycat: ok, I'm thinking...11:05
kota_straycat: Basically, when 404 appeared at PUT container, account deosn't exist in the Swift.11:07
acolesstraycat: did you do 'swift post <containername>' before the upload11:09
straycatkota_, ok11:10
straycatacoles, no11:10
acolesstraycat: swift upload will attempt to create the container but just curious if you see 404 from straightforward 'swift post <container>'11:10
*** silor has joined #openstack-swift11:11
kota_straycat: did you do 'swift list'?11:12
kota_straycat: i.e. get a list of containers.11:13
acoleskota_: hi!11:14
kota_acoles: Hi! Thanks to help us :)11:14
kota_acoles: How's going? Maybe, good morning!11:14
acoleskota_: i don't think i have helped yet :)11:14
acoleskota_: yes its morning! thanks11:15
straycatsorry, i'm going to have to try this later i've screwed the config somehow11:16
straycatrunning swift-init all start now gives me ValueError: invalid literal for int() with base 10: ''11:16
straycatthanks though :]11:16
kota_starycat: ok, no worried11:17
*** dencaval has joined #openstack-swift11:17
straycatokay, it's back, some pid files got left behind in /var/run, so i can swift list, and swift put swift-container11:25
straycatshould have mentioned there's a 400 as well as a 40411:25
straycats/put/post/11:25
*** o5k has joined #openstack-swift11:25
*** knl has joined #openstack-swift11:25
straycatwell, swift post returns with 0, but looking at the log the POST got a 40011:27
openstackgerritAlistair Coles proposed openstack/swift: Make functional tests tolerate pre-existing versioned container  https://review.openstack.org/16338511:38
acolesstraycat: swiftclient had a bug with return status not indicating failures. Its fixed upstream but don't think it is yet in last release11:44
acolesstraycat: 'swift --debug post c1' will show you http response status11:45
openstackgerritDaisuke Morita proposed openstack/swift: object-replicator warns when object dirs mismatch with policy settings  https://review.openstack.org/16338911:51
straycatacoles, that's cool11:52
straycatso i see that running curl -i http://127.0.0.1:8080/v1/AUTH_3eda71c0765f43478ba9e44256bfa701/c1 -X POST -H "Content-Lengt11:53
straycath: 0" -H "X-Auth-Token: 40dea1c964bd4e2ead1f60a52b8705d1"11:53
straycatgives me a 400 bad request11:53
straycati guess the more important part is RESP BODY: Invalid path: /sdb/719/AUTH_3eda71c0765f43478ba9e44256bfa701/c111:55
*** dmorita has quit IRC11:56
kota_straycat: wow, curious. Looks like as from container-sever...11:58
openstackgerritPrashanth Pai proposed openstack/swift: Make object creation more atomic in Linux  https://review.openstack.org/16224312:02
*** erlon has joined #openstack-swift12:04
*** cdelatte has joined #openstack-swift12:14
*** delattec has joined #openstack-swift12:14
kota_straycat: Sorry I am running out of time to look at. It looks curious but tentaitively I have no idea.12:16
straycatkota_, I think it might be related to https://answers.launchpad.net/swift/+question/241916 i'm checking12:17
kota_straycat: great. I hope it would be what you want.12:19
straycatthanks :)12:19
acolesstraycat: could be. can you look in your logs, /var/log/swift/storage<n>.log and see if you can locate the 400 there, and for which server?12:19
straycatacoles, redploying currently, but i recall seeing a 400 from the account-server, there were no messages from container-server or object-server12:20
*** o5k_ has joined #openstack-swift12:20
acolesstraycat: well that would be consistent with that bug, if a path with 4 parts e.g. /sdb/719/AUTH_3eda71c0765f43478ba9e44256bfa701/c1 is sent to account server it will 400.12:21
*** o5k has quit IRC12:22
straycatyep looks like i borked the ring configs, swift-ring-builder tells me they're all set to listen on 600212:29
* straycat should have checked that ages ago12:29
acolesstraycat: :( well lets hope that fixes things for you12:29
*** ppai has quit IRC12:31
*** mahatic has joined #openstack-swift12:36
*** kota_ has quit IRC12:38
*** SkyRocknRoll has quit IRC12:48
*** SkyRocknRoll has joined #openstack-swift12:51
*** SkyRocknRoll has joined #openstack-swift12:51
*** NM has joined #openstack-swift12:51
*** mariusv has joined #openstack-swift12:58
*** mariusv has quit IRC12:58
*** mariusv has joined #openstack-swift12:58
*** mariusv has quit IRC13:01
*** mariusv has joined #openstack-swift13:02
*** mariusv has quit IRC13:02
*** mariusv has joined #openstack-swift13:02
*** mariusv has quit IRC13:02
*** mariusv has joined #openstack-swift13:02
*** aix has joined #openstack-swift13:13
*** nellysmitt has joined #openstack-swift13:24
m_hanhi, i'm deploing SAIO and i get some errors in the the functional tests, can anybody help?13:29
m_hanping 0.0.0.0 :313:31
*** jrichli has joined #openstack-swift13:36
*** nellysmitt has quit IRC13:39
*** nellysmi_ has joined #openstack-swift13:42
*** nellysmi_ has quit IRC13:44
*** annegentle has joined #openstack-swift13:49
straycatOkay this works now13:50
straycatacoles, thanks for your help :)13:50
acolesstraycat: welcome13:50
m_hanacoles : i'm getting  some errors in the the functional tests of SAIO, can you help me ?13:53
acolesm_han : paste your errors somewhere e.g. http://paste.openstack.org/ and put a link here (don't paste the errors here!)13:54
*** zaitcev has joined #openstack-swift13:55
*** ChanServ sets mode: +v zaitcev13:55
*** tellesnobrega_ has joined #openstack-swift14:00
*** tsg_ has joined #openstack-swift14:05
*** tgohad has joined #openstack-swift14:05
*** tgohad has quit IRC14:05
*** SkyRocknRoll has quit IRC14:05
m_hanacoles :  http://paste.openstack.org/show/191597/  tell me there is a need for the log files, thank's in advance man14:08
*** mahatic has quit IRC14:09
*** mahatic has joined #openstack-swift14:09
mahaticacoles, hi! if you are around and free, could you tell me how are the policies accessed here:https://review.openstack.org/#/c/138697/3/swift/cli/recon.py14:14
zaitcevm_han: looks like proxy-server.conf has some of TempAuth entries wrong14:14
mahaticacoles, I mean, as I see it, it is accessed by the url['policies'] but I'm not sure how that is valid. Would you be able to help?14:15
acolesm_han: like zaitcev says, check the tempauth account config in proxy-server.conf matches those in test.conf14:20
acolesm_han: the sample configs should work (with tempauth)14:20
acolesmahatic: looking14:20
mahaticacoles, great. thanks!14:20
acolesmahatic : looks to me like url is a key into all_scan dict. recon.scout requests recon info from host which i presume is a dict with a key 'policies'. Looks like object auditor also has a change to add a 'policies' key in recon_cache_dict.14:31
*** lcurtis has joined #openstack-swift14:32
m_hanthis is my /etc/swift/proxy-server.conf http://paste.openstack.org/show/191610/14:33
m_hanit shoud work like that or i have to change the entries in the [filter:tempauth] directive?14:34
zaitcevno, that part looks okay14:41
zaitcevso, maybe the test.conf is wrong or whatever it is that you use14:41
mahaticacoles, hosts are retrieved in main() by calling get_devices. But there is no [policies] key in Ring class which is called in that method.14:42
zaitcevI have SWIFT_TEST_CONFIG_FILE=/etc/swift/func_test.conf14:42
*** o5k_ has quit IRC14:42
zaitcevIf that one checks out, I don't have any good ideas. The previous paste looked like the tenant "test" worked, but "test2" failed.14:43
mahaticacoles, sorry if that was confusing. In cli/recon.py the hosts info is collected in main() by calling get_devices method, which in turn calls Ring class14:43
m_hani've followed the official doc step by step docs.openstack.org/developer/swift/development_saio.html i don't see where is the prb ://14:47
acolesmahatic: i'm confused, is your query with line 616 in https://review.openstack.org/#/c/138697/3/swift/cli/recon.py14:52
acoles?14:52
mahaticyeah that's right14:52
mahaticmy question is, I do no really see a key as 'policies' anywhere. Am I missing something?14:53
mahaticdo not*14:53
*** jkugel has joined #openstack-swift14:54
acolesm_han: i just ran functional tests ok with your proxy-server.conf. I did have to change the user to 'swift' in DEFAULT section. maybe check you have correct user permissions in your setup? If you post your test.conf i will verify that too, but the sample.conf should work.14:55
tsg_yuanz, still around?14:58
acolesmahatic: all_scan[url] is set equal to the response content from a call to Scout.scout_host() which loads json, so the 'policies' key will be in that response body json (I presume - I am not hugely familiar with this) - so as long as the object server recon middleware returns json with a 'policies' key then the key will be in the dict stored under all_scans[url].14:59
m_hanacoles : this is my test.conf http://paste.openstack.org/show/191615/14:59
m_hani'm cheking my permissions in the setup15:02
mahaticacoles, hmm okay. I am actually aware of the flow (that it calls scout_host() and that it loads json). But I just don't see anywhere policies as a key. As in a way to know which policy the URL belongs to.15:04
*** tellesnobrega_ has quit IRC15:07
mahaticacoles, line 115 in https://review.openstack.org/#/c/138697/3/swift/obj/auditor.py -> is creating I guess.15:07
acolesmahatic: obj/auditor.py line 122 in that patch adds key ['policies'] to recon_cache_dict - is that not the dict that gets returned in response to a recon request?15:07
acolesmahatic: right :)15:07
mahaticacoles, yeah :)15:09
*** bkopilov has quit IRC15:09
acolesmahatic: so if that dict has a key ['policies'], then cli recon effectively all_scan[url] = json.loads(dict with a 'policies' key in it) so all_scan[url]['policies'] is cool?15:11
mahaticacoles, yup! :) I was all the time looking at the middleware/recon.py So was confused in the way things are called. But that is not relevant here.15:13
mahaticacoles, thanks! :)15:13
acolesm_han: your test.conf works for me too. like i said check you have followed setup substituting with user 'med'15:14
acolesmahatic: ok!15:15
*** bkopilov has joined #openstack-swift15:23
*** david-lyle_afk is now known as david-lyle15:28
*** Nadeem has joined #openstack-swift15:41
*** nellysmitt has joined #openstack-swift15:45
*** Nadeem_ has joined #openstack-swift15:49
*** nellysmitt has quit IRC15:50
*** Nadeem_ has quit IRC15:50
*** Nadeem_ has joined #openstack-swift15:50
*** Nadeem has quit IRC15:53
*** tellesnobrega has quit IRC15:58
*** tellesnobrega has joined #openstack-swift15:59
*** doxavore has joined #openstack-swift16:03
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873616:09
*** jrichli has quit IRC16:10
*** jrichli has joined #openstack-swift16:11
*** donagh has quit IRC16:13
*** briancurtin has quit IRC16:13
*** matt__ has joined #openstack-swift16:14
*** zacksh has quit IRC16:14
*** jroll has quit IRC16:14
*** classicsnail has quit IRC16:14
*** CrackerJackMack has quit IRC16:14
*** mattoliverau has quit IRC16:14
*** zigo_ has quit IRC16:14
*** goodes has quit IRC16:14
*** zigo_ has joined #openstack-swift16:14
*** zacksh has joined #openstack-swift16:15
*** jroll has joined #openstack-swift16:15
*** CrackerJackMack has joined #openstack-swift16:16
*** classicsnail has joined #openstack-swift16:16
*** jroll has quit IRC16:16
*** jroll has joined #openstack-swift16:16
*** annegentle has quit IRC16:18
*** goodes has joined #openstack-swift16:19
*** briancurtin has joined #openstack-swift16:19
*** mahatic has quit IRC16:19
*** donagh has joined #openstack-swift16:23
*** nshaikh has left #openstack-swift16:26
*** SkyRocknRoll has joined #openstack-swift16:28
*** mahatic has joined #openstack-swift16:31
*** SkyRocknRoll has quit IRC16:37
*** SkyRocknRoll has joined #openstack-swift16:37
*** thumpba has joined #openstack-swift16:41
*** thumpba has quit IRC16:46
*** thumpba has joined #openstack-swift16:48
*** openstack has joined #openstack-swift16:55
*** thumpba has quit IRC16:57
*** gvernik has joined #openstack-swift17:05
*** rledisez has quit IRC17:15
*** jordanP has joined #openstack-swift17:16
*** SkyRocknRoll has quit IRC17:17
*** chlong has quit IRC17:21
openstackgerritTushar Gohad proposed openstack/swift: Bring EC API calls in sync with PyECLib 1.0  https://review.openstack.org/16353317:22
tsg_torgomatic, clayg, peluse: not sure yet if Jenkins has picked up the pyeclib update, but we'll need this ^^^ change once it does17:24
peluseOK17:31
*** tsg_ has quit IRC17:31
*** zhill has joined #openstack-swift17:34
*** bkopilov has quit IRC17:35
claygtsg_ does https://review.openstack.org/#/c/163533/1 also work with 0.98?17:36
*** bkopilov has joined #openstack-swift17:39
*** annegentle has joined #openstack-swift17:41
*** devlaps has joined #openstack-swift17:42
*** nellysmitt has joined #openstack-swift17:46
*** knl has quit IRC17:47
*** nellysmitt has quit IRC17:50
*** Trixboxer has quit IRC17:53
*** bkopilov has quit IRC17:55
*** bkopilov has joined #openstack-swift17:57
claygis this thing on?17:57
klrmn*tap* *tap*tap*17:58
clayghehe17:59
acolespeluse: if you haven't already applied it i am about to pusj another version of write_durable patch 16271718:00
patchbotacoles: https://review.openstack.org/#/c/162717/18:00
acolesthanks patchbot18:00
acolespeluse: assuming it passes local test ;)18:01
*** reed has joined #openstack-swift18:03
*** reed has quit IRC18:03
*** reed has joined #openstack-swift18:03
torgomaticNo meeting this week?18:04
*** remix_tj has quit IRC18:04
acolestorgomatic: nope notmyname cancelled18:07
acolestorgomatic: you'd be 53 mins early if there were :)18:07
torgomaticTo heck with everything about time changes. :p18:07
peluseacoles, heh, yeah I just applied it.  funny, this is the one that I was trying to add as a dependency the other day that was giving me fits.18:08
peluseacoles, and I was doing it for the reasons you state in the comments before you stated them :)18:08
peluse(git was giving me fits, not the code)18:08
acolespeluse: lol18:08
peluseacoles, about to test and see if .durable is now correctly restored on a reconstruction....18:09
acolespeluse: i just added an fsync in there, but noticed something else i'm not sure is right...hash_cleanup_listdir is called after data file is written but before durable, so nothing will be cleaned out :/ think we need to delay calling hash_cleanup_listdir til durable is in place?18:10
*** remix_tj has joined #openstack-swift18:10
peluseacoles, well, its called like all over the place though so isn't it the case that things will be cleaned up just not til next time someone calls it (because of a put or a reconstructor run or whatever)?18:11
acolespeluse: i guess so but it seems like a waste of a listdir if we know it won't actually clear out the older data files18:12
peluseacoles, yeah, true.  BTW, the test just now worked as expected18:13
acolespeluse: cool (re test). re HCL, I'll mull some more.18:13
peluseacoles, cool.  I've got a race condition I'm dealing with that I need to get back to that is killing me.  Will likely leave the .durable code as is for now until I figure out WTF is happening there18:16
acolespeluse: bummer18:16
openstackgerritAlistair Coles proposed openstack/swift: Diskfile decides if durable is written based on policy  https://review.openstack.org/16271718:17
*** gyee has joined #openstack-swift18:17
acolespeluse: ^^ latest. so torgomatic had some concern about this, which i am not disregarding, but wanted to add the fsync and error handling (which i hope i got right - clayg??)18:18
*** mahatic has quit IRC18:19
*** aix has quit IRC18:21
*** mmcardle has quit IRC18:21
*** remix_tj has quit IRC18:22
peluseacoles, OK thanks18:25
*** remix_tj has joined #openstack-swift18:26
acolesclayg: around?18:26
*** silor has quit IRC18:26
*** nellysmitt has joined #openstack-swift18:27
*** remix_tj has quit IRC18:36
*** remix_tj has joined #openstack-swift18:37
*** tsg_ has joined #openstack-swift18:37
*** jistr has quit IRC18:46
*** geaaru has quit IRC18:50
*** ho has joined #openstack-swift18:52
*** nellysmitt has quit IRC18:59
*** nellysmitt has joined #openstack-swift18:59
acolesclayg: nm, guess i missed you, maybe tomorrow.19:00
*** acoles is now known as acoles_away19:01
*** doxavore has quit IRC19:03
*** jordanP has quit IRC19:08
gvernikis there Swift meeting today?19:15
hogvernik: I checked the IRC log and today no meeting.19:17
hogvernik: 2015-03-10T15:31:53  <notmyname> reminder that there is no meeting tomorrow19:17
gvernikthanks19:17
*** gvernik has quit IRC19:22
*** dencaval has quit IRC19:31
*** thumpba_ has quit IRC19:31
tdasilvaclayg: around?19:34
torgomaticblah, ranged GETs are annoying19:38
torgomaticevery time I write a new test case I find a new bug :/19:38
*** Fin1te has joined #openstack-swift19:39
*** nellysmitt has quit IRC19:46
*** annegentle has quit IRC19:46
*** annegentle has joined #openstack-swift19:47
*** annegentle has quit IRC19:52
pelusetorgomatic, stop writing new tests then :)20:03
*** annegentle has joined #openstack-swift20:08
*** thumpba has joined #openstack-swift20:13
openstackgerritTushar Gohad proposed openstack/swift: Bring EC API calls in sync with PyECLib 1.0  https://review.openstack.org/16353320:24
*** silor has joined #openstack-swift20:25
*** silor has quit IRC20:30
*** delattec has quit IRC20:31
*** cdelatte has quit IRC20:31
claygpeluse: lol!20:31
claygacoles_away: tdasilva: nope, but am now20:31
openstackgerritpaul luse proposed openstack/swift: Erasure Code Reconstructor  https://review.openstack.org/13187220:35
*** jistr has joined #openstack-swift20:35
peluse ^ more rebase and bug fix.  should be some good stuff to talk about in addition to the multi FI patch over the next few days20:36
peluse.. and another half dozen good patches too!20:36
*** cdelatte has joined #openstack-swift20:42
notmynamehello20:57
pelusehola20:58
peluseback in CA yet?20:58
notmynamenope. waiting in the Philly airport.20:59
notmynamewill be a 6.5 hour flight home :-(20:59
peluseoh boy20:59
notmynamepeluse: since we didn't have the team meeting today, can you send me a quick email about EC status this week?21:00
pelusesure, or we can talk tomorrow afternoon in SanFran as there are a few things up in the air that we need to talk about wrt what/when/how21:01
peluseyour call21:01
notmynamepeluse: I can glean from trello and from what clayg and torgomatic have told me. just looking to send out my weekly summary in the morning21:05
peluseahh, OK.  I'll send a note to you and the two of them in case they want to add some detail/correct something21:07
*** tellesnobrega_ has joined #openstack-swift21:09
notmynamepeluse: I just forwarded you the email I was discussing it with them in. just add to it21:10
notmynamewell, whenever this really slow network gets around to sending the email21:10
*** jistr has quit IRC21:10
*** tellesnobrega_ has quit IRC21:11
matt__Morning21:24
homatto_: morning. your irc name is differenct from usual :)21:25
*** matt__ is now known as mattoliverau21:25
*** ChanServ sets mode: +v mattoliverau21:25
mattoliverauyeah, rackspace must have rebooted my quassel server again during the night21:26
homattoliverau: now you recovered.21:28
mattoliverauho: yup :)21:28
mattoliveraunotmyname: how's the ops summit going?21:28
openstackgerritSamuel Merritt proposed openstack/swift: EC: support single ranges for GET requests  https://review.openstack.org/16362021:29
*** Fin1te has quit IRC21:34
torgomaticnow to figure out how to demimulate object-server responses21:34
*** movielovers has joined #openstack-swift21:41
*** NM has quit IRC21:53
claygpeluse: I think i'm going to look at squashing policy-everywhere down with the multi fi patch - I think the fi patch does so much plubming of policy_index, only for policy-everywhere to go and replumb as policy it may well be just as easy to review in one change - anyway I'll look at the diff and put it up directly on feature/ec21:55
*** jkugel has quit IRC22:02
peluseclayg, I just got done going over your policy-everywhere patch in more detail and I agree22:03
peluseclayg, good call22:03
pelusemattoliverau, I believe notmyname is wheels-up right about now (or close to it anyways)22:04
clayghrmm... it is a little bigger22:04
peluseyeah, that's what she said22:04
*** jrichli has quit IRC22:05
*** annegentle has quit IRC22:05
*** ho__ has joined #openstack-swift22:12
*** Nadeem_ has quit IRC22:20
*** annegentle has joined #openstack-swift22:25
torgomaticdid something change in pyeclib-land recently? all my stuff is failing with "ImportError: No module named pyeclib.ec_iface"22:27
torgomaticpeluse: tsg_: ^^22:27
tsg_torgomatic: something jenkins is not happy about .. I have been looking at it22:28
tsg_about to push hopefully the final update22:28
torgomatictsg_: that's good; I'm glad someone with a clue is looking at it, because I'm staring at it like a dog watching a magic trick22:28
*** srsakhamuri has joined #openstack-swift22:29
tsg_torgomatic: yeah the slave logs are kind of pointless22:29
tsg_but I do think I know what's going on22:29
tsg_this library integration into debian/ubuntu/jenkins has been a PITA22:30
tsg_torgomatic: I will do rechecks on the stuff that failed22:30
torgomatictsg_: sounds good to me22:32
*** annegentle has quit IRC22:34
*** tellesnobrega_ has joined #openstack-swift22:40
*** tellesnobrega_ has quit IRC22:41
*** lcurtis has quit IRC22:42
openstackgerritSamuel Merritt proposed openstack/swift: EC: support single ranges for GET requests  https://review.openstack.org/16362022:48
*** panbalag has quit IRC22:53
*** echevemaster has joined #openstack-swift22:56
*** movielovers has left #openstack-swift22:57
notmynameback online (in the air)22:57
tsg_torgomatic: things looking better now https://jenkins02.openstack.org/job/gate-swift-python27/4311/console23:08
tsg_this is for https://review.openstack.org/#/c/163533/23:08
torgomatictsg_: ok, cool... so assuming that lands and then I rebase on it, I should be good, yes?23:08
tsg_yes23:09
torgomaticsweet!23:09
tsg_torgomatic: waiting for your review :)23:09
tsg_needless to say, in addition to the rebase, you'll need an update to pyeclib 1.0.3 off of pypi23:10
torgomatictsg_: I'll +2/+A it as soon as Jenkins is done with it23:10
tsg_thank you!23:10
torgomaticthat way I can get all these other patches back in action :)23:11
tsg_yep .. I am going to trigger rechecks as soon as 163533 is green23:11
*** thumpba_ has joined #openstack-swift23:13
*** thumpba has quit IRC23:15
*** annegentle has joined #openstack-swift23:32
*** chlong has joined #openstack-swift23:41
*** annegentle has quit IRC23:43
*** thumpba_ has quit IRC23:45
*** km has joined #openstack-swift23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!