| *** david-lyle_afk is now known as david-lyle | 00:10 | |
| openstackgerrit | Samuel Merritt proposed openstack/swift-specs: Spec for at-rest encryption. https://review.openstack.org/123220 | 00:11 |
|---|---|---|
| *** exploreshaifali has quit IRC | 00:12 | |
| *** Nadeem has quit IRC | 00:13 | |
| *** Viswanath has joined #openstack-swift | 00:17 | |
| *** Viswanath has quit IRC | 00:20 | |
| *** dmorita has joined #openstack-swift | 00:25 | |
| *** tellesnobrega_ has joined #openstack-swift | 00:28 | |
| *** tellesnobrega_ has quit IRC | 00:39 | |
| *** dmsimard_away is now known as dmsimard | 00:40 | |
| *** tellesnobrega_ has joined #openstack-swift | 00:40 | |
| *** tellesnobrega_ has quit IRC | 00:48 | |
| clayg | some core merge this for christs sake - https://review.openstack.org/#/c/129572/ | 00:51 |
| *** sungju has joined #openstack-swift | 01:03 | |
| *** dmsimard is now known as dmsimard_away | 01:20 | |
| *** RockKuo_Office has joined #openstack-swift | 01:21 | |
| *** gyee has quit IRC | 01:25 | |
| *** addnull has joined #openstack-swift | 01:25 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 01:30 |
| *** shri has quit IRC | 01:37 | |
| *** haomaiwang has joined #openstack-swift | 01:45 | |
| clayg | torgomatic: thanks | 01:46 |
| *** haomai___ has joined #openstack-swift | 01:51 | |
| *** haomaiwang has quit IRC | 01:51 | |
| *** tellesnobrega_ has joined #openstack-swift | 01:53 | |
| *** nosnos has joined #openstack-swift | 02:06 | |
| *** tellesnobrega_ has quit IRC | 02:07 | |
| *** david-lyle is now known as david-lyle_afk | 02:08 | |
| *** tellesnobrega_ has joined #openstack-swift | 02:17 | |
| *** tellesnobrega_ has quit IRC | 02:25 | |
| *** kyles_ne has joined #openstack-swift | 02:41 | |
| *** kyles_ne has quit IRC | 02:46 | |
| *** tellesnobrega_ has joined #openstack-swift | 02:59 | |
| *** addnull has quit IRC | 03:11 | |
| openstackgerrit | Merged openstack/python-swiftclient: Fix KeyError raised from client Connection https://review.openstack.org/128929 | 03:12 |
| *** addnull has joined #openstack-swift | 03:13 | |
| *** nosnos has quit IRC | 03:25 | |
| *** mahatic has quit IRC | 03:26 | |
| openstackgerrit | Merged openstack/python-swiftclient: Make swift post output an error message when failing https://review.openstack.org/129572 | 03:30 |
| clayg | elambert: ping, trying to figure out how to read ec headers from a fragment - i really want to know it's index | 03:40 |
| clayg | where "really" is only slightly greater than there's a pre-existing call that'll let me do it with pyeclib ;) | 03:41 |
| *** jyoti-ranjan has joined #openstack-swift | 03:48 | |
| *** nosnos has joined #openstack-swift | 03:57 | |
| elambert | clayg: well in theory you shouldn't have to care .. but libec does expose that … let me look at the current pyeclib | 04:03 |
| clayg | well, turns out I have to care in so much as I need to store only one copy of each fragment and I need to know what fragments I have | 04:04 |
| *** addnull has quit IRC | 04:05 | |
| elambert | fair'nuff | 04:05 |
| clayg | heh | 04:05 |
| clayg | thanks for being up! | 04:05 |
| elambert | yeah .. np | 04:05 |
| *** jdaggett has quit IRC | 04:05 | |
| *** jdaggett_ has joined #openstack-swift | 04:06 | |
| elambert | it looks like ECPyECLibDriver.get_metadata should do the tick | 04:08 |
| clayg | :returns: an opaque buffer | 04:10 |
| clayg | indeed I do not know what those bytes mean | 04:10 |
| clayg | is there a struct def somewhere in a .h file I could crib a struct unpack from? | 04:11 |
| elambert | there is in libec | 04:11 |
| elambert | typedef struct __attribute__((__packed__)) | 04:11 |
| elambert | fragment_metadata | 04:11 |
| elambert | { | 04:11 |
| elambert | uint32_t idx; /* 4 */ | 04:11 |
| elambert | uint32_t size; /* 4 */ | 04:11 |
| elambert | uint64_t orig_data_size; /* 8 */ | 04:11 |
| elambert | uint8_t chksum_type; /* 1 */ | 04:11 |
| elambert | uint32_t chksum[LIBERASURECODE_MAX_CHECKSUM_LEN]; /* 32 */ | 04:11 |
| elambert | uint8_t chksum_mismatch; /* 1 */ | 04:11 |
| elambert | uint8_t backend_id; /* 1 */ | 04:11 |
| elambert | uint32_t backend_version; /* 4 */ | 04:11 |
| elambert | } fragment_metadata_t; | 04:11 |
| *** jd__` has joined #openstack-swift | 04:11 | |
| elambert | whoops .. should have gisted that | 04:12 |
| *** tristanC_ has joined #openstack-swift | 04:12 | |
| *** RockKuo_ has joined #openstack-swift | 04:12 | |
| *** mordred_ has joined #openstack-swift | 04:12 | |
| *** Tyger_ has joined #openstack-swift | 04:12 | |
| *** zaitcev has quit IRC | 04:12 | |
| *** mhu has quit IRC | 04:12 | |
| *** EmilienM has quit IRC | 04:12 | |
| *** vishy has quit IRC | 04:12 | |
| *** ahale has quit IRC | 04:12 | |
| *** ondergetekende has quit IRC | 04:12 | |
| *** acoles_away has quit IRC | 04:12 | |
| *** sileht has quit IRC | 04:12 | |
| *** RockKuo_Office has quit IRC | 04:12 | |
| *** mitz_ has quit IRC | 04:12 | |
| *** nottrobin has quit IRC | 04:12 | |
| *** mordred has quit IRC | 04:12 | |
| *** IRTermite has quit IRC | 04:12 | |
| *** tristanC has quit IRC | 04:12 | |
| *** Tyger has quit IRC | 04:12 | |
| *** jd__ has quit IRC | 04:12 | |
| *** JelleB has quit IRC | 04:12 | |
| *** mitz has quit IRC | 04:12 | |
| *** dvorkbjel has quit IRC | 04:12 | |
| *** jd__` is now known as jd__ | 04:12 | |
| *** IRTermite1 has joined #openstack-swift | 04:12 | |
| *** nottrobin_ has joined #openstack-swift | 04:12 | |
| *** nottrobin_ has joined #openstack-swift | 04:12 | |
| *** mordred_ is now known as mordred | 04:12 | |
| *** mhu1 has joined #openstack-swift | 04:12 | |
| *** mitz has joined #openstack-swift | 04:12 | |
| clayg | or tell me the file in liberasurecode ;) | 04:12 |
| *** mhu1 is now known as mhu | 04:12 | |
| elambert | erasurecode.h | 04:12 |
| *** JelleB has joined #openstack-swift | 04:12 | |
| elambert | idx is the field you care about | 04:13 |
| elambert | given your usecase .. we should probably exposes in pyeclib | 04:13 |
| *** ondergetekende has joined #openstack-swift | 04:14 | |
| *** ahale has joined #openstack-swift | 04:14 | |
| *** EmilienM has joined #openstack-swift | 04:14 | |
| *** dvorkbjel has joined #openstack-swift | 04:15 | |
| clayg | is this the right repo -> git@bitbucket.org:elambert/liberasurecode.git | 04:15 |
| *** kyles_ne has joined #openstack-swift | 04:16 | |
| elambert | this is | 04:16 |
| elambert | https://bitbucket.org/tsg-/liberasurecode | 04:16 |
| *** vishy has joined #openstack-swift | 04:16 | |
| clayg | i think i found yours from a link in the README on pyeclib | 04:16 |
| elambert | yikes | 04:16 |
| *** kyles_ne has quit IRC | 04:17 | |
| clayg | k this is great, just what I needed <hugs> | 04:18 |
| elambert | I'm gonna fix that now (the reference that is) we abandoned that repo a while go | 04:18 |
| elambert | sorry for the confusion | 04:18 |
| *** acoles_away has joined #openstack-swift | 04:18 | |
| *** acoles_away is now known as acoles | 04:19 | |
| *** ChanServ sets mode: +v acoles | 04:19 | |
| *** zaitcev has joined #openstack-swift | 04:20 | |
| *** ChanServ sets mode: +v zaitcev | 04:20 | |
| *** sileht has joined #openstack-swift | 04:22 | |
| clayg | no worries, still a bit confused on what get_metadata is returning exactly | 04:26 |
| elambert | each fragment has a metadata header that contains info needed by libec to decode the fragment .. that's what its returning | 04:27 |
| elambert | I can describe each member of the header if you are interested | 04:29 |
| clayg | well, what I have installed is returning 20 bytes - which doesn't seem big enough for that struct | 04:29 |
| *** kyles_ne has joined #openstack-swift | 04:29 | |
| elambert | that aint right | 04:29 |
| elambert | let me look closer at what the method is doing | 04:32 |
| clayg | i think i just have an old version of libec installed maybe? | 04:32 |
| elambert | could be .. libec has gone through a lot of churn | 04:33 |
| elambert | how did you install it? | 04:34 |
| clayg | don't really recall - I think it got built when I installed pyeclib | 04:34 |
| elambert | hmm .. once upoin a time pyeclib built libec from source .. but we are moving away from that | 04:36 |
| *** rawat_vedams has joined #openstack-swift | 04:37 | |
| elambert | to be honest, i've been focusing mainly on the libec side of stuff … so not really sure what's up with pyeclib side .. let me see if tushar is around somewhere | 04:37 |
| clayg | well, anyway - I guess I need to know what version of libec I've got built and how it's building - and I also need to get a feature against pyeclib to expose the unpacked fragment_metadata_t struct rather than just the raw bytes | 04:39 |
| *** tsg has joined #openstack-swift | 04:39 | |
| elambert | tsg! | 04:39 |
| *** tsg_ has joined #openstack-swift | 04:39 | |
| *** tsg_ has quit IRC | 04:39 | |
| tsg | elambert: what's up | 04:40 |
| clayg | that's probably about all I got for the night - just sort of picking at it I've got something in bytes 4-8 that look a lot like the unsigned int representing the index - so dunno why the first 4 bytes of padding are doing - or why the rest are all zeros :\ | 04:40 |
| elambert | so clayg is trying to trouble shoot some issues with pyeclib | 04:40 |
| elambert | long story short .. what's the latest pyeclib that has been "released" | 04:41 |
| clayg | meh, maybe it's no so bad - like I said I need to know what i've got for libec on this box, and I need to make a feature request against pyeclib - that may be it | 04:41 |
| elambert | and how does it pull in libec | 04:41 |
| clayg | PyECLib==0.9.8 installed | 04:41 |
| elambert | ah .. i think we have 0.9.10 now? | 04:42 |
| tsg | elambert: I haven't pushed 0.9.10 to PyPi yet | 04:42 |
| clayg | yeah there's a tag for that in the repo | 04:42 |
| tsg | clayg: can you try to build off of git? | 04:42 |
| clayg | tsg: i do get the feeling at some point I'ma wanna suss that | 04:43 |
| elambert | tsg .. did 9.8 pull libec from kevin's repo? | 04:43 |
| tsg | yes - | 04:43 |
| elambert | ah | 04:43 |
| tsg | (clayg: what's the feature request btw?) | 04:43 |
| tsg | clayg: we are close to 1.0 so 0.9.10 wasn't pushed | 04:43 |
| tsg | I think I should push that | 04:44 |
| clayg | tsg unpack fragment_metadata_t when you call get_metadata instead of just returning the raw bytes | 04:44 |
| tsg | clayg: good call .. that will certainly be useful | 04:44 |
| clayg | trello or issue on bitbucket? | 04:45 |
| tsg | Trello is good | 04:45 |
| elambert | bugzilla :-P | 04:45 |
| * elambert was tyring to be funny | 04:45 | |
| tsg | :) | 04:45 |
| tsg | clayg: I assume you were trying to inspect individual EC fragments in FAs | 04:46 |
| tsg | and it was a bit tricky to make sense of the metadata .. | 04:47 |
| *** kota_ has joined #openstack-swift | 04:50 | |
| clayg | yeah, sorta, the patch I was looking at was just not doing the right thing - it didn't know it - but the fragment archives did | 04:50 |
| clayg | so is the correct and current repo -> git@bitbucket.org:tsg-/liberasurecode.git | 04:51 |
| tsg | yep | 04:51 |
| tsg | and master on https://tsg-@bitbucket.org/kmgreen2/pyeclib.git | 04:52 |
| tsg | s/tsg-/git/ | 04:52 |
| *** tellesnobrega_ has quit IRC | 04:52 | |
| tsg | clayg: I assume you have Jerasure 2.0 installed already - that repo is down at the moment | 04:57 |
| clayg | hrm... yeah not sure | 05:01 |
| clayg | i was able to build liberasurecode, and then setup.py install pylibec, but my swift doesn't work because it doesn't like the signature on ECDriver | 05:02 |
| tsg | clayg: pyeclib until 0.9.8 would pull it automatically .. Debian guys made us change that | 05:02 |
| clayg | oic | 05:02 |
| clayg | yeah it's gunna be a pita to package al this | 05:03 |
| tsg | clayg: in touch with Zigo to figure that out | 05:03 |
| clayg | library_import_str ? | 05:05 |
| *** zaitcev has quit IRC | 05:06 | |
| clayg | oh you done gone and implemented a python plugin system without using package resources entry points didnt' you | 05:08 |
| *** addnull has joined #openstack-swift | 05:09 | |
| *** bkopilov has joined #openstack-swift | 05:09 | |
| tsg | clayg: wasn't the plan - something seems amiss - give me until the morning to sort it out | 05:09 |
| tsg | :) | 05:09 |
| clayg | awww man this is all fucked up - what'd you guys do to me? "just go build the latest from source, it'll be better, trust us" :P | 05:09 |
| tsg | clayg: one reason why this isn't on pypi yet | 05:09 |
| clayg | AttributeError: 'ECDriver' object has no attribute 'min_parity_fragments_needed' | 05:09 |
| clayg | heh | 05:09 |
| clayg | yeah np, I didn't even mean to be doing this right now - all I wanted was the fa index - got that - then got side tracked trying to figure out all of this - i should just stick up in swift - better for everyone probably | 05:11 |
| tsg | clayg: let's just stick to 0.9.8 for now - I need to look at why the API was reverted to an old version | 05:12 |
| tsg | I will drop you a note | 05:12 |
| clayg | kthxbai | 05:14 |
| *** ppai has joined #openstack-swift | 05:28 | |
| briancline | well, crap, that answers that question: https://blueprints.launchpad.net/tempest/+spec/swift-test-without-keystone | 05:38 |
| briancline | the qa meeting logs from 2014-12 show discussion of it not really going anywhere | 05:39 |
| briancline | um. 2013-12 | 05:41 |
| briancline | so by way of that requirement, defcore essentially means "you must be using keystone for anything" | 05:41 |
| briancline | what a crock, imho | 05:53 |
| *** k4n0 has joined #openstack-swift | 06:09 | |
| *** SkyRocknRoll has joined #openstack-swift | 06:17 | |
| *** SkyRocknRoll has joined #openstack-swift | 06:17 | |
| *** mmcardle1 has quit IRC | 06:23 | |
| *** nshaikh has joined #openstack-swift | 06:36 | |
| *** cbaesema has quit IRC | 06:38 | |
| *** cbaesema has joined #openstack-swift | 06:42 | |
| openstackgerrit | Prashanth Pai proposed openstack/swift: fsync() on directories https://review.openstack.org/126923 | 06:42 |
| *** kyles_ne has quit IRC | 06:52 | |
| *** ppai has quit IRC | 06:55 | |
| *** ppai has joined #openstack-swift | 07:15 | |
| *** elambert has quit IRC | 07:17 | |
| *** mkollaro has joined #openstack-swift | 07:19 | |
| *** sungju has quit IRC | 07:27 | |
| mattoliverau | Greetings from the south of France :) | 07:27 |
| *** mkollaro has quit IRC | 07:31 | |
| *** tsg has quit IRC | 07:59 | |
| *** nellysmitt has joined #openstack-swift | 08:01 | |
| *** foexle has joined #openstack-swift | 08:13 | |
| *** bkopilov has quit IRC | 08:21 | |
| *** geaaru has joined #openstack-swift | 08:36 | |
| *** bkopilov has joined #openstack-swift | 08:37 | |
| *** foexle_ has joined #openstack-swift | 08:57 | |
| *** foexle has quit IRC | 08:59 | |
| *** bkopilov has quit IRC | 09:01 | |
| *** exploreshaifali has joined #openstack-swift | 09:05 | |
| *** RockKuo_ has quit IRC | 09:11 | |
| *** ppai has quit IRC | 09:14 | |
| *** bkopilov has joined #openstack-swift | 09:16 | |
| *** exploreshaifali has quit IRC | 09:18 | |
| *** jyoti-ranjan has quit IRC | 09:23 | |
| *** RockKuo_ has joined #openstack-swift | 09:24 | |
| *** ppai has joined #openstack-swift | 09:28 | |
| *** jordanP has joined #openstack-swift | 09:29 | |
| *** exploreshaifali has joined #openstack-swift | 09:29 | |
| *** jyoti-ranjan has joined #openstack-swift | 09:31 | |
| *** jistr has joined #openstack-swift | 09:34 | |
| *** addnull has quit IRC | 09:34 | |
| *** joeljwright has joined #openstack-swift | 09:44 | |
| *** kyles_ne has joined #openstack-swift | 09:52 | |
| *** RockKuo_ has quit IRC | 09:53 | |
| *** kyles_ne has quit IRC | 09:57 | |
| *** sluo_laptop has quit IRC | 09:58 | |
| *** RockKuo_ has joined #openstack-swift | 10:06 | |
| *** aix has joined #openstack-swift | 10:07 | |
| *** ujjain has quit IRC | 10:11 | |
| *** ujjain has joined #openstack-swift | 10:11 | |
| *** MasterPiece has quit IRC | 10:15 | |
| *** mmcardle has joined #openstack-swift | 10:20 | |
| *** haomai___ has quit IRC | 10:33 | |
| *** haomaiwang has joined #openstack-swift | 10:34 | |
| *** tellesnobrega_ has joined #openstack-swift | 10:35 | |
| *** mmcardle has quit IRC | 10:39 | |
| *** mmcardle has joined #openstack-swift | 10:41 | |
| rawat_vedams | hi guys.. | 10:49 |
| *** exploreshaifali has quit IRC | 10:54 | |
| rawat_vedams | when i am starting storage node services Unable to locate config for object-expirer is it necessary to add object-expirer.conf file . | 10:55 |
| rawat_vedams | if i will not add this configuration file then what effect will happen to my swift storage node...? | 10:57 |
| *** tellesnobrega_ has quit IRC | 10:59 | |
| *** nellysmitt has quit IRC | 11:00 | |
| *** nellysmi_ has joined #openstack-swift | 11:01 | |
| *** joeljwright has quit IRC | 11:01 | |
| *** mkollaro has joined #openstack-swift | 11:04 | |
| rawat_vedams | hi friends | 11:04 |
| rawat_vedams | when i am starting storage node services Unable to locate config for object-expirer is it necessary to add object-expirer.conf file | 11:05 |
| rawat_vedams | if i will not add this configuration file then what effect will happen to my swift storage node...? | 11:05 |
| *** aix has quit IRC | 11:09 | |
| *** haomaiwang has quit IRC | 11:10 | |
| *** RockKuo_ has quit IRC | 11:11 | |
| openstackgerrit | Alistair Coles proposed openstack/python-swiftclient: Make preauth params work https://review.openstack.org/130711 | 11:12 |
| openstackgerrit | Merged openstack/swift-specs: Composite Authorization and Service Accounts https://review.openstack.org/105228 | 11:25 |
| *** aix has joined #openstack-swift | 11:25 | |
| openstackgerrit | Daniel Wakefield proposed openstack/python-swiftclient: Add unit tests for _encode_meta_headers https://review.openstack.org/133052 | 11:32 |
| *** nosnos has quit IRC | 11:34 | |
| *** nosnos has joined #openstack-swift | 11:34 | |
| *** nosnos has quit IRC | 11:39 | |
| *** mahatic has joined #openstack-swift | 11:44 | |
| *** mmcardle has quit IRC | 11:54 | |
| *** joeljwright has joined #openstack-swift | 11:54 | |
| *** joeljwright has quit IRC | 11:56 | |
| *** dmsimard_away is now known as dmsimard | 11:57 | |
| *** lpabon has joined #openstack-swift | 12:07 | |
| *** kota_ has quit IRC | 12:11 | |
| *** jyoti-ranjan has quit IRC | 12:12 | |
| openstackgerrit | Alistair Coles proposed openstack/python-swiftclient: Fix cross account upload using --os-storage-url https://review.openstack.org/125759 | 12:15 |
| openstackgerrit | Alistair Coles proposed openstack/python-swiftclient: Capture test output better https://review.openstack.org/131238 | 12:15 |
| *** tdasilva has quit IRC | 12:19 | |
| *** dmorita has quit IRC | 12:28 | |
| *** erlon has quit IRC | 12:39 | |
| *** rawat_vedams has quit IRC | 12:42 | |
| *** lpabon has quit IRC | 12:50 | |
| *** lpabon has joined #openstack-swift | 12:51 | |
| *** aix has quit IRC | 13:01 | |
| *** joeljwright has joined #openstack-swift | 13:01 | |
| *** mmcardle has joined #openstack-swift | 13:01 | |
| *** aix has joined #openstack-swift | 13:04 | |
| *** SkyRocknRoll has quit IRC | 13:07 | |
| *** nellysmi_ has quit IRC | 13:19 | |
| *** ppai has quit IRC | 13:29 | |
| *** miqui has joined #openstack-swift | 13:31 | |
| openstackgerrit | Alistair Coles proposed openstack/python-swiftclient: Suppress 'No handlers...' message from keystoneclient logger https://review.openstack.org/134207 | 13:37 |
| openstackgerrit | Alistair Coles proposed openstack/python-swiftclient: Suppress 'No handlers...' message from keystoneclient logger https://review.openstack.org/134207 | 13:38 |
| *** aix has quit IRC | 13:40 | |
| *** bkopilov has quit IRC | 13:44 | |
| *** nshaikh has quit IRC | 13:44 | |
| *** tdasilva has joined #openstack-swift | 13:44 | |
| *** mahatic has quit IRC | 13:46 | |
| *** mahatic has joined #openstack-swift | 13:46 | |
| *** SkyRocknRoll has joined #openstack-swift | 13:47 | |
| openstackgerrit | Donagh McCabe proposed openstack/swift-specs: Adds Object Storage v1 API specification information https://review.openstack.org/129384 | 13:50 |
| *** X019 has joined #openstack-swift | 13:50 | |
| *** X019 has quit IRC | 13:52 | |
| tdasilva | interesting...just came accross this link: http://webnumbr.com/open-swift-bugs | 13:53 |
| *** jistr has quit IRC | 13:53 | |
| *** aix has joined #openstack-swift | 13:54 | |
| *** jistr has joined #openstack-swift | 13:54 | |
| cschwede | tdasilva: uh, that one looks awful! | 14:06 |
| tdasilva | cschwede: yeah, it looks quite the steady climb since apr'13 | 14:07 |
| *** haomaiwa_ has joined #openstack-swift | 14:08 | |
| jokke_ | tdasilva: open-glance-bugs does not look any better ;) | 14:09 |
| *** k4n0 has quit IRC | 14:10 | |
| tdasilva | jokke_: yeah, did you see nova? over 1000 | 14:11 |
| tdasilva | cschwede, jokke_: the interesting thing is that it seems that there was a trigger event on apr'13 that sent numbers climbing | 14:14 |
| *** joe__ has quit IRC | 14:15 | |
| cschwede | tdasilva: yes, you’re right. and quickly going over https://bugs.launchpad.net/swift it looks a lot of bugs are cross-project, for example tests that failed in tempest | 14:16 |
| *** tsg has joined #openstack-swift | 14:16 | |
| *** joe__ has joined #openstack-swift | 14:16 | |
| *** mmcardle has quit IRC | 14:17 | |
| tdasilva | cschwede: oh, so maybe there was a effort starting in that release ( grizzly or havana I'm assuming) to start cross-project testing? | 14:17 |
| *** joe__ has quit IRC | 14:19 | |
| *** wolsen has quit IRC | 14:19 | |
| *** wolsen has joined #openstack-swift | 14:19 | |
| cschwede | tdasilva: not sure, but sounds reasonable to me. but at that point in time more and more swift tests were also added to tempest, and sometimes there are/were race conditions - thus more bug reports | 14:21 |
| cschwede | tdasilva: iirc, sometime ago the infra team asked to use „reckeck bug #123“ rechecks, so people started to add more bug reports to retrigger tests | 14:22 |
| *** joe__ has joined #openstack-swift | 14:23 | |
| cschwede | anyways, we should try to lower the number and check which reports are actual „real“ bugs | 14:23 |
| tdasilva | cschwede: so tempest creates bug reports automatically? wasn't aware of that...but yes, I agree we should try to lower the number... | 14:25 |
| cschwede | tdasilva: no, not automatically | 14:25 |
| cschwede | but more bug reports were added because of the policy to add a bug number in case of a recheck | 14:26 |
| *** joeljwright has quit IRC | 14:31 | |
| tdasilva | cschwede: got it | 14:31 |
| *** mmcardle has joined #openstack-swift | 14:36 | |
| *** joeljwright has joined #openstack-swift | 14:37 | |
| joe__ | cschwede: Hi, just continue with the issue of where after a quarantine item is replicated back by another node, so far what I have done is that whatever server syncs back the miss matched path file I would just restart that node, so far I have restarted almost all of them, it does not seem to address the issue, however I will keep restarting so far I haven't seen the same node replicating back, it is random | 14:43 |
| *** lpabon has quit IRC | 14:51 | |
| *** geaaru has quit IRC | 14:53 | |
| *** jistr has quit IRC | 15:06 | |
| *** jistr has joined #openstack-swift | 15:07 | |
| *** tsg has quit IRC | 15:16 | |
| *** lcurtis has joined #openstack-swift | 15:21 | |
| *** mmcardle has quit IRC | 15:22 | |
| swifterdarrell | joe__: thanks for digging into this further... has any node you've rebooted copied any file back to the wrong place again? | 15:23 |
| joe__ | swifterdarrell: no so far | 15:23 |
| swifterdarrell | joe__: k, so there's some chance that the problem will go away once the last node has been rebooted? | 15:24 |
| * swifterdarrell has fingers crossed | 15:24 | |
| joe__ | swifterdarrell: I was wondering if there ia a large number of objects like this and the auditor takes too long to complete is it possible the object-replicator would just copy it back? | 15:25 |
| swifterdarrell | joe__: I think that unless an object-replicator had the bad swift.conf values loaded (imported) into memory, it wouldn't copy them to incorrect locations | 15:26 |
| swifterdarrell | joe__: (did I misunderstand your quesiton?) | 15:26 |
| joe__ | swifterdarrell: okay I will wait, however I am restarting both nodes, the ones that did and did not have the bad swift.conf values | 15:27 |
| swifterdarrell | joe__: have you seen any node which never had the bad swift.conf values replicate a file to the wrong place? | 15:28 |
| joe__ | swifterdarrell: Yes I have seen it | 15:29 |
| *** mkollaro has quit IRC | 15:33 | |
| joe__ | swifterdarrell: that is why I asked maybe because it is a large set of objects it takes too long for the auditor and therefore it doesn't qurantine in all nodes at the same time, and the replicator just replicates it because it was missing, etc... | 15:33 |
| *** mmcardle has joined #openstack-swift | 15:35 | |
| *** annegent_ has joined #openstack-swift | 15:35 | |
| *** Nadeem has joined #openstack-swift | 15:49 | |
| *** jistr has quit IRC | 15:53 | |
| swifterdarrell | joe__: (cc cschwede) hopefully the replicator doesn't blindly copy an object based on where it was in the fs, but rather based on the hash of its name? I think that's the sort of thing cschwede checked in the code yesterday? | 15:55 |
| swifterdarrell | joe__: if the situation doesn't resolve with 100% certainty that no swift daemon has bad swift.conf data in memory (e.g. their swift.conf files have been sanity-checked and the server rebooted), then there may still be some mechanism of bad behavior we haven't thought of which bears investigation | 15:56 |
| *** lpabon has joined #openstack-swift | 15:57 | |
| *** nshaikh has joined #openstack-swift | 16:13 | |
| *** exploreshaifali has joined #openstack-swift | 16:15 | |
| *** dmsimard is now known as dmsimard_away | 16:26 | |
| *** dmsimard_away is now known as dmsimard | 16:34 | |
| *** annegent_ has quit IRC | 16:37 | |
| *** annegent_ has joined #openstack-swift | 16:38 | |
| *** jistr has joined #openstack-swift | 16:51 | |
| clayg | man jenkins is on a tear this morning | 16:51 |
| *** SkyRocknRoll has quit IRC | 16:55 | |
| *** tsg has joined #openstack-swift | 16:57 | |
| *** david-lyle_afk is now known as david-lyle | 16:58 | |
| clayg | gasp! we've landed TWO specs now! | 16:59 |
| *** kyles_ne has joined #openstack-swift | 17:00 | |
| *** kyles_ne has quit IRC | 17:02 | |
| *** kyles_ne has joined #openstack-swift | 17:03 | |
| peluse | clayg, did you ever by chance run probetests on your SAIO with 8 devices? | 17:04 |
| *** miqui has quit IRC | 17:08 | |
| *** miqui has joined #openstack-swift | 17:11 | |
| *** X019 has joined #openstack-swift | 17:12 | |
| *** aix has quit IRC | 17:16 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/89250 | 17:16 |
| openstackgerrit | paul luse proposed openstack/swift-specs: Quick note about the reconstructor section being WIP so stale information isn't read here over the next few weeks... https://review.openstack.org/134306 | 17:18 |
| *** mtreinish has quit IRC | 17:19 | |
| *** tellesnobrega_ has joined #openstack-swift | 17:22 | |
| *** foexle has joined #openstack-swift | 17:31 | |
| *** jistr has quit IRC | 17:32 | |
| *** openstackgerrit has quit IRC | 17:34 | |
| *** openstackgerrit has joined #openstack-swift | 17:34 | |
| *** exploreshaifali has quit IRC | 17:35 | |
| *** jordanP has quit IRC | 17:36 | |
| *** nellysmitt has joined #openstack-swift | 17:38 | |
| *** nshaikh has quit IRC | 17:41 | |
| *** exploreshaifali has joined #openstack-swift | 17:41 | |
| *** mmcardle has quit IRC | 18:01 | |
| *** openstackgerrit has quit IRC | 18:03 | |
| *** openstackgerrit has joined #openstack-swift | 18:04 | |
| *** joeljwright has quit IRC | 18:04 | |
| *** annegent_ has quit IRC | 18:12 | |
| *** annegent_ has joined #openstack-swift | 18:13 | |
| *** mahatic has quit IRC | 18:13 | |
| *** nshaikh has joined #openstack-swift | 18:13 | |
| *** lpabon has quit IRC | 18:14 | |
| acoles | peluse: ^^ so your spec commit title says it all :) | 18:18 |
| *** tellesnobrega has quit IRC | 18:19 | |
| *** tellesnobrega_ has quit IRC | 18:20 | |
| *** lpabon has joined #openstack-swift | 18:20 | |
| *** mahatic has joined #openstack-swift | 18:27 | |
| *** foexle has quit IRC | 18:30 | |
| *** zaitcev has joined #openstack-swift | 18:31 | |
| *** ChanServ sets mode: +v zaitcev | 18:31 | |
| *** X019 has quit IRC | 18:33 | |
| *** foexle has joined #openstack-swift | 18:37 | |
| *** nellysmitt has quit IRC | 18:39 | |
| *** X019 has joined #openstack-swift | 18:46 | |
| *** annegent_ has quit IRC | 18:49 | |
| *** openstackgerrit has quit IRC | 18:49 | |
| *** openstackgerrit has joined #openstack-swift | 18:49 | |
| *** tellesnobrega has joined #openstack-swift | 18:50 | |
| *** tellesnobrega_ has joined #openstack-swift | 18:50 | |
| clayg | peluse: yeah doesn't work ;) | 18:53 |
| clayg | peluse: one line note saying everything is fucked - now that's a spec update I can get behind! | 18:56 |
| openstackgerrit | Merged openstack/swift-specs: Quick note about the reconstructor section being WIP so stale information isn't read here over the next few weeks... https://review.openstack.org/134306 | 19:06 |
| *** nellysmitt has joined #openstack-swift | 19:14 | |
| *** Poe_ has joined #openstack-swift | 19:15 | |
| peluse | clayg, you like that huh? :) | 19:17 |
| peluse | will take a look at the probe failures now, really want everyone doing EV dev on the same ring setup and EC scheme now that PUT works | 19:17 |
| *** openstackgerrit has quit IRC | 19:18 | |
| *** openstackgerrit has joined #openstack-swift | 19:19 | |
| peluse | argh... EC of course (not EV, don't know what that is) | 19:19 |
| *** shri has joined #openstack-swift | 19:22 | |
| *** annegent_ has joined #openstack-swift | 19:24 | |
| *** exploreshaifali has quit IRC | 19:25 | |
| *** acoles is now known as acoles_away | 19:35 | |
| *** mahatic has quit IRC | 19:47 | |
| openstackgerrit | Thiago da Silva proposed openstack/swift: initial version of object version middleware https://review.openstack.org/134347 | 19:51 |
| *** openstackgerrit has quit IRC | 20:04 | |
| *** openstackgerrit has joined #openstack-swift | 20:05 | |
| *** kyles_ne has quit IRC | 20:08 | |
| clayg | tdasilva: are you pulling object versioning out to middleware!? | 20:12 |
| tdasilva | tdasilva: yeah, that was the plan...thoughts? | 20:12 |
| clayg | that's awesome! can't wait to review - why is it the "initial" version and not the "final" version? | 20:13 |
| tdasilva | hehehe...i should have said initial draft | 20:13 |
| clayg | ... interesting | 20:13 |
| tdasilva | I just wanted to get a first impression from you guys to make sure I was on the right path | 20:13 |
| tdasilva | skipped all the tests, docs and everything else | 20:14 |
| clayg | tdasilva: oic, cool - well hopefully we can get some feedback early - nice work | 20:14 |
| tdasilva | thanks, yeah, I did some manual testing and it works ok. The pieces I'm still unclear is on the container side of the code | 20:15 |
| tdasilva | I think there is some code there to handle the header, but I'm not sure if that should be pulled to the middleware | 20:16 |
| tdasilva | I'm guessing not | 20:16 |
| tdasilva | I think there's some code on the object-servers too, but don't think that should be touched either | 20:16 |
| openstackgerrit | Thiago da Silva proposed openstack/swift: object versioning middleware https://review.openstack.org/134347 | 20:18 |
| tdasilva | clayg: ^^^ better title | 20:18 |
| *** tellesnobrega_ has quit IRC | 20:21 | |
| clayg | tdasilva: how's our functional test coverage of versioned objects? | 20:21 |
| *** exploreshaifali has joined #openstack-swift | 20:26 | |
| tdasilva | clayg: I did not look too closely yet to be honest. I noticed there was only one test there that gets called multiple times (e.g., UTF8, cross-policy, etc) | 20:35 |
| *** annegent_ has quit IRC | 20:36 | |
| *** annegent_ has joined #openstack-swift | 20:37 | |
| *** annegent_ has quit IRC | 20:51 | |
| *** nellysmitt has quit IRC | 20:55 | |
| *** annegent_ has joined #openstack-swift | 21:03 | |
| *** abhirc has quit IRC | 21:03 | |
| *** kyles_ne has joined #openstack-swift | 21:09 | |
| *** kyles_ne has quit IRC | 21:13 | |
| *** kyles_ne has joined #openstack-swift | 21:14 | |
| *** openstackgerrit has quit IRC | 21:19 | |
| *** openstackgerrit has joined #openstack-swift | 21:19 | |
| *** nshaikh has left #openstack-swift | 21:22 | |
| *** foexle has quit IRC | 21:23 | |
| *** lpabon has quit IRC | 21:25 | |
| *** tdasilva has quit IRC | 21:43 | |
| openstackgerrit | Anne Gentle proposed openstack/swift-specs: Adds Object Storage v1 API specification information https://review.openstack.org/129384 | 21:57 |
| *** annegent_ has quit IRC | 22:08 | |
| *** tellesnobrega_ has joined #openstack-swift | 22:08 | |
| *** annegent_ has joined #openstack-swift | 22:11 | |
| openstackgerrit | Anne Gentle proposed openstack/swift-specs: Adds Object Storage v1 API specification information https://review.openstack.org/129384 | 22:26 |
| *** joeljwright has joined #openstack-swift | 22:31 | |
| *** gyee has joined #openstack-swift | 22:37 | |
| peluse | clayg, I didn't fully root cause the issue w/probetests and >4 devices on the ring but clearly someone had a guard against it, VALIDATE_RSYNC, that will result in skipping pretty much all the probe tests because of not using 3x repl and/or not using 4 devices | 22:38 |
| peluse | see get_ring() in common.py of probe tests... | 22:38 |
| clayg | peluse: yes | 22:39 |
| peluse | so for now I'll push the SAIO env w/proper EC settings that we can all use for EC dev work knowing that there's a shitpile of probetest work to do (well we knew that already). Coming here in just a minute | 22:39 |
| openstackgerrit | paul luse proposed openstack/swift: SAIO updates to support EC development environment. https://review.openstack.org/128154 | 22:45 |
| peluse | ^ now configured for 4+2+2 w/8 devices on EC ring and still 4 servers.... (instead of before 5 servers 1 device each for 2+1+2) | 22:46 |
| *** ahonda has quit IRC | 22:52 | |
| *** hondak has joined #openstack-swift | 22:52 | |
| *** Nadeem has quit IRC | 22:53 | |
| clayg | peluse: hey that sounds pretty good, i've been doing 4 servers with 12 drives | 22:55 |
| openstackgerrit | Anne Gentle proposed openstack/swift-specs: Adds Object Storage v1 API specification information https://review.openstack.org/129384 | 22:58 |
| *** joeljwright has quit IRC | 23:03 | |
| *** foexle_ has quit IRC | 23:09 | |
| *** dmsimard is now known as dmsimard_away | 23:22 | |
| *** exploreshaifali has quit IRC | 23:46 | |
| *** annegent_ has quit IRC | 23:56 | |
| *** annegent_ has joined #openstack-swift | 23:58 | |
| *** lcurtis has quit IRC | 23:59 | |
| *** annegent_ has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!