| notmyname | so 16.04 just doubled our inode memory usage? fun | 00:00 |
|---|---|---|
| mattoliverau | hosanai: morning | 00:00 |
| timburke | notmyname: install/format with trusty, then upgrade to xenial? sounds like fun! | 00:01 |
| mattoliverau | lol | 00:01 |
| notmyname | timburke: what could go wrong?! | 00:01 |
| notmyname | yeah, I hadn't even thought of that (surely you'd just wipe and reinstall clean, right?) | 00:02 |
| notmyname | the CRC thing in the error is interesting | 00:02 |
| notmyname | ah ha! | 00:03 |
| notmyname | By default, mkfs.xfs will enable metadata CRCs. | 00:03 |
| notmyname | The value is either 0 to | 00:03 |
| notmyname | disable the feature, or 1 to enable the use of | 00:03 |
| notmyname | CRCs. | 00:03 |
| notmyname | so `mkfs.xfs -m crc=0 -i size=256 ...` might work | 00:04 |
| notmyname | yeah, that works | 00:05 |
| *** lyrrad has quit IRC | 00:07 | |
| notmyname | ooo, interesting | 00:08 |
| notmyname | if you use crcs, then you can also turn on finobt (default on when using crc) | 00:09 |
| notmyname | The free inode btree mirrors the existing | 00:09 |
| notmyname | allocated inode btree index which indexes both | 00:09 |
| notmyname | used and free inodes. The free inode btree does | 00:09 |
| notmyname | not index used inodes, allowing faster, more | 00:10 |
| notmyname | consistent inode allocation performance as | 00:10 |
| notmyname | filesystems age. | 00:10 |
| notmyname | the "faster...performance as filesystems age" sounds very interesting | 00:10 |
| *** vint_bra has joined #openstack-swift | 00:12 | |
| mattoliverau | just +A'ed copy middleware \o/ | 00:14 |
| mattoliverau | go ecryption go | 00:15 |
| notmyname | yay! | 00:15 |
| timburke | whooo! thanks mattoliverau! | 00:15 |
| kota_ | mattoliverau: good job! | 00:22 |
| tdasilva | mattoliverau: thank you!!! | 00:23 |
| *** diogogmt has joined #openstack-swift | 00:28 | |
| *** duobei has joined #openstack-swift | 00:33 | |
| notmyname | n | 00:35 |
| *** gyee has quit IRC | 00:36 | |
| notmyname | FYI it would seem that the distro version of setuptools in xenial isn't new enough to understand the version markers in the requirements files | 00:38 |
| timburke | yay! so how much work would it be to pull cname_lookup out as it's own project? :P | 00:40 |
| notmyname | or vendor dnspython or write a tiny dns client | 00:41 |
| *** klamath has quit IRC | 00:42 | |
| *** lifeless has quit IRC | 00:46 | |
| *** lifeless has joined #openstack-swift | 00:47 | |
| clayg | notmyname: what are you doing? | 00:48 |
| clayg | talking to yourself? quoting manpages? what's happening? | 00:48 |
| clayg | mattoliverau: awesome! | 00:48 |
| notmyname | clayg: my SAIO is a precise box. I figured it was time to upgrade, so I'm building a xenial SAIO. | 00:48 |
| clayg | notmyname: oh oh oh are you using the saio docs!? | 00:49 |
| notmyname | clayg: and I was kinda hoping the xfs changes would pique your interest :-) | 00:49 |
| clayg | notmyname: get in rsync module per disk and servers per port while you're att it | 00:49 |
| notmyname | clayg: heh, not really. I should, huh? and update them | 00:49 |
| clayg | notmyname: nope. i'm busy. | 00:49 |
| clayg | notmyname: or review one of the many patches claiming to "fix" them! | 00:49 |
| timburke | notmyname: to what degree do we expect functests to pass against a non-default locale? the conversation earlier this morning got me curious about locales, so i came up with https://gist.github.com/tipabu/8b627bf99509188e274ede3978bd1149 and started playing around | 00:50 |
| notmyname | patch 298313 is actually going to make it a lot easier, I think. that will give you a list of non python stuff you need | 00:50 |
| patchbot | notmyname: https://review.openstack.org/#/c/298313/ - swift - List system dependencies for running common tests | 00:50 |
| clayg | notmyname: I also think you sign it - everytime someome compleates the saio doc the final step should be "now open this document, add your name/distro/version/date to this list and publish the change to gerrit for review (include any fixes to commands/steps you had to figure out along the way with your change)" | 00:50 |
| clayg | notmyname: that *is* sorta cool? | 00:52 |
| notmyname | I got tox -e py27 passing, but I haven't set up configs or rings yet. I should back out some stuff now and make sure the SAIO docs are up to date. clayg's right :-) | 00:54 |
| *** bill_az has quit IRC | 00:54 | |
| *** rcernin has quit IRC | 00:54 | |
| *** suyash has quit IRC | 01:01 | |
| clayg | ^ that last statement is in contrast with most of my real world experience | 01:03 |
| *** Sam___ has joined #openstack-swift | 01:05 | |
| *** mingdang1 has quit IRC | 01:06 | |
| *** Sam___ has quit IRC | 01:07 | |
| *** ozialien10 has quit IRC | 01:14 | |
| *** klrmn has quit IRC | 01:14 | |
| jrichli | mattoliverau: Awesome! hurray! | 01:22 |
| *** shakamunyi has joined #openstack-swift | 01:23 | |
| *** NM has quit IRC | 01:42 | |
| *** tqtran has quit IRC | 01:48 | |
| *** sgundur- has left #openstack-swift | 01:53 | |
| kota_ | back to online | 01:55 |
| *** dmorita has joined #openstack-swift | 02:00 | |
| *** dmorita has quit IRC | 02:04 | |
| *** bill_az has joined #openstack-swift | 02:18 | |
| *** garthb has joined #openstack-swift | 02:25 | |
| *** klrmn has joined #openstack-swift | 02:32 | |
| mahatic | good morning | 02:33 |
| *** daemontool has quit IRC | 02:38 | |
| *** garthb has quit IRC | 02:39 | |
| openstackgerrit | Merged openstack/swift: Refactor server side copy as middleware https://review.openstack.org/156923 | 02:48 |
| tdasilva | yay!! | 02:48 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 03:01 |
| openstackgerrit | Tim Burke proposed openstack/swift: Stop complaining about auditor_status files https://review.openstack.org/315334 | 03:14 |
| *** diogogmt has quit IRC | 03:18 | |
| mahatic | COPY merged! | 03:19 |
| mahatic | hmm, how do we add something to "watched changes" in gerrit as opposed to starring patches? | 03:19 |
| *** silor has joined #openstack-swift | 03:24 | |
| *** vint_bra has quit IRC | 03:26 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 03:28 |
| *** mingdang1 has joined #openstack-swift | 03:32 | |
| *** bill_az has quit IRC | 03:33 | |
| *** links has joined #openstack-swift | 03:34 | |
| *** vint_bra has joined #openstack-swift | 03:34 | |
| kota_ | mahatic: add yourself into the review with gerrit gui, since then, you can recieve subscription when status changed. | 03:36 |
| kota_ | into the reviewer | 03:36 |
| kota_ | mahatic: if you want to get subscription for all patch push, set the project you want to watch via https://review.openstack.org/#/settings/projects | 03:37 |
| mahatic | kota_: ok cool, thanks much! | 03:38 |
| *** takashi has joined #openstack-swift | 03:46 | |
| *** vint_bra1 has joined #openstack-swift | 04:12 | |
| openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Fix EC ring validation at ring reload https://review.openstack.org/268993 | 04:12 |
| *** vint_bra has quit IRC | 04:14 | |
| jrichli | #success swift just merged a large effort that started over a year ago that will facilitate new capabilities - like encryption | 04:16 |
| openstackstatus | jrichli: Added success to Success page | 04:16 |
| mahatic | torgomatic: excellent posts on go lang thread, very precise on the problem; prompted me to go look some stuff up | 04:17 |
| *** nadeem has joined #openstack-swift | 04:18 | |
| *** ppai has joined #openstack-swift | 04:24 | |
| *** pcaruana has joined #openstack-swift | 04:25 | |
| *** pcaruana has quit IRC | 04:32 | |
| *** _JZ_ has quit IRC | 04:37 | |
| *** psachin has joined #openstack-swift | 04:39 | |
| *** hezhiqiang has joined #openstack-swift | 04:41 | |
| *** vint_bra1 has quit IRC | 04:59 | |
| *** hezhiqiang has quit IRC | 05:22 | |
| *** hezhiqiang has joined #openstack-swift | 05:23 | |
| *** McMurlock1 has joined #openstack-swift | 05:40 | |
| *** ChubYann has quit IRC | 05:40 | |
| *** mingdang1 has quit IRC | 05:47 | |
| *** ppai has quit IRC | 05:49 | |
| *** rcernin has joined #openstack-swift | 05:54 | |
| *** asettle has joined #openstack-swift | 06:02 | |
| *** mmcardle has joined #openstack-swift | 06:02 | |
| *** asettle has quit IRC | 06:06 | |
| *** pcaruana has joined #openstack-swift | 06:12 | |
| *** mmcardle has quit IRC | 06:13 | |
| *** ppai has joined #openstack-swift | 06:13 | |
| openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Fix EC ring validation at ring reload https://review.openstack.org/268993 | 06:29 |
| *** jmccarthy has quit IRC | 06:30 | |
| *** jmccarthy has joined #openstack-swift | 06:31 | |
| *** SkyRocknRoll has joined #openstack-swift | 06:41 | |
| openstackgerrit | Mahati Chamarthy proposed openstack/swift: change etag (currently encypted with object key) to use container key https://review.openstack.org/315372 | 06:47 |
| kota_ | Thanks Pete for reviewing! | 06:49 |
| openstackgerrit | Andreas Jaeger proposed openstack/swift: List system dependencies for running common tests https://review.openstack.org/298313 | 06:51 |
| *** sudorandom has quit IRC | 06:58 | |
| *** natarej has quit IRC | 06:59 | |
| *** StevenK has quit IRC | 07:00 | |
| *** natarej has joined #openstack-swift | 07:00 | |
| *** sudorandom has joined #openstack-swift | 07:00 | |
| *** StevenK has joined #openstack-swift | 07:01 | |
| *** klrmn has quit IRC | 07:02 | |
| *** tesseract has joined #openstack-swift | 07:05 | |
| *** geaaru has joined #openstack-swift | 07:08 | |
| *** tesseract has quit IRC | 07:09 | |
| *** rledisez has joined #openstack-swift | 07:16 | |
| *** daemontool has joined #openstack-swift | 07:19 | |
| *** dmorita has joined #openstack-swift | 07:27 | |
| openstackgerrit | Christian Schwede proposed openstack/swift: Don't delete misplaced dbs if not replicated https://review.openstack.org/303994 | 07:28 |
| *** jmccarthy has quit IRC | 07:31 | |
| *** dmorita has quit IRC | 07:32 | |
| *** nadeem has quit IRC | 07:32 | |
| *** jmccarthy has joined #openstack-swift | 07:37 | |
| *** dmk0202 has joined #openstack-swift | 07:40 | |
| *** asettle has joined #openstack-swift | 07:52 | |
| *** acoles_ is now known as acoles | 07:54 | |
| *** mvk_ has joined #openstack-swift | 08:04 | |
| *** pchng has quit IRC | 08:07 | |
| acoles | tdasilva: ppai: congrats - great work on copy middleware | 08:08 |
| *** mvk has quit IRC | 08:08 | |
| *** jamielennox is now known as jamielennox|away | 08:10 | |
| ppai | acoles, glad to see it getting merged | 08:13 |
| openstackgerrit | Merged openstack/swift: Allow fallocate_reserve to be a percentage https://review.openstack.org/288011 | 08:18 |
| *** sams-gleb has joined #openstack-swift | 08:21 | |
| *** Jeffrey4l has quit IRC | 08:22 | |
| *** asettle has quit IRC | 08:25 | |
| *** Jeffrey4l has joined #openstack-swift | 08:26 | |
| *** asettle has joined #openstack-swift | 08:33 | |
| *** jistr has joined #openstack-swift | 08:35 | |
| *** joeljwright has joined #openstack-swift | 08:37 | |
| *** ChanServ sets mode: +v joeljwright | 08:37 | |
| *** jamiehan_ has joined #openstack-swift | 08:43 | |
| *** jamiehan_ has quit IRC | 08:44 | |
| *** jamie_h_ has joined #openstack-swift | 08:44 | |
| *** jamie_h_ has quit IRC | 08:48 | |
| *** jamie_h_ has joined #openstack-swift | 08:48 | |
| *** jamie_h_ has quit IRC | 08:48 | |
| *** jamie_h_ has joined #openstack-swift | 08:49 | |
| *** ppai has quit IRC | 08:49 | |
| *** jamie_h has quit IRC | 08:49 | |
| *** jamie_h_ has quit IRC | 08:49 | |
| *** jamie_h has joined #openstack-swift | 08:50 | |
| *** joeljwright has quit IRC | 08:54 | |
| *** hosanai has quit IRC | 08:57 | |
| *** jamie_h has quit IRC | 09:00 | |
| *** pcaruana is now known as pcaruana|afk| | 09:01 | |
| *** ppai has joined #openstack-swift | 09:03 | |
| *** openstackgerrit has quit IRC | 09:04 | |
| *** mvk_ has quit IRC | 09:04 | |
| *** openstackgerrit has joined #openstack-swift | 09:04 | |
| openstackgerrit | Merged openstack/swift: crypto - cleanup decrypter exception handling https://review.openstack.org/304806 | 09:05 |
| openstackgerrit | Merged openstack/swift: crypto - cleanup encrypter error handling https://review.openstack.org/312662 | 09:11 |
| openstackgerrit | Merged openstack/swift: Remove unneeded setting of SO_REUSEADDR. https://review.openstack.org/312791 | 09:19 |
| *** SkyRocknRoll has quit IRC | 09:30 | |
| *** mingdang1 has joined #openstack-swift | 09:34 | |
| *** JelleB is now known as a1|away | 09:35 | |
| *** mvk_ has joined #openstack-swift | 09:35 | |
| *** jamie_h has joined #openstack-swift | 09:36 | |
| *** jamie_h has quit IRC | 09:38 | |
| kota_ | what!!?? why patch 268993 fails at objectserver._diskfile_router? | 09:52 |
| patchbot | kota_: https://review.openstack.org/#/c/268993/ - swift - Fix EC ring validation at ring reload | 09:52 |
| *** ppai has quit IRC | 09:52 | |
| kota_ | the test doesn't touch anything at object-server... | 09:53 |
| kota_ | and it occurs only in mem_server tests. Plus, that didn't happen in my local... | 09:54 |
| kota_ | ah, the mem_server tests looking into the filesystem look skipped and the test probably write down something as fast-post. | 09:58 |
| *** ppai has joined #openstack-swift | 10:04 | |
| *** psachin has quit IRC | 10:12 | |
| *** cbartz has joined #openstack-swift | 10:13 | |
| *** psachin has joined #openstack-swift | 10:18 | |
| *** SkyRocknRoll has joined #openstack-swift | 10:22 | |
| mahatic | acoles: is this for increased scope as well? https://trello.com/c/IWbTC2nj/94-add-crypto-id-to-the-object-body-and-metadata-crypto-meta-instead-of-adding-a-new-header | 10:23 |
| mahatic | acoles: reduced* | 10:23 |
| mahatic | acoles: any of your patches covering that? Not the ones so far you've pushed i believe? | 10:24 |
| acoles | not sure. commented on trello - I'm not sure why we still have crypto-id at all. I am not covering it. | 10:26 |
| *** takashi has quit IRC | 10:30 | |
| *** jamie_h has joined #openstack-swift | 10:32 | |
| *** jamie_h has quit IRC | 10:32 | |
| *** jamie_h has joined #openstack-swift | 10:33 | |
| *** hezhiqiang has quit IRC | 10:33 | |
| mahatic | acoles: there is TODO: https://github.com/openstack/swift/blob/feature/crypto/swift/common/middleware/keymaster.py#L136-141 | 10:34 |
| mahatic | but i don't completely understand the context of it | 10:34 |
| kota_ | ah, yeah probably, mem_server doesn't support any storage-policy. That's the reason. | 10:35 |
| mahatic | actually i do get the context | 10:35 |
| openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Fix EC ring validation at ring reload https://review.openstack.org/268993 | 10:36 |
| acoles | mahatic: right, that TODO is a hint that crypto id could go once we have copy middleware. I plan to merge from master today to get that onto feature/crypto, then we can delete that code and see what happens | 10:36 |
| acoles | kota_: mem-server is a pain ;) | 10:37 |
| mahatic | acoles: yup, sounds good | 10:37 |
| kota_ | acoles: exactly :\ | 10:37 |
| acoles | kota_: I wonder why we have it? Maybe its a reference implementation for a pluggable backend, but unless it is maintained then it ceases to be a good reference, and I suspect we only maintain when we have to pass tests. | 10:40 |
| *** duobei has quit IRC | 10:40 | |
| openstackgerrit | Alistair Coles proposed openstack/swift: crypto - wrap random body key https://review.openstack.org/313640 | 10:41 |
| kota_ | hmm... I thought the reason is that someone is still using it but exactly I don't have the experienc to hear anyone uses it. | 10:45 |
| kota_ | acoles:^^ | 10:45 |
| kota_ | acoles: it might be good to survey in the ops session in the next summit who one uses mem_server implementation. | 10:46 |
| kota_ | so far from now, just we done the previous austin summt a bit ago. I'm not sure I can remember to bring it to the next summit :/ | 10:46 |
| acoles | kota_: maybe, i remember a while back you and I fixed some stuff in mem_diskfile | 10:47 |
| acoles | kota_: make a calendar entry ;) | 10:47 |
| kota_ | acoles: yeah, I know. | 10:47 |
| kota_ | make the eitherpad now for next ops session! | 10:48 |
| kota_ | kidding | 10:48 |
| *** mingdang1 has quit IRC | 10:52 | |
| *** silor has quit IRC | 11:03 | |
| *** diogogmt has joined #openstack-swift | 11:33 | |
| *** kei_yama has quit IRC | 11:37 | |
| *** natarej has quit IRC | 11:38 | |
| *** sams-gleb has quit IRC | 11:40 | |
| *** sams-gleb has joined #openstack-swift | 11:40 | |
| *** ZZelle has joined #openstack-swift | 11:44 | |
| *** sams-gleb has quit IRC | 11:49 | |
| *** ppai has quit IRC | 11:57 | |
| *** raildo-afk is now known as raildo | 12:10 | |
| *** NM has joined #openstack-swift | 12:11 | |
| *** sams-gleb has joined #openstack-swift | 12:15 | |
| *** pauloewerton has joined #openstack-swift | 12:17 | |
| *** hezhiqiang has joined #openstack-swift | 12:20 | |
| *** mingdang1 has joined #openstack-swift | 12:23 | |
| pdardeau | good morning | 12:31 |
| pdardeau | way to go on the copy middleware! | 12:31 |
| *** hezhiqia_ has joined #openstack-swift | 12:36 | |
| *** mmcardle has joined #openstack-swift | 12:38 | |
| *** hezhiqiang has quit IRC | 12:38 | |
| *** esker has joined #openstack-swift | 12:42 | |
| *** hezhiqiang has joined #openstack-swift | 12:44 | |
| *** hezhiqia_ has quit IRC | 12:45 | |
| *** esker has quit IRC | 12:45 | |
| *** esker has joined #openstack-swift | 12:47 | |
| *** pcaruana|afk| is now known as pcaruana | 13:01 | |
| *** coreycb has quit IRC | 13:04 | |
| *** sams-gleb has quit IRC | 13:04 | |
| *** sams-gleb has joined #openstack-swift | 13:04 | |
| *** duobei has joined #openstack-swift | 13:06 | |
| *** hezhiqiang has quit IRC | 13:06 | |
| *** hezhiqiang has joined #openstack-swift | 13:07 | |
| *** sams-gleb has quit IRC | 13:13 | |
| *** links has quit IRC | 13:14 | |
| *** silor has joined #openstack-swift | 13:16 | |
| *** duobei has quit IRC | 13:16 | |
| *** sams-gleb has joined #openstack-swift | 13:18 | |
| openstackgerrit | Alistair Coles proposed openstack/swift: Merge branch 'master' into feature/crypto https://review.openstack.org/315554 | 13:19 |
| *** mmcardle has quit IRC | 13:21 | |
| *** SkyRocknRoll has quit IRC | 13:22 | |
| psachin | Do we have any documentation to add additional storage server to SAIO | 13:22 |
| *** klamath has joined #openstack-swift | 13:24 | |
| *** psachin has quit IRC | 13:30 | |
| *** psachin has joined #openstack-swift | 13:31 | |
| openstackgerrit | Saverio Proto proposed openstack/swift: README: fix broken link https://review.openstack.org/315562 | 13:31 |
| *** sams-gleb has quit IRC | 13:35 | |
| *** hezhiqiang has quit IRC | 13:35 | |
| *** sams-gleb has joined #openstack-swift | 13:35 | |
| *** hezhiqiang has joined #openstack-swift | 13:37 | |
| *** silor1 has joined #openstack-swift | 13:43 | |
| *** bill_az has joined #openstack-swift | 13:43 | |
| *** sams-gleb has quit IRC | 13:44 | |
| *** wanghua has quit IRC | 13:44 | |
| *** silor has quit IRC | 13:46 | |
| *** silor1 is now known as silor | 13:46 | |
| *** SkyRocknRoll has joined #openstack-swift | 13:46 | |
| glange | psachin: you mean another "fake" object server ? | 13:46 |
| glange | because a saio is swift on one server/VM, right? | 13:47 |
| *** sams-gleb has joined #openstack-swift | 13:47 | |
| *** silor1 has joined #openstack-swift | 13:49 | |
| *** eranrom has quit IRC | 13:50 | |
| ober37 | mtreinish: BTW, this is the devstack patch we discussed yesterday https://review.openstack.org/#/c/315296/1 | 13:51 |
| patchbot | ober37: patch 315296 - openstack-dev/devstack - WIP: Enable Swift Account Management | 13:51 |
| *** silor has quit IRC | 13:52 | |
| *** silor1 is now known as silor | 13:52 | |
| *** eranrom has joined #openstack-swift | 13:53 | |
| *** geaaru has quit IRC | 13:59 | |
| *** sgundur- has joined #openstack-swift | 13:59 | |
| jrichli | acoles mahatic : like acoles said, now that we have copy mw, we can remove the crypto_id. But, when we all talked about auto-tiering it made me re-think that. | 14:02 |
| jrichli | If we ever think some action in swift will use a different path used on the GET than what was used on the PUT/POST, then crypto-id would be necessary | 14:03 |
| *** geaaru has joined #openstack-swift | 14:03 | |
| *** eranrom has quit IRC | 14:03 | |
| jrichli | i know that we could try to organize the pipeline so that moves like that happen first, but ... worth a second thought | 14:03 |
| openstackgerrit | Mahati Chamarthy proposed openstack/swift: Add "disable_encryption" config option https://review.openstack.org/315588 | 14:04 |
| tdasilva | jrichli: sorry to jump in the convo, is crypto_id same as the hash of the key? | 14:05 |
| *** esker has quit IRC | 14:06 | |
| mahatic | tdasilva: it's a header to persist object path, which is used in key derivation | 14:06 |
| jrichli | it's not that now, but I suppose that it could be later when BYOK is brought back | 14:06 |
| *** esker has joined #openstack-swift | 14:06 | |
| mahatic | tdasilva: https://github.com/openstack/swift/blob/feature/crypto/swift/common/middleware/keymaster.py#L95 | 14:07 |
| jrichli | tdasilva: we had to save the path because without copy as mw, there was a particular scenario where the path on a PUT was different than the path used on a GET | 14:07 |
| acoles | jrichli: if it becomes the hash then it can't be used to derive the key if an object moves. those have to be two different things | 14:07 |
| jrichli | acoles: yes, i meant if we decide we dont need it for decryption | 14:08 |
| *** mingdang1 has quit IRC | 14:08 | |
| mahatic | jrichli: what you mean is key_id? (I'm just using terms from overview_doc) | 14:08 |
| jrichli | oh, yes. name change would be good :-) | 14:08 |
| jrichli | yes, if it is the hash hten it would only be for verification of supplied key | 14:09 |
| mahatic | jrichli: re auto-tiering usecase: good point, i'd also give it a second thought. But I'm not deeply aware of other alternatives (i.e. if there is no crypto-id, then how will we handle those cases) | 14:10 |
| acoles | jrichli: ok. if an object is moved without being COPYed then while a crypto_id=path would help decrypt the object, the destination container etag will be encrypted using the source container key, so we'd need to propagate the crypto_id into the listing meta, and then fetch multiple keys while decrypting a listing | 14:10 |
| jrichli | ugh :-? | 14:11 |
| mahatic | acoles: mean in future we could handle it that way? | 14:11 |
| mahatic | do you mean* | 14:11 |
| jrichli | it seems like we try to avoid copies now - want to be more like fast post. but that leads to this situation for crypto : the crypto cant be tied to PUT path. | 14:13 |
| acoles | mahatic: I mean that as it is now it is not a sufficient solution for objects that move, and to make it sufficient isn't straightforward (i.e. the container listing) | 14:14 |
| *** d0ugal has quit IRC | 14:14 | |
| mahatic | acoles: ohh yeah | 14:15 |
| jrichli | that last bit was just thinking out loud. | 14:15 |
| jrichli | i guess we will solve the problem later if needed | 14:16 |
| *** d0ugal has joined #openstack-swift | 14:16 | |
| acoles | and if/when we have wrapped container listing keys its gets harder/impossible - we cannot deal with an etag in the container db encrypted with a key that is wrapped and stored as metadata of a different container. | 14:16 |
| jrichli | i see your poit | 14:17 |
| jrichli | point | 14:17 |
| mahatic | acoles: i thought, we'd store crypto-id as another header in listing meta | 14:18 |
| mahatic | when you said propogate crypto_id into listing meta | 14:19 |
| acoles | jrichli: its partly why I put that paragraph in the overview doc for developers - it's a headsup for anyone who is planning to move objects around without involving the proxy. | 14:20 |
| *** AJaeger has quit IRC | 14:21 | |
| acoles | mahatic: problem is, even if we put metadata in the listing etag that points to which key was used, if an object was moved then that key might be for a different container which would require a HEAD to that container to retrieve the key. | 14:22 |
| acoles | and potentially the same for every moved object in a container. | 14:22 |
| mahatic | acoles: oh sorry, i do see it. it's listing key meta. right, very complicated | 14:22 |
| acoles | the good news is we have copy middleware on feature/crypto for real and all func tests passing | 14:22 |
| *** d0ugal has quit IRC | 14:23 | |
| mahatic | yay | 14:23 |
| jrichli | +2 | 14:23 |
| *** flaper87 has quit IRC | 14:24 | |
| tdasilva | cool! | 14:24 |
| *** flaper87 has joined #openstack-swift | 14:27 | |
| *** flaper87 has quit IRC | 14:27 | |
| *** flaper87 has joined #openstack-swift | 14:27 | |
| *** vint_bra has joined #openstack-swift | 14:28 | |
| *** _JZ_ has joined #openstack-swift | 14:30 | |
| *** links has joined #openstack-swift | 14:36 | |
| *** esker has quit IRC | 14:38 | |
| *** joeljwright has joined #openstack-swift | 14:41 | |
| *** ChanServ sets mode: +v joeljwright | 14:41 | |
| admin6 | Hi there, do you know where I’m supposed to find the logs for object-reconstructor regarding my erasure coding storage? I would expect something like object-reconstructor.log just a the replicator do with object-replicator.log. Shouldn’t I ? | 14:44 |
| openstackgerrit | Andy McCrae proposed openstack/swift: [Docs] Document prevention of disk full scenarios https://review.openstack.org/315610 | 14:48 |
| acoles | jrichli: mahatic brainstorming...what if we used an account level key (wrapped) to encrypt the etags? then we'd always have the right key available regardless of which container the etag ended up in, so long as it's in the same account. Is auto-tiering going to cross accounts? | 14:48 |
| acoles | of course, IDK about re-suing that key so much | 14:48 |
| notmyname | good morning | 14:49 |
| openstackgerrit | Alistair Coles proposed openstack/swift: Put back missing sysmeta unit tests https://review.openstack.org/315613 | 14:50 |
| acoles | tdasilva: ^^ i noticed this while doing the merge to feature/crypto | 14:50 |
| mahatic | acoles: accessing account metadata on obj/cont requests? by calling account_info etc? | 14:52 |
| acoles | mahatic: it already happens often when getting container info https://github.com/openstack/swift/blob/7402d7d9cf91ed00a9c86fc1511592ac2eed5d6c/swift/proxy/controllers/base.py#L526-L526 | 14:56 |
| openstackgerrit | Alexandra Settle proposed openstack/swift: [Docs] Document prevention of disk full scenarios https://review.openstack.org/315610 | 14:56 |
| notmyname | joeljwright: is there an option in swiftclient to not validate teh md5 on download? or actually does it even do that? a cursory glance seems that it only does md5 checks when skip_identical is set | 14:57 |
| notmyname | acoles: now that copy middleware has landed are you (or have you already) done a merge to crypto from master? | 14:57 |
| openstackgerrit | Andy McCrae proposed openstack/swift: [Docs] Document prevention of disk full scenarios https://review.openstack.org/315610 | 14:59 |
| *** esker has joined #openstack-swift | 15:01 | |
| notmyname | acoles: ah, nm. you have. just got to that point in my email inbox :-) | 15:01 |
| *** esker has quit IRC | 15:02 | |
| *** esker has joined #openstack-swift | 15:04 | |
| *** arch-nemesis has joined #openstack-swift | 15:05 | |
| admin6 | sorry for the noise about reconstructor logs, just a stupid rsyslog misconfiguration on my side :( | 15:08 |
| *** mmcardle has joined #openstack-swift | 15:08 | |
| jrichli | acoles: sounds like a good idea. we dont even use an account key right now. we used one before when we had a wrapping scheme at each level. | 15:11 |
| notmyname | admin6: no worries. I'm both glad you asked and glad you figured it out :-) | 15:11 |
| admin6 | notmyname: thanks | 15:12 |
| joeljwright | notmynname: I believe the _SwiftReader object will throw an error on the download if the received md5sum is not the expected value | 15:12 |
| joeljwright | notmyname ^^^ | 15:12 |
| jrichli | acoles: i dont think that would be too much use. also, if it only us used for etags - that would still make for a very lengthy attack to eventually get to object bodies or metadata | 15:12 |
| notmyname | joeljwright: ah yes. there it is. thanks | 15:12 |
| jrichli | of course we will have crypto experts vet all this ;-) | 15:12 |
| joeljwright | notmyname: no probs | 15:13 |
| notmyname | joeljwright: do you think it would be valuable to noop the md5 check there if requested? | 15:13 |
| notmyname | joeljwright: someone pointed me to http://www.spinics.net/lists/ceph-users/msg27686.html this morning | 15:14 |
| joeljwright | notmyname: I'll take a look | 15:15 |
| notmyname | joeljwright: certainly not a priority (from my perspective), but it's an interesting consideration, I think. I wonder if swift3 does something similar or has similar issues | 15:15 |
| joeljwright | notmyname: is the problem really that we should check large objects properly? | 15:15 |
| joeljwright | if we're not already | 15:15 |
| notmyname | joeljwright: you mean the actual md5sum of the whole large object? | 15:16 |
| mahatic | acoles: okay cool. it does sound good. re reusing: we'd still have different iv's in any case i believe | 15:16 |
| joeljwright | looking at the code, it looks like it ignores the md5sum for large object downloads anyway | 15:16 |
| mahatic | if that's what you meant by reusing | 15:17 |
| notmyname | joeljwright: yeah. but I'm guessing that in their case they actually aren't using *LOs. I mean, they don't actually have swift | 15:17 |
| notmyname | joeljwright: which goes back to my first point of "not really a priority" ;-) | 15:17 |
| joeljwright | notmyname: ah, I see! | 15:17 |
| *** d0ugal has joined #openstack-swift | 15:18 | |
| joeljwright | an option couldn't hurt I suppose | 15:18 |
| notmyname | timburke: how does swift3 handle multipart objects vs *LOs? | 15:18 |
| joeljwright | notmyname: and we could do with checking 'properly' anyway | 15:18 |
| *** shakamunyi has quit IRC | 15:19 | |
| jrichli | mahatic: the re-use of keys itself is considered because although we do get 256 bits, it is still a finite number of keys - if we used a random account key, then you have to factor in probability of getting same number. | 15:20 |
| mahatic | jrichli: oh I see | 15:20 |
| jrichli | but - are we going to use the naem of the account in this case? i suppose so. so we still have to consider the fact that the iv for etag is still used for each time we re-use an object path | 15:21 |
| jrichli | (i mean derive key from name of accoutn) | 15:21 |
| jrichli | actually, I guess that he was speaking to the re-use of one given key - not to how many keys we were generating. | 15:24 |
| mmotiani_ | I can see there are lot of empty docs in the swift git repository | 15:24 |
| mmotiani_ | https://github.com/openstack/swift/tree/master/doc/source | 15:24 |
| jrichli | mahatic: so actually, in this case, its about the probability of the iv / nounce being repeated | 15:25 |
| notmyname | mmotiani_: not really empty. but they have sphinx directives in them to fill out with other generated stuff | 15:25 |
| jrichli | sort of along the same lines of thinking about key repetitions : its all finite so you gotta think of how many you can do before a "unique" number is not so unique anymore | 15:25 |
| notmyname | mmotiani_: https://github.com/openstack/swift/blob/master/doc/source/db.rst vs http://docs.openstack.org/developer/swift/db.html | 15:25 |
| notmyname | mmotiani_: check out the raw version of the .rst https://raw.githubusercontent.com/openstack/swift/master/doc/source/db.rst | 15:26 |
| *** catintheroof has joined #openstack-swift | 15:26 | |
| mahatic | jrichli: hmm. but iv being a repetitive, that concern would apply to everything else as well. not specific to etags i guess | 15:26 |
| jrichli | the etag situation is worse. for etag, we know we repeat the iv if you repeat a path | 15:27 |
| *** catintheroof has quit IRC | 15:27 | |
| jrichli | but for the random iv case, the argument is similar to the one about keys: you only get 16 bytes, and random is sometimes going to repeat | 15:28 |
| jrichli | in fact, there are fewer bytes that move in the iv case for CTR | 15:28 |
| jrichli | 16 bytes is the nonce + counter | 15:28 |
| jrichli | only the counter is incremented | 15:29 |
| *** catintheroof has joined #openstack-swift | 15:29 | |
| jrichli | if there are 2 blocks that re-use an iv, and somebody finds those two blocks, they could discover part of the key stream. | 15:29 |
| *** mmcardle has quit IRC | 15:29 | |
| mahatic | hmm | 15:31 |
| *** links has quit IRC | 15:32 | |
| jrichli | mahatic: but every encryption has a percentage of risk like this. I think our scheme is pretty secure (again, we will vet from a crypto expert!) | 15:32 |
| mahatic | acoles: jrichli since we're trying to solve moving of objects, should also think of auto-tiering being cross accounts or not? as acoles mentioned. IDK. | 15:33 |
| mmotiani_ | notmyname, got it, thankss :) | 15:33 |
| mahatic | jrichli: yeah | 15:33 |
| mahatic | acoles: jrichli i'm calling it a night | 15:33 |
| mahatic | have a nice day/evening | 15:33 |
| jrichli | mahatic: ok, good night! | 15:33 |
| *** sams-gleb has quit IRC | 15:35 | |
| *** dmk0202 has quit IRC | 15:35 | |
| *** dmk0202 has joined #openstack-swift | 15:36 | |
| *** sams-gleb has joined #openstack-swift | 15:36 | |
| *** psachin has quit IRC | 15:39 | |
| openstackgerrit | Andrew Welleck proposed openstack/python-swiftclient: Query string functionality for containers https://review.openstack.org/283815 | 15:40 |
| *** mmcardle has joined #openstack-swift | 15:41 | |
| ZZelle | Hi everyone! | 15:43 |
| ZZelle | Some cores can look at https://review.openstack.org/303863 ? it needs one more +2 | 15:43 |
| *** lyrrad has joined #openstack-swift | 15:44 | |
| *** sams-gleb has quit IRC | 15:45 | |
| jrichli | acoles: I will ask ccachin what he thinks about using the account key for each obj etag | 15:45 |
| jrichli | and repearhulk | 15:47 |
| openstackgerrit | Samuel Merritt proposed openstack/swift: Clean up fallocate tests a little https://review.openstack.org/309608 | 15:51 |
| *** SkyRocknRoll has quit IRC | 15:51 | |
| *** SkyRocknRoll has joined #openstack-swift | 15:52 | |
| *** dmorita has joined #openstack-swift | 15:54 | |
| jrichli | acoles: is it possible for me to work on adding a cyrpto gate test for our branch - even without core privileges? | 15:55 |
| *** garthb has joined #openstack-swift | 15:56 | |
| *** SkyRocknRoll has quit IRC | 15:57 | |
| acoles | jrichli: swift cores have no privilege wrt the gate jobs, it's approved by -infra | 15:59 |
| acoles | jrichli: fwiw I would be inclined to add another in process test variant with a modified pipeline rather than get a devstack config option | 15:59 |
| jrichli | acoles: ok. i will try to find the patch where you added that for fast post and take a look. any info or advice would be welcome :-) | 16:01 |
| acoles | jrichli: so auto-tiering, if the tier containers are managed by some server side process then in principle it could be arranged for the to have to same wrapped container keys as the source container, assuming a 1:1 mapping of source to tier containers | 16:02 |
| acoles | jrichli: do a git blame on test/functional/__init__.py to find the change I made for fast post config | 16:02 |
| acoles | jrichli: the hard part will be agreeing an acceptable way to configure the in process test pipeline - i used an env var for fast post, that will be way too clunk for a pipeline. perhaps have a set of pre-config'd pipelines that selected by an env var | 16:04 |
| openstackgerrit | Richard Hawkins proposed openstack/swift: go: middleware to allow creating test objects https://review.openstack.org/312255 | 16:04 |
| acoles | e.g. SWIFT_IN_PROCESS_TEST_PIPELINE=default|crypto ?? | 16:04 |
| jrichli | interesting on the auto-tiering. I dont know enough about the plan to know if we could expect 1:1 mapping. but its something i will record as an idea | 16:09 |
| jrichli | thanks for the ideas on the in process option. i'll take a loo | 16:10 |
| jrichli | k | 16:10 |
| *** cbartz has left #openstack-swift | 16:12 | |
| *** diogogmt has quit IRC | 16:15 | |
| *** dmk0202 has quit IRC | 16:15 | |
| openstackgerrit | Andrew Welleck proposed openstack/python-swiftclient: Query string functionality for containers https://review.openstack.org/283815 | 16:18 |
| acoles | jrichli: https://review.openstack.org/#/c/276823/ is my infra patch, you'd need something similar once you have a configurable in process test variant | 16:18 |
| patchbot | acoles: patch 276823 - openstack-infra/project-config - Add job gate-swift-tox-func-in-process-fast-post (MERGED) | 16:18 |
| acoles | jrichli: that would be great to have! and the env var referencing an alternate pipeline or conf section might be the most expedient way | 16:19 |
| *** joeljwright has quit IRC | 16:19 | |
| acoles | reminds me we should make that a voting job | 16:19 |
| *** d0ugal has quit IRC | 16:20 | |
| *** d0ugal has joined #openstack-swift | 16:22 | |
| *** zaitcev has joined #openstack-swift | 16:22 | |
| *** ChanServ sets mode: +v zaitcev | 16:22 | |
| *** klrmn has joined #openstack-swift | 16:25 | |
| *** d0ugal has quit IRC | 16:27 | |
| *** asettle has quit IRC | 16:31 | |
| *** nadeem has joined #openstack-swift | 16:34 | |
| *** nadeem has quit IRC | 16:34 | |
| *** nadeem has joined #openstack-swift | 16:35 | |
| *** rledisez has quit IRC | 16:38 | |
| clayg | heyoh! | 16:41 |
| *** sams-gleb has joined #openstack-swift | 16:41 | |
| acoles | clayg: morning! | 16:42 |
| *** d0ugal has joined #openstack-swift | 16:42 | |
| *** esker has quit IRC | 16:42 | |
| clayg | IN_PROCESS_TEST_PIPELINE!? | 16:42 |
| acoles | notmyname: other cores, fyi patch 315665 proposes to make fast post func tests voting | 16:42 |
| patchbot | acoles: https://review.openstack.org/#/c/315665/ - openstack-infra/project-config - Make gate-swift-tox-func-in-process-fast-post voting | 16:42 |
| acoles | clayg: like I said to jrichli..."the hard part will be agreeing an acceptable way to configure the in process test pipeline" | 16:43 |
| clayg | s/hard/impossible/ - ftfy | 16:43 |
| *** silor has quit IRC | 16:44 | |
| *** McMurlock1 has quit IRC | 16:44 | |
| *** Jeffrey4l has quit IRC | 16:45 | |
| *** bill_az has quit IRC | 16:45 | |
| acoles | right! I just didn't want to discourage her too much ;) | 16:46 |
| *** dmorita has quit IRC | 16:47 | |
| *** gyee has joined #openstack-swift | 16:47 | |
| *** dmorita has joined #openstack-swift | 16:47 | |
| notmyname | good morning, again | 16:49 |
| clayg | jrichli: acoles thinks your soft - I think you've stuck around too long with Swift you're not going to do something just because it's impossible. | 16:49 |
| notmyname | jrichli: did you say "crypto experts ... and reaperhulk"?! | 16:49 |
| *** sams-gleb has quit IRC | 16:50 | |
| notmyname | acoles: +1 to making that voting! | 16:52 |
| acoles | notmyname: they are one and the same | 16:52 |
| notmyname | acoles: yeah, I know :-) | 16:52 |
| notmyname | just made me laugh | 16:52 |
| acoles | sometimes I'd like to go back and change my nick | 16:53 |
| *** garthb_ has joined #openstack-swift | 16:53 | |
| notmyname | to what? | 16:54 |
| notmyname | (you still could, of course) | 16:54 |
| *** garthb has quit IRC | 16:55 | |
| clayg | notmyname: maybe reaperhulk? | 16:57 |
| *** vint_bra has quit IRC | 16:57 | |
| clayg | "big al" apparently has some history in SF? | 16:58 |
| acoles | IDK, "loser" maybe | 16:58 |
| clayg | har har | 16:58 |
| acoles | clayg: really | 16:58 |
| * acoles is googling | 16:58 | |
| acoles | clayg: got it. clearly i don't get out enough! | 16:59 |
| * acoles added that one to the vacation planner ;) | 17:01 | |
| *** diogogmt has joined #openstack-swift | 17:01 | |
| *** SkyRocknRoll has joined #openstack-swift | 17:02 | |
| clayg | rofl | 17:03 |
| *** mvk_ has quit IRC | 17:04 | |
| timburke | good morning | 17:05 |
| *** lakshmiS has joined #openstack-swift | 17:06 | |
| tdasilva | big al: i 'm reviewing your patches now | 17:08 |
| *** mingdang1 has joined #openstack-swift | 17:09 | |
| *** ChubYann has joined #openstack-swift | 17:09 | |
| *** mingdang1 has quit IRC | 17:13 | |
| openstackgerrit | Tim Burke proposed openstack/swift: Add "history" mode to versioned_writes middleware https://review.openstack.org/214922 | 17:14 |
| acoles | tdasilva: lol, thanks! sorry about the huge rebase noise on the wrapped key one :/ | 17:17 |
| tdasilva | acoles: no worries :) | 17:17 |
| acoles | goo dnight | 17:20 |
| acoles | ugh! | 17:20 |
| *** acoles is now known as acoles_ | 17:21 | |
| *** jistr has quit IRC | 17:24 | |
| openstackgerrit | Tim Burke proposed openstack/swift: Use the same key for memcache and env['swift.infocache'] https://review.openstack.org/310566 | 17:24 |
| openstackgerrit | Tim Burke proposed openstack/swift: Make info caching work across subrequests https://review.openstack.org/280977 | 17:24 |
| *** garthb__ has joined #openstack-swift | 17:25 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 17:26 |
| *** garthb_ has quit IRC | 17:26 | |
| *** SkyRocknRoll has quit IRC | 17:26 | |
| *** mmcardle has quit IRC | 17:28 | |
| openstackgerrit | Tim Burke proposed openstack/swift: Add Vary: headers for CORS responses https://review.openstack.org/274303 | 17:29 |
| openstackgerrit | Tim Burke proposed openstack/swift: Autovivify X-Versions-Location container https://review.openstack.org/265015 | 17:32 |
| timburke | hurray copy middleware! hopefully all of those rebases are accurate | 17:33 |
| *** d0ugal has quit IRC | 17:34 | |
| *** gyee has quit IRC | 17:35 | |
| *** NellyK has joined #openstack-swift | 17:36 | |
| *** SkyRocknRoll has joined #openstack-swift | 17:40 | |
| openstackgerrit | Richard Hawkins proposed openstack/swift: a well-commented skeleton middleware https://review.openstack.org/281885 | 17:43 |
| *** sams-gleb has joined #openstack-swift | 17:47 | |
| *** d0ugal has joined #openstack-swift | 17:53 | |
| *** NellyK has quit IRC | 17:53 | |
| *** sams-gleb has quit IRC | 17:54 | |
| notmyname | hurricanerix: thanks for keep working on that :-) | 17:55 |
| hurricanerix | notmyname np, i'll follow up with those changes you mentioned. | 17:56 |
| *** CaioBrentano has joined #openstack-swift | 17:56 | |
| tdasilva | cool, step 1 - complete: https://github.com/openstack/pyeclib and https://github.com/openstack/liberasurecode | 17:57 |
| *** tqtran has joined #openstack-swift | 17:58 | |
| *** suyash has joined #openstack-swift | 17:58 | |
| notmyname | tdasilva: great, thanks! | 17:58 |
| notmyname | tdasilva: what's next? | 17:58 |
| *** pcaruana has quit IRC | 17:58 | |
| tdasilva | notmyname: zuul jobs | 17:59 |
| *** asettle has joined #openstack-swift | 17:59 | |
| notmyname | tdasilva: ack. gate-noop first? or is there actually some tests that can be run? | 17:59 |
| tdasilva | gate-noop first | 18:00 |
| tdasilva | no tests yet, planning to add that next | 18:00 |
| tdasilva | my understanding is that we can only add tests for pyeclib thou, does that sound right? | 18:00 |
| tdasilva | since liberasurecode is a C library | 18:00 |
| *** klamath has quit IRC | 18:07 | |
| *** d0ugal has quit IRC | 18:08 | |
| *** rcernin has quit IRC | 18:09 | |
| openstackgerrit | Merged openstack/swift: Don't delete misplaced dbs if not replicated https://review.openstack.org/303994 | 18:09 |
| notmyname | tdasilva: well... | 18:10 |
| notmyname | tdasilva: I think it's possible to run the C tests. (actually not much different that what you might do for golang) | 18:10 |
| notmyname | tdasilva: in this case, it's probably something like "take the bare image, install what you need, run some script in the repo that builds and run tests..." | 18:11 |
| tdasilva | notmyname: ok, I was thinking more because of the whole infra only supports certain languages discussions, not so much because of the technical issues | 18:14 |
| *** jistr has joined #openstack-swift | 18:15 | |
| tdasilva | notmyname: but I guess that's only for "offical" openstack projects... | 18:15 |
| *** jistr is now known as jistr|afk | 18:15 | |
| tdasilva | anyway..I will play with it... | 18:15 |
| jrichli | clayg acoles: swift does have its share of "wicked problems" http://ptolemy.eecs.berkeley.edu/~johnr/deco/morereading/rittel69.html | 18:16 |
| *** openstackgerrit has quit IRC | 18:18 | |
| *** openstackgerrit has joined #openstack-swift | 18:18 | |
| *** hezhiqiang has quit IRC | 18:21 | |
| clayg | jrichli: so much of that rings so true | 18:23 |
| clayg | jrichli: although i don't believe I'd ever seen that synopsis nor read that paper before - thank you! | 18:23 |
| jrichli | yw :-) | 18:24 |
| jrichli | notmyname: i was including reaperhulk when i said crypto experts! | 18:24 |
| clayg | jrichli: oh the research seems to study policy/social problems - odd that the top level principles apply so well to complex system/software design! | 18:25 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 18:25 |
| jrichli | clayg : yeah, seemed fitting at the surface. i like "Every solution leaves traces that cannot be undone. You can't build a freeway to test if it works." | 18:26 |
| jrichli | and "Every wicked problem is a symptom of another problem. " | 18:26 |
| jrichli | Any solution generates waves of consequences that propagate forever. | 18:27 |
| jrichli | ok, ill stop | 18:27 |
| *** onovy has quit IRC | 18:28 | |
| *** onovy has joined #openstack-swift | 18:28 | |
| clayg | heh, the referenced paper is fairly short and itself short on methodolgy/references - their conclusions are less obviously correct than at first glance - still interesting | 18:29 |
| *** rchurch has quit IRC | 18:36 | |
| *** esker has joined #openstack-swift | 18:38 | |
| *** esker has quit IRC | 18:39 | |
| *** esker has joined #openstack-swift | 18:39 | |
| *** awelleck has joined #openstack-swift | 18:46 | |
| *** rchurch has joined #openstack-swift | 18:46 | |
| *** dmk0202 has joined #openstack-swift | 18:47 | |
| torgomatic | mahatic: I'm glad you found them useful :) | 18:47 |
| *** sams-gleb has joined #openstack-swift | 18:51 | |
| notmyname | jrichli: that is a great link. | 18:54 |
| *** lyrrad has quit IRC | 18:55 | |
| jrichli | notmyname: when googling about it, there was a title i saw that mixed that concept with herding cats. i didnt look into it, but thought that was interesting | 18:56 |
| openstackgerrit | Samuel Merritt proposed openstack/swift: Fix up get_account_info and get_container_info https://review.openstack.org/280978 | 18:57 |
| openstackgerrit | Samuel Merritt proposed openstack/swift: Make info caching work across subrequests https://review.openstack.org/280977 | 18:57 |
| openstackgerrit | Paul Dardeau proposed openstack/swift: fix docs word usage for large obj copy https://review.openstack.org/315718 | 18:58 |
| *** sams-gleb has quit IRC | 19:00 | |
| *** d0ugal has joined #openstack-swift | 19:02 | |
| *** SkyRocknRoll has quit IRC | 19:07 | |
| *** asettle has quit IRC | 19:09 | |
| hurricanerix | zaitcev: I think these are the links you were looking for in that "supporting go" thread: https://www.youtube.com/watch?v=1TuwLDs5fqk http://share.scottic.us/hummingbird-vancouver.pdf | 19:12 |
| *** asettle has joined #openstack-swift | 19:13 | |
| zaitcev | hurricanerix: The video is from panel, which didn't touch the specfic performance numbers, I think. But thanks for the presentation link, it seems like | 19:14 |
| hurricanerix | zaitcev np, i'll see if i can find the other video too | 19:14 |
| *** bill_az has joined #openstack-swift | 19:18 | |
| openstackgerrit | Merged openstack/swift: Merge branch 'master' into feature/crypto https://review.openstack.org/315554 | 19:19 |
| *** lyrrad has joined #openstack-swift | 19:20 | |
| openstackgerrit | Merged openstack/swift: README: fix broken link https://review.openstack.org/315562 | 19:20 |
| hurricanerix | zaitcev i am starting to wonder if that other one wasn't recorded because i can't find it either. | 19:20 |
| zaitcev | hurricanerix: Quite possibly... It was a Design Summit working session, not a presentation as such. | 19:20 |
| *** SkyRocknRoll has joined #openstack-swift | 19:26 | |
| *** asettle has quit IRC | 19:35 | |
| *** jistr|afk has quit IRC | 19:52 | |
| *** pauloewerton has quit IRC | 19:55 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 19:55 |
| *** sams-gleb has joined #openstack-swift | 19:57 | |
| *** asettle has joined #openstack-swift | 19:59 | |
| *** asettle has quit IRC | 19:59 | |
| *** asettle has joined #openstack-swift | 20:00 | |
| *** lyrrad has quit IRC | 20:00 | |
| *** asettle has quit IRC | 20:00 | |
| *** sams-gleb has quit IRC | 20:05 | |
| *** Guest28457 is now known as sc | 20:18 | |
| *** rcernin has joined #openstack-swift | 20:24 | |
| *** lyrrad has joined #openstack-swift | 20:32 | |
| *** raildo is now known as raildo-afk | 20:41 | |
| *** lyrrad_ has joined #openstack-swift | 20:43 | |
| *** lyrrad has quit IRC | 20:43 | |
| *** lyrrad_ is now known as lyrrad | 20:43 | |
| *** gyee has joined #openstack-swift | 20:44 | |
| openstackgerrit | Merged openstack/swift: Stop complaining about auditor_status files https://review.openstack.org/315334 | 20:47 |
| openstackgerrit | Andrew Welleck proposed openstack/python-swiftclient: Query string functionality for containers https://review.openstack.org/283815 | 20:49 |
| *** NM has quit IRC | 20:52 | |
| openstackgerrit | Samuel Merritt proposed openstack/swift: Fix up get_account_info and get_container_info https://review.openstack.org/280978 | 20:56 |
| openstackgerrit | Samuel Merritt proposed openstack/swift: Make info caching work across subrequests https://review.openstack.org/280977 | 20:56 |
| ober37 | Does anyone know if there are any restrictions in using the allow_account_management setting with Keystone v2 auth. There is a comment in the functional test sample.conf file that would imply this. I was curious if there is a limitation in this implementation or if its just something with the functional tests themselves... | 20:57 |
| clayg | notmyname: if you run account auto-create do you like *have* to have allow_account_management true? | 21:01 |
| clayg | i always seem to forget how exclusive those options are | 21:01 |
| *** sams-gleb has joined #openstack-swift | 21:01 | |
| clayg | like I sorta *know* what account_autocreate does - but I always forget exactly how allow_account_management is implemented | 21:01 |
| ober37 | clayg: I didn't think so, I thought that they were exclusive. I think the allow* just allows for the PUT / DELETE from an authorized user | 21:02 |
| ober37 | clayg: What confuses me is the connection with this and the comment of not allowing for v2 auth, I don't see why this restriction exists. | 21:02 |
| clayg | ober37: either way I'd guess they bot need to be true where authorized identity is provided by a seperate service - almost noone (anymore?) integrates a seperate "provision swift account" step when a new identity is added | 21:02 |
| clayg | ober37: can you ref the comment? | 21:03 |
| ober37 | clayg: It's part of test/sample.conf lines 8-9 | 21:03 |
| notmyname | yeah, ober37 is right. allow_ isn't needed if autocreate is on | 21:03 |
| clayg | maybe this has some clues? https://review.openstack.org/#/c/262664/ | 21:05 |
| patchbot | clayg: patch 262664 - swift - Add a note for functional tests with Keystone. (MERGED) | 21:05 |
| ober37 | clayg: Thank you! I'll take a look | 21:06 |
| clayg | how does test.functional.tests.TestAccount.testPUT not *always* fail when allow_account_management is true? | 21:07 |
| clayg | doesn't seem like keystone really matters - that test is really specific | 21:07 |
| *** sams-gleb has quit IRC | 21:09 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 21:10 |
| ober37 | clayg: Yeah I just read the patch and I think I would agree with you. It seems that the funky behavior is that PUT will not succeed since autocreation will take care of it (at least that's my understanding). I am not sure v2 vs v3 Keystone should make a difference. Or at least it's not clear to me how it would | 21:11 |
| ober37 | clayg: i guess in theory someone could disable account autocreation AND enable allow_account_management with Keystone and this test case would work... | 21:12 |
| *** lakshmiS has quit IRC | 21:13 | |
| clayg | ober37: i'm positive v2/v3 auth is unrelated - the comment about v2 auth and the comment about allow_account_management are orthogonal | 21:13 |
| clayg | either way I think the comment about allow_account_management applies to the entire suite - which is sort wonky | 21:13 |
| ober37 | clayg: yeah. It really seems like it's more of a conflict between using Keystone + autocreation OR Keystone + manual creation. That if you enable autocreate + manual management, functional tests will fail. | 21:14 |
| ober37 | (not all of them obviously) | 21:14 |
| ober37 | clayg: Is that your impression as well? | 21:16 |
| clayg | I think the test suite will always fail, regardless of auth system, if you change that option in the proxy config - because the test is asserting the behavior of the default configuration | 21:18 |
| *** mmcardle has joined #openstack-swift | 21:19 | |
| *** mmcardle1 has joined #openstack-swift | 21:21 | |
| ober37 | clayg: Yeah you are right. | 21:22 |
| ober37 | clayg: This test probably should look at the setting for allow_account_management and adjust what it verifies against based on that setting. | 21:24 |
| *** mmcardle has quit IRC | 21:24 | |
| *** mingdang1 has joined #openstack-swift | 21:24 | |
| *** awelleck has quit IRC | 21:28 | |
| ober37 | clayg: Thanks for your help. I'll look more at this tomorrow morning and will plan on providing a patch around this test case to adjust what status it is verifying based on this setting | 21:30 |
| *** vint_bra has joined #openstack-swift | 21:31 | |
| *** ametts has quit IRC | 21:33 | |
| *** nadeem has quit IRC | 21:39 | |
| mattoliverau | morning | 21:44 |
| *** arch-nemesis has quit IRC | 21:46 | |
| bkeller` | 'evening | 21:52 |
| notmyname | arvo | 21:58 |
| torgomatic | polo? | 21:59 |
| *** dmk0202 has quit IRC | 22:00 | |
| *** cdelatte has joined #openstack-swift | 22:04 | |
| *** sams-gleb has joined #openstack-swift | 22:06 | |
| openstackgerrit | Merged openstack/swift: go: shuffle suffix dirs when replicating a partition https://review.openstack.org/315138 | 22:08 |
| *** CaioBrentano has quit IRC | 22:11 | |
| *** sams-gleb has quit IRC | 22:15 | |
| *** mmotian__ has joined #openstack-swift | 22:19 | |
| *** lakshmiS has joined #openstack-swift | 22:24 | |
| *** jamielennox|away is now known as jamielennox | 22:24 | |
| *** SkyRocknRoll has quit IRC | 22:32 | |
| openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Accept gzip-encoded API responses https://review.openstack.org/184956 | 22:38 |
| *** mmotian__ has quit IRC | 22:42 | |
| *** geaaru has quit IRC | 22:42 | |
| *** lakshmiS has quit IRC | 23:01 | |
| timburke | notmyname: want to +A https://review.openstack.org/#/c/306661/ at the same time? | 23:04 |
| patchbot | timburke: patch 306661 - swift - Tighten up ResumingGetter.fast_forward | 23:04 |
| notmyname | timburke: no. torgomatic was just standing over me threatening me about the other one ;-) | 23:05 |
| timburke | haha | 23:05 |
| notmyname | timburke: so this one looks like some efficiency improvements? | 23:06 |
| timburke | mainly some sanity checks. shouldn't really come up in practice, but the NotSatisfiable/RangeAlreadyComplete exceptions seem appropriate if it ever came up | 23:08 |
| notmyname | yeah. lgtm | 23:08 |
| timburke | thanks | 23:09 |
| *** sams-gleb has joined #openstack-swift | 23:12 | |
| notmyname | I just noticed that our code coverage has gone up slightly. used to be 91%. now it's 92% (on unit tests) | 23:13 |
| timburke | notmyname: looks like recent feature/crypto brings it up to 93% http://logs.openstack.org/40/313640/2/check/gate-swift-python27/87e7b58/console.html#_2016-05-12_10_52_17_136 | 23:16 |
| timburke | good job acoles_, jrichli, mahatic! | 23:17 |
| notmyname | nice | 23:17 |
| *** mingdang1 has quit IRC | 23:18 | |
| *** sams-gleb has quit IRC | 23:19 | |
| *** garthb__ has quit IRC | 23:25 | |
| *** cdelatte has quit IRC | 23:25 | |
| *** _JZ_ has quit IRC | 23:27 | |
| *** j_king has quit IRC | 23:29 | |
| *** j_king has joined #openstack-swift | 23:29 | |
| *** mahatic has quit IRC | 23:31 | |
| *** mahatic has joined #openstack-swift | 23:32 | |
| *** kei_yama has joined #openstack-swift | 23:34 | |
| *** chlong has quit IRC | 23:35 | |
| *** mmotian__ has joined #openstack-swift | 23:41 | |
| *** mmotia___ has joined #openstack-swift | 23:42 | |
| *** mmotian__ has quit IRC | 23:42 | |
| *** vint_bra has quit IRC | 23:43 | |
| *** mmotian__ has joined #openstack-swift | 23:44 | |
| *** mmotia___ has quit IRC | 23:46 | |
| *** mmotia___ has joined #openstack-swift | 23:47 | |
| *** hosanai has joined #openstack-swift | 23:47 | |
| *** ChanServ sets mode: +v hosanai | 23:47 | |
| *** mmotian__ has quit IRC | 23:50 | |
| *** mmcardle1 has quit IRC | 23:51 | |
| openstackgerrit | Merged openstack/swift: fix docs word usage for large obj copy https://review.openstack.org/315718 | 23:51 |
| *** mmcardle has joined #openstack-swift | 23:52 | |
| *** NM has joined #openstack-swift | 23:56 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 23:56 |
| *** asettle has joined #openstack-swift | 23:56 | |
| torgomatic | heh, global requirements just hit patch set 423 | 23:57 |
| *** mmotian__ has joined #openstack-swift | 23:58 | |
| torgomatic | and it turned two years old last month | 23:58 |
| *** mmoti____ has joined #openstack-swift | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!