*** nanzha has joined #openstack-swift | 01:22 | |
*** rcernin has quit IRC | 02:10 | |
*** ianychoi__ has joined #openstack-swift | 02:38 | |
*** ianychoi_ has quit IRC | 02:41 | |
*** nanzha has quit IRC | 03:11 | |
*** nanzha has joined #openstack-swift | 03:21 | |
*** diablo_rojo has quit IRC | 03:37 | |
openstackgerrit | zhangboye proposed openstack/python-swiftclient master: Stop testing python2.7 https://review.opendev.org/691608 | 06:47 |
---|---|---|
*** gkadam has joined #openstack-swift | 07:19 | |
*** gkadam has quit IRC | 07:19 | |
*** tkajinam has quit IRC | 08:04 | |
*** lifeless has joined #openstack-swift | 08:05 | |
*** tesseract has joined #openstack-swift | 08:13 | |
*** rdejoux has joined #openstack-swift | 08:28 | |
*** rpittau|afk is now known as rpittau | 08:30 | |
*** ccamacho has joined #openstack-swift | 08:38 | |
*** mikecmpbll has joined #openstack-swift | 08:55 | |
*** nanzha has quit IRC | 09:13 | |
*** nanzha has joined #openstack-swift | 09:15 | |
alecuyer | binwiederhier: thanks for sharing! | 09:21 |
*** root____1 has joined #openstack-swift | 09:28 | |
*** nanzha has quit IRC | 11:38 | |
*** nanzha has joined #openstack-swift | 11:43 | |
*** nanzha has quit IRC | 12:05 | |
rledisez | good morning, don't know who commented on https://etherpad.openstack.org/p/swift-profiling but I added some notes/answers to the comments | 12:49 |
*** diablo_rojo has joined #openstack-swift | 13:34 | |
*** zaitcev__ has joined #openstack-swift | 13:44 | |
*** ChanServ sets mode: +v zaitcev__ | 13:44 | |
*** zaitcev_ has quit IRC | 13:48 | |
binwiederhier | alecuyer: i know it's very much the opposite of what you guys have been doing, so i hope i didn't step on your guys' toes. it's just a PoC after all, just wanted to try if it was possible. | 14:00 |
binwiederhier | That said, my thing obviously has drawbacks, such as that the application has to be packing-aware. | 14:01 |
openstackgerrit | Thiago da Silva proposed openstack/swift master: WIP: New Object Versioning mode https://review.opendev.org/682382 | 14:20 |
timburke | rledisez, that was me -- sorry, i should have left my nick | 15:12 |
timburke | binwiederhier, yeah, as i was looking at it, i realized that the name you use for GET is different from what you use for PUT -- it's not how swift usually behaves, but it definitely opens up a lot of possibilities for us | 15:19 |
timburke | fwiw, i realized that we're *kind of* going to be doing that with the object versioning work -- client does a put to a name, server responds with a version id, and then the client can always get that particular data by requesting /v1/<account>/<container>/<name>?version-id=<id> (even if /v1/<account>/<container>/<name> is subsequently overwritten) | 15:19 |
binwiederhier | If this was implemented in swift or as middleware, you could keep the path-to-pack relationship in the container db, but i'm sure then it wouldn't be as simple as it is right now anymore. | 15:25 |
*** gyee has joined #openstack-swift | 15:25 | |
binwiederhier | Large objects are also "different" for the client, so there is definitely precedent (not that that's good though). | 15:27 |
alecuyer | binwiederhier: don't worry about my toes ;) It's a cool idea, I was also wondering about having it directly in swift, or in the client library. (if you can handle the X-Item-Path there, with properties on the container/packed object, "transparent" small files support :) ) | 15:54 |
*** zaitcev__ is now known as zaitcev | 15:56 | |
zaitcev | I had my concerns about the external DB, but they were mostly misgivings. CouchDB seems to work for Ceph. | 15:56 |
zaitcev | Funny thing though, one day Sage decided to get away from using a filesystem and start consuming raw block devices, and oops, you have to mod the DB then. | 15:57 |
gmann | timburke: ping | 16:17 |
openstackgerrit | Clay Gerrard proposed openstack/swift master: use request_helpers import namespace for tests https://review.opendev.org/691712 | 16:28 |
tdasilva | timburke: do you remember why we added a separate s3api func test job to the gate as opposed to just enabling s3api on the other tests (e.g., func-encryption) ? | 16:36 |
timburke | gmann, hi! | 16:36 |
timburke | tdasilva, no i don't :-( | 16:37 |
gmann | timburke: i would like to sync up with the py2.7 drop plan for swift . L22 - https://etherpad.openstack.org/p/drop-python2-support | 16:37 |
timburke | sure | 16:37 |
gmann | timburke: you might have seen my mail and this etherpad. | 16:38 |
gmann | basically, there is no issue in keeping the support. swift can keep the support but we would like to know what all projects/lib/testing tool etc swift might need the support of py2.7 | 16:39 |
gmann | common lib like oslo or testing tooling like devstack, tempest will drop the support from milestone-1 to milestone-2 (as mentioned in schedule section of the etherpad) | 16:40 |
timburke | sounds good -- the main things we'd be interested in would be devstack (which we use to test our keystone support) and keystonemiddleware (and all of its dependencies) | 16:41 |
timburke | note that devstack doesn't need to have all services running under py2 -- we'd be content with soemthing like the long-standing previous behavior where all services *except swift* were running py3 | 16:42 |
timburke | keystonemiddleware could probably be addressed with a version cap and/or a py2-specific upper-constraints file | 16:43 |
timburke | i don't want to keep projects from dropping py2 support, i just want to make sure we don't find ourselves unable to test swift on py2 :-) | 16:44 |
* gmann ok. I will make note for devstack. how about client, keystoneclient and openstackclient are also being used for testing - | 16:44 | |
gmann | ok. I will make note for devstack. how about client, keystoneclient and openstackclient are also being used for testing - | 16:45 |
gmann | https://github.com/openstack/swift/blob/master/test-requirements.txt | 16:45 |
gmann | those also can be handled via version cap | 16:45 |
timburke | hmmm... and castellan and barbicanclient are also integration points... | 16:45 |
gmann | ok | 16:45 |
gmann | but capping the version for py2.7 need g-r support which we can check with prometheanfire | 16:46 |
timburke | i don't care too much about clients. i'll probably end up -2'ing https://review.opendev.org/#/c/691608/ but that's because we own it. if some other client wants to drop py2, i've got no objections | 16:47 |
patchbot | patch 691608 - python-swiftclient - Stop testing python2.7 - 1 patch set | 16:47 |
timburke | or rather, i don't care too much about *what language* clients *are implemented in* ;-) i care very much about not breaking clients | 16:47 |
*** rpittau is now known as rpittau|afk | 16:48 | |
gmann | yeah but there might be possibility of having them break on py2.7. so either we can go when it happen and cap the version for py2.7 | 16:49 |
gmann | but i do not know how to handle that from g-r side as it has to be done only for swift (or any other projects keeping py2.7 ) | 16:49 |
gmann | may be we can discuss on #openstack-requirements channel with prometheanfire | 16:50 |
timburke | as i recall, openstackclient is just being used to configure keystone to work with swift and create users and such. i could double check that. keystoneclient comes in as a transitive dep for keystonemiddleware and even (iirc) used to provide the middleware | 16:56 |
timburke | fwiw, castellan and barbicanclient are *untested* integration points -- part of how https://bugs.launchpad.net/swift/+bug/1847755 slipped by us :-/ | 16:59 |
openstack | Launchpad bug 1847755 in OpenStack Object Storage (swift) "On-disk encryption is borken with Python 3" [High,Fix released] | 16:59 |
timburke | i really need to find some time to get barbican up and getting tested in our dsvm jobs | 16:59 |
timburke | gotta get to a meeting -- back in a bit. or we can talk more about it async | 17:02 |
gmann | timburke: ok. I will put that on ML with requirements team input also, thanks | 17:04 |
*** pcaruana has joined #openstack-swift | 17:31 | |
openstackgerrit | Thiago da Silva proposed openstack/swift master: WIP: New Object Versioning mode https://review.opendev.org/682382 | 17:32 |
*** mikecmpbll has quit IRC | 17:33 | |
*** rdejoux has quit IRC | 17:46 | |
*** henriqueof has quit IRC | 17:47 | |
openstackgerrit | Gilles Biannic proposed openstack/swift master: probe: Add test for syncing a delete when the remote 404s https://review.opendev.org/691463 | 17:55 |
openstackgerrit | Gilles Biannic proposed openstack/swift master: Stop retrying every deletes in container-sync https://review.opendev.org/691729 | 17:55 |
*** pcaruana has quit IRC | 18:30 | |
*** pcaruana has joined #openstack-swift | 18:31 | |
*** tesseract has quit IRC | 18:31 | |
*** Buggys has quit IRC | 18:45 | |
*** StevenK has quit IRC | 18:45 | |
clayg | tdasilva: you got the encryption stuff fixed up!? Or ... we're just not running those tests in the gate? | 18:46 |
*** StevenK has joined #openstack-swift | 18:46 | |
*** openstackgerrit has quit IRC | 18:50 | |
tdasilva | clayg: there was an issue in `handle_post` when encryption is enabled that should be fixed in the latest patchset. I've also enabled object versioning in the encryption gate jobs since it was running before | 19:19 |
clayg | !!! 😍 | 19:20 |
openstack | clayg: Error: "!!" is not a valid command. | 19:20 |
tdasilva | clayg, timburke: which actually brings me to a question i've been pondering about. Should the new object versioning mode be enabled by default | 19:20 |
tdasilva | we currently have the option in the middleware, but it's 'false' by default. I'm wondering if we should keep the option, but have it enabled by default | 19:20 |
clayg | tdasilva: good question - we should talk about that on wednesday and the PTG - preference? | 19:21 |
clayg | i mean s3api is *really* going to want it on - but I guess as long as the option is there we'll have to check | 19:21 |
tdasilva | no preference, but I'm going to start a list of open questions on the ehterpad, maybe it can be discussed at the PTG... | 19:21 |
tdasilva | clayg: right, even more reason to have it on by default i think... /me needs to think more of the drawbacks | 19:22 |
clayg | an etherpad would be GREAT! Thank you! | 19:23 |
*** renich has joined #openstack-swift | 19:26 | |
*** pcaruana has quit IRC | 20:02 | |
*** openstackgerrit has joined #openstack-swift | 20:12 | |
openstackgerrit | Thiago da Silva proposed openstack/swift master: WIP: Enabled s3api tests across all func tests https://review.opendev.org/691747 | 20:12 |
timburke | i kinda want to have a swift-tox-func-minimal (with basically no feaures enabled, and maybe even just one user) and swift-tox-func-maximal (with basically *everything* enabled) | 20:23 |
timburke | as much as anything, the minimal would be there to ensure that we have appropriate feature checks in place against /info | 20:24 |
timburke | still gotta have separate jobs for non-client-facing things though -- EC vs replicated, encryption on/off... | 20:25 |
timburke | maybe we could do something with periodic jobs to make sure we still have some coverage to ensure that, for example, s3api doesn't *absolutely require* that you enable slo... | 20:26 |
tdasilva | timburke: yeah, defining the test matrix is tricky because it can get out of hand quickly | 20:34 |
openstackgerrit | Merged openstack/swift master: use request_helpers import namespace for tests https://review.opendev.org/691712 | 20:34 |
tdasilva | timburke: my current plan is to absorb s3api into the other tests as I'm not sure why we would need a separate job just for that, then maybe staticweb is the same? | 20:35 |
tdasilva | agree about separate encryption/ec jobs | 20:36 |
*** umbSublime has quit IRC | 21:01 | |
*** diablo_rojo has quit IRC | 21:45 | |
mattoliverau | morning | 21:58 |
*** diablo_rojo has joined #openstack-swift | 22:00 | |
*** timburke_ has joined #openstack-swift | 22:19 | |
*** ChanServ sets mode: +v timburke_ | 22:19 | |
*** timburke_ has quit IRC | 22:20 | |
openstackgerrit | Clay Gerrard proposed openstack/swift master: WIP: Allow internal clients to use reserved namespace https://review.opendev.org/682138 | 22:41 |
openstackgerrit | Clay Gerrard proposed openstack/swift master: WIP: New Object Versioning mode https://review.opendev.org/682382 | 22:41 |
openstackgerrit | Clay Gerrard proposed openstack/swift master: WIP: s3api: Implement object versioning API https://review.opendev.org/673682 | 22:41 |
*** rcernin has joined #openstack-swift | 22:58 | |
*** tkajinam has joined #openstack-swift | 23:00 | |
*** mvkr has joined #openstack-swift | 23:13 | |
*** diablo_rojo has quit IRC | 23:27 | |
*** gyee has quit IRC | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!