DHE | timburke: I'm not sure that's going to work. basically I'm looking to store data in such a way that an extra column in the 'objects' table of the container DB would be the dream implementation for me... running HEAD on tens/hundreds of millions of objects isn't exactly living the dream... | 00:04 |
---|---|---|
timburke | DHE: what's the extra data? can it get baked into the object name? what's its lifecycle like? i.e., can it be updated on POST, or is it set only via PUT? | 00:07 |
DHE | set only at PUT time and never changed again. not feasible to put into the object name, no. the value is itself a full URL | 00:08 |
DHE | hmmm... now you've got me thinking... not that much of the URL changes between objects... | 00:09 |
timburke | might also want to take a look at https://github.com/openstack/swift/blob/2.20.0/swift/common/middleware/symlink.py#L433-L452 -- if you can include some custom middleware in your pipeline, you could do something similar and then pick it back out of the hash/etag during listings | 00:13 |
timburke | note that symlink has it easy, though -- it forces the object to be zero bytes, so it already knows the base etag to include. https://github.com/openstack/swift/blob/master/swift/common/middleware/crypto/encrypter.py has to deal with arbitrary content (and does so by using a "footers" callback) but like i said, it gets a bit hairy | 00:15 |
*** NM has quit IRC | 00:26 | |
*** baojg has joined #openstack-swift | 00:56 | |
*** gyee has quit IRC | 01:18 | |
*** mikecmpbll has quit IRC | 02:42 | |
*** baojg has quit IRC | 02:58 | |
*** baojg has joined #openstack-swift | 07:44 | |
*** baojg has quit IRC | 07:49 | |
*** baojg has joined #openstack-swift | 07:55 | |
*** baojg has quit IRC | 08:31 | |
*** baojg has joined #openstack-swift | 08:31 | |
*** baojg has quit IRC | 09:36 | |
*** mikecmpbll has joined #openstack-swift | 09:56 | |
*** baojg has joined #openstack-swift | 10:28 | |
openstackgerrit | Merged openstack/swift master: misc test cleanup https://review.openstack.org/631077 | 12:38 |
openstackgerrit | Merged openstack/swift master: Treat all invalid frag indexes the same https://review.openstack.org/615990 | 13:29 |
*** baojg has quit IRC | 14:42 | |
*** baojg has joined #openstack-swift | 14:43 | |
*** baojg has quit IRC | 15:32 | |
*** e0ne has joined #openstack-swift | 19:57 | |
*** e0ne has quit IRC | 20:05 | |
*** e0ne has joined #openstack-swift | 20:26 | |
*** early has quit IRC | 20:33 | |
*** early has joined #openstack-swift | 21:20 | |
*** e0ne has quit IRC | 21:58 | |
*** baojg has joined #openstack-swift | 23:39 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!