*** zaitcev has quit IRC | 00:03 | |
*** pvradu has joined #openstack-swift | 00:12 | |
*** zaitcev has joined #openstack-swift | 00:17 | |
*** ChanServ sets mode: +v zaitcev | 00:17 | |
*** takamatsu has quit IRC | 00:17 | |
*** gyee has quit IRC | 00:32 | |
*** zaitcev has quit IRC | 00:55 | |
*** hogepodge has quit IRC | 00:55 | |
*** csmart has quit IRC | 00:55 | |
*** ChanServ has quit IRC | 00:55 | |
*** tkajinam has quit IRC | 00:55 | |
*** threestrands has quit IRC | 00:55 | |
*** clayg has quit IRC | 00:55 | |
*** nottrobin has quit IRC | 00:55 | |
*** patchbot has quit IRC | 00:55 | |
*** rcernin has quit IRC | 00:55 | |
*** DHE has quit IRC | 00:55 | |
*** baojg has quit IRC | 00:55 | |
*** mrjk has quit IRC | 00:56 | |
*** cwright has quit IRC | 00:56 | |
*** joeljwright has quit IRC | 00:56 | |
*** stamps has quit IRC | 00:56 | |
*** evrardjp has quit IRC | 00:56 | |
*** lifeless has quit IRC | 00:56 | |
*** sorrison has quit IRC | 00:56 | |
*** camelCaser has quit IRC | 00:56 | |
*** kukacz has quit IRC | 00:56 | |
*** cschwede has quit IRC | 00:56 | |
*** early has quit IRC | 00:56 | |
*** notmyname has quit IRC | 00:56 | |
*** kota_ has quit IRC | 00:56 | |
*** timss has quit IRC | 00:56 | |
*** hoonetorg has quit IRC | 00:56 | |
*** openstackgerrit has quit IRC | 00:56 | |
*** dasp has quit IRC | 00:56 | |
*** tonyb has quit IRC | 00:56 | |
*** MooingLemur has quit IRC | 00:56 | |
*** irclogbot_3 has quit IRC | 00:56 | |
*** dosaboy has quit IRC | 00:56 | |
*** ndk_ has quit IRC | 00:56 | |
*** paladox has quit IRC | 00:56 | |
*** Anticimex has quit IRC | 00:56 | |
*** hugokuo has quit IRC | 00:56 | |
*** fungi has quit IRC | 00:56 | |
*** seongsoocho has quit IRC | 00:56 | |
*** fyx has quit IRC | 00:56 | |
*** godog has quit IRC | 00:56 | |
*** mugsie has quit IRC | 00:56 | |
*** gmann has quit IRC | 00:56 | |
*** donnyd has quit IRC | 00:56 | |
*** jungleboyj has quit IRC | 00:56 | |
*** rledisez has quit IRC | 00:56 | |
*** alecuyer has quit IRC | 00:56 | |
*** pvradu has quit IRC | 00:56 | |
*** jistr has quit IRC | 00:56 | |
*** rickflare has quit IRC | 00:56 | |
*** mahatic has quit IRC | 00:56 | |
*** corvus has quit IRC | 00:56 | |
*** kazsh has quit IRC | 00:56 | |
*** mattoliverau has quit IRC | 00:56 | |
*** coreycb has quit IRC | 00:56 | |
*** d34dh0r53 has quit IRC | 00:56 | |
*** abelur has quit IRC | 00:56 | |
*** StevenK has quit IRC | 00:56 | |
*** beisner has quit IRC | 00:56 | |
*** f0o has quit IRC | 00:56 | |
*** mgagne has quit IRC | 00:56 | |
*** onovy has quit IRC | 00:56 | |
*** Jeffrey4l has quit IRC | 00:56 | |
*** redrobot has quit IRC | 00:56 | |
*** spotz has quit IRC | 00:56 | |
*** szaher has quit IRC | 00:56 | |
*** dabukalam has quit IRC | 00:56 | |
*** timur has quit IRC | 00:56 | |
*** timur has joined #openstack-swift | 01:14 | |
*** szaher has joined #openstack-swift | 01:14 | |
*** spotz has joined #openstack-swift | 01:14 | |
*** redrobot has joined #openstack-swift | 01:14 | |
*** Jeffrey4l has joined #openstack-swift | 01:14 | |
*** dabukalam has joined #openstack-swift | 01:14 | |
*** sorrison has joined #openstack-swift | 01:14 | |
*** lifeless has joined #openstack-swift | 01:14 | |
*** stamps has joined #openstack-swift | 01:14 | |
*** evrardjp has joined #openstack-swift | 01:14 | |
*** joeljwright has joined #openstack-swift | 01:14 | |
*** cwright has joined #openstack-swift | 01:14 | |
*** mrjk has joined #openstack-swift | 01:14 | |
*** baojg has joined #openstack-swift | 01:14 | |
*** DHE has joined #openstack-swift | 01:14 | |
*** rcernin has joined #openstack-swift | 01:14 | |
*** MooingLemur has joined #openstack-swift | 01:14 | |
*** tonyb has joined #openstack-swift | 01:14 | |
*** dasp has joined #openstack-swift | 01:14 | |
*** openstackgerrit has joined #openstack-swift | 01:14 | |
*** hoonetorg has joined #openstack-swift | 01:14 | |
*** hogepodge has joined #openstack-swift | 01:14 | |
*** zaitcev has joined #openstack-swift | 01:14 | |
*** onovy has joined #openstack-swift | 01:14 | |
*** mgagne has joined #openstack-swift | 01:14 | |
*** timss has joined #openstack-swift | 01:14 | |
*** kota_ has joined #openstack-swift | 01:14 | |
*** notmyname has joined #openstack-swift | 01:14 | |
*** card.freenode.net sets mode: +vvvv joeljwright zaitcev kota_ notmyname | 01:14 | |
*** early has joined #openstack-swift | 01:14 | |
*** cschwede has joined #openstack-swift | 01:14 | |
*** kukacz has joined #openstack-swift | 01:14 | |
*** camelCaser has joined #openstack-swift | 01:14 | |
*** patchbot has joined #openstack-swift | 01:14 | |
*** clayg has joined #openstack-swift | 01:14 | |
*** nottrobin has joined #openstack-swift | 01:14 | |
*** threestrands has joined #openstack-swift | 01:14 | |
*** tkajinam has joined #openstack-swift | 01:14 | |
*** f0o has joined #openstack-swift | 01:14 | |
*** beisner has joined #openstack-swift | 01:14 | |
*** StevenK has joined #openstack-swift | 01:14 | |
*** abelur has joined #openstack-swift | 01:14 | |
*** d34dh0r53 has joined #openstack-swift | 01:14 | |
*** coreycb has joined #openstack-swift | 01:14 | |
*** card.freenode.net sets mode: +vv cschwede clayg | 01:14 | |
*** ChanServ has joined #openstack-swift | 01:14 | |
*** card.freenode.net sets mode: +o ChanServ | 01:14 | |
*** ndk_ has joined #openstack-swift | 01:14 | |
*** paladox has joined #openstack-swift | 01:14 | |
*** hugokuo has joined #openstack-swift | 01:14 | |
*** jistr has joined #openstack-swift | 01:15 | |
*** rickflare has joined #openstack-swift | 01:15 | |
*** corvus has joined #openstack-swift | 01:15 | |
*** mahatic has joined #openstack-swift | 01:15 | |
*** kazsh has joined #openstack-swift | 01:15 | |
*** mattoliverau has joined #openstack-swift | 01:15 | |
*** card.freenode.net sets mode: +vv mahatic mattoliverau | 01:15 | |
*** sorrison has quit IRC | 01:17 | |
*** mugsie has joined #openstack-swift | 01:21 | |
*** Anticimex has joined #openstack-swift | 01:21 | |
*** persia has joined #openstack-swift | 01:22 | |
*** sorrison has joined #openstack-swift | 01:23 | |
*** gmann has joined #openstack-swift | 01:23 | |
*** irclogbot_2 has joined #openstack-swift | 01:25 | |
*** gmann has quit IRC | 01:27 | |
*** gmann has joined #openstack-swift | 01:28 | |
*** fungi has joined #openstack-swift | 01:37 | |
*** ianychoi has quit IRC | 02:19 | |
*** ianychoi has joined #openstack-swift | 02:19 | |
*** baojg has quit IRC | 02:38 | |
*** baojg has joined #openstack-swift | 02:44 | |
*** baojg has quit IRC | 02:51 | |
*** baojg has joined #openstack-swift | 02:53 | |
*** BjoernT has joined #openstack-swift | 02:55 | |
*** gkadam has joined #openstack-swift | 03:37 | |
*** gkadam is now known as gkadam-afk | 03:38 | |
*** gkadam has joined #openstack-swift | 04:17 | |
*** gkadam-afk has quit IRC | 04:19 | |
*** pvradu has joined #openstack-swift | 04:22 | |
*** pvradu has quit IRC | 04:27 | |
*** zaitcev has quit IRC | 04:46 | |
*** csmart has joined #openstack-swift | 04:48 | |
*** BjoernT_ has joined #openstack-swift | 04:49 | |
*** BjoernT has quit IRC | 04:50 | |
*** BjoernT_ has quit IRC | 05:15 | |
openstackgerrit | Merged openstack/swift feature/losf: Merge branch 'master' into feature/losf https://review.opendev.org/677848 | 05:17 |
---|---|---|
*** takamatsu has joined #openstack-swift | 05:47 | |
*** ianychoi has quit IRC | 06:15 | |
*** ianychoi has joined #openstack-swift | 06:19 | |
*** pvradu has joined #openstack-swift | 06:24 | |
*** ianychoi has quit IRC | 06:28 | |
*** ianychoi has joined #openstack-swift | 06:29 | |
*** ianychoi has quit IRC | 06:52 | |
*** ianychoi has joined #openstack-swift | 06:54 | |
*** takamatsu has quit IRC | 06:57 | |
*** pvradu has quit IRC | 06:57 | |
*** e0ne has joined #openstack-swift | 07:37 | |
*** ianychoi has quit IRC | 07:52 | |
*** ianychoi has joined #openstack-swift | 07:54 | |
*** threestrands has quit IRC | 08:01 | |
openstackgerrit | Merged openstack/swift master: py3: Finish porting func tests https://review.opendev.org/675227 | 08:13 |
*** takamatsu has joined #openstack-swift | 08:21 | |
*** godog has joined #openstack-swift | 08:21 | |
*** tkajinam has quit IRC | 08:23 | |
*** tdasilva has joined #openstack-swift | 08:38 | |
*** ChanServ sets mode: +v tdasilva | 08:38 | |
*** pvradu has joined #openstack-swift | 08:42 | |
*** tdasilva_ has joined #openstack-swift | 08:51 | |
*** ChanServ sets mode: +v tdasilva_ | 08:51 | |
*** tdasilva has quit IRC | 08:52 | |
*** tdasilva_ is now known as tdasilva | 08:52 | |
*** rcernin has quit IRC | 08:54 | |
*** tdasilva_ has joined #openstack-swift | 08:55 | |
*** ChanServ sets mode: +v tdasilva_ | 08:55 | |
*** tdasilva_ has quit IRC | 08:55 | |
*** tdasilva has quit IRC | 08:58 | |
*** tdasilva has joined #openstack-swift | 09:03 | |
*** ChanServ sets mode: +v tdasilva | 09:03 | |
*** takamatsu has quit IRC | 09:08 | |
*** e0ne has quit IRC | 09:42 | |
*** e0ne has joined #openstack-swift | 09:56 | |
*** takamatsu has joined #openstack-swift | 10:55 | |
*** tesseract has joined #openstack-swift | 11:07 | |
*** takamatsu has quit IRC | 11:25 | |
*** takamatsu has joined #openstack-swift | 11:45 | |
*** alecuyer has joined #openstack-swift | 12:00 | |
*** rledisez has joined #openstack-swift | 12:01 | |
*** ChanServ sets mode: +v rledisez | 12:01 | |
*** ianychoi has quit IRC | 12:07 | |
*** ianychoi has joined #openstack-swift | 12:09 | |
openstackgerrit | Thiago da Silva proposed openstack/swift master: symlink-backed versioned_writes https://review.opendev.org/633857 | 12:11 |
*** ianychoi has quit IRC | 12:27 | |
*** ianychoi has joined #openstack-swift | 12:28 | |
*** gkadam has quit IRC | 12:32 | |
*** donnyd has joined #openstack-swift | 12:32 | |
openstackgerrit | Thiago da Silva proposed openstack/swift master: symlink-backed versioned_writes https://review.opendev.org/633857 | 12:59 |
*** BjoernT has joined #openstack-swift | 13:19 | |
*** BjoernT_ has joined #openstack-swift | 13:33 | |
*** BjoernT has quit IRC | 13:34 | |
*** altlogbot_0 has joined #openstack-swift | 13:47 | |
*** altlogbot_0 has quit IRC | 13:48 | |
*** altlogbot_2 has joined #openstack-swift | 13:52 | |
*** baojg has quit IRC | 14:09 | |
*** spsurya has joined #openstack-swift | 14:10 | |
*** baojg has joined #openstack-swift | 14:12 | |
openstackgerrit | Thiago da Silva proposed openstack/swift master: Add rebalance seed to build rings in docker image https://review.opendev.org/678034 | 14:41 |
*** takamatsu has quit IRC | 14:55 | |
tdasilva | timburke: while testing p 678034, i noticed that i'm able to start and stop a py2 container as many times as I want and I can get data back, but if I try to "migrate" to a py3 container, i'm no longer able to. would you expect our ring rebalance to change even when using same seed value? | 15:12 |
patchbot | https://review.opendev.org/#/c/678034/ - swift - Add rebalance seed to build rings in docker image - 1 patch set | 15:12 |
timburke | tdasilva, yes :-( | 15:12 |
tdasilva | scary :/ | 15:13 |
timburke | i remember trying incredibly hard in https://review.opendev.org/#/c/401397/ to get them to match, but ultimately i had to just give up so i could keep moving | 15:15 |
patchbot | patch 401397 - swift - py3: port common/ring/ and common/utils.py (MERGED) - 14 patch sets | 15:15 |
timburke | i think patchset 7 had me trying to make py3 random behave like py2 random? but there were *still* issues | 15:18 |
timburke | tdasilva, so what if we think about it this way: why do we have to build the rings every time? why isn't that considered an output of the container? | 15:19 |
timburke | like, create it if it doesn't exist, but store it on the bind mount? | 15:20 |
tdasilva | timburke: yep! that was actually going to be a different approach I was going to try testing, but mostly for testing migration from py2 to py3 | 15:22 |
tdasilva | for the bind mounting of the data path, I just wanted to enable users to be able to save their data without thinking too much about swift configuration | 15:23 |
tdasilva | so still the same goal of just providing an API endpoint useful for application dev. testing, with the additional benefit of being able to keep data between container restarts | 15:24 |
tdasilva | but but but, for us swift devs, i was hoping it could be useful to testing py2-py3 migration for example, or just release upgrade testing | 15:24 |
tdasilva | wdyt? | 15:27 |
timburke | i think for app dev testing, the existing setup isn't so bad -- provided they just have the one "drive" | 15:27 |
timburke | it's all single-replica anyway, right? | 15:27 |
timburke | for the broader case... idk, i think we need to make whoever's running this start thinking more about configs | 15:28 |
timburke | hmm. so if you really want to run containerized swift... do you have multiple drives per container? or do you just spin up a container per drive? my gut says the latter... | 15:31 |
tdasilva | well...right now as is, the container is a single saio, so we create 6 internal dirs and add 6 devices to a single replica ring which doesn't make much sense, i don't think... | 15:33 |
openstackgerrit | Tim Burke proposed openstack/swift master: py3: Switch swift-dsvm-functional-py3 to run tests under py3 https://review.opendev.org/677047 | 15:34 |
tdasilva | how if one was really serious about containerizing swift to run in prod, it might make sense to investgate running object servers with server per port enabled and run one object-server container per device...maybe?? | 15:35 |
tdasilva | s/how/Now | 15:35 |
*** gyee has joined #openstack-swift | 15:50 | |
*** pvradu has quit IRC | 15:53 | |
*** gkadam has joined #openstack-swift | 16:02 | |
*** gkadam has quit IRC | 16:06 | |
*** altlogbot_2 has quit IRC | 16:14 | |
*** ianychoi has quit IRC | 16:15 | |
*** altlogbot_1 has joined #openstack-swift | 16:15 | |
*** ianychoi has joined #openstack-swift | 16:17 | |
*** ianychoi has quit IRC | 16:19 | |
*** ianychoi has joined #openstack-swift | 16:19 | |
openstackgerrit | Tim Burke proposed openstack/swift master: Autovivify X-Versions-Location container https://review.opendev.org/265015 | 16:23 |
*** e0ne has quit IRC | 16:54 | |
*** psachin has joined #openstack-swift | 16:55 | |
*** psachin is now known as psachin|away | 17:12 | |
*** tesseract has quit IRC | 17:13 | |
*** psachin|away has quit IRC | 17:32 | |
*** psachin has joined #openstack-swift | 17:33 | |
*** zaitcev has joined #openstack-swift | 17:38 | |
*** ChanServ sets mode: +v zaitcev | 17:38 | |
*** zaitcev has quit IRC | 17:43 | |
*** psachin has quit IRC | 17:50 | |
*** zaitcev has joined #openstack-swift | 17:54 | |
*** ChanServ sets mode: +v zaitcev | 17:54 | |
*** e0ne has joined #openstack-swift | 17:59 | |
*** zaitcev has quit IRC | 18:01 | |
*** e0ne has quit IRC | 18:11 | |
*** e0ne has joined #openstack-swift | 18:11 | |
*** irclogbot_2 has quit IRC | 18:14 | |
*** e0ne has quit IRC | 18:14 | |
*** zaitcev has joined #openstack-swift | 18:15 | |
*** ChanServ sets mode: +v zaitcev | 18:15 | |
*** irclogbot_2 has joined #openstack-swift | 18:16 | |
*** altlogbot_1 has quit IRC | 18:29 | |
*** e0ne has joined #openstack-swift | 18:52 | |
*** spsurya has quit IRC | 18:52 | |
*** zaitcev_ has joined #openstack-swift | 19:00 | |
*** ChanServ sets mode: +v zaitcev_ | 19:00 | |
*** zaitcev has quit IRC | 19:03 | |
tdasilva | timburke, clayg I’m still scratching my head over how to handle object expiration and object versions. The idea of expiring old versions seems counterintuitive | 19:09 |
tdasilva | This is one area where I actually like the idea of the bucket policies where users intentionally would set a policy such as delete previous versions older than 30 days. | 19:11 |
timburke | tdasilva, i agree wholeheartedly -- i don't think any of the interactions there are intuitive or even necessarily well-understood (much less documented) | 19:49 |
timburke | so if anyone has opinions on how they *should* interact, maybe that'd be a better direction to start looking... | 19:50 |
timburke | i *think* i know what i'd want it to look like with x-history-location -- record the delete marker and clean up the primary container. but i think trying to apply that to x-versions-location gets weird... | 19:52 |
timburke | (there are some edge cases with history mode, of course -- like how to handle an overwrite between when the object expired and when the expirer got around to trying to clean it up. but especially with symlink-backed versioning, i think it's all resolvable) | 19:54 |
tdasilva | timburke: would blocking X-delete-at header on a versions container be a totally crazy idea? | 19:54 |
timburke | we still have to worry about it, at least somewhat. what if the container replicas are out-of-sync and don't agree about whether versioning is enabled or not? somebody somewhere is going to be able to get that expiry entry in the queue | 19:56 |
timburke | this is particularly likely if the client does a container PUT before starting a round of uploads -- which i'm pretty sure is also what led to https://bugs.launchpad.net/swift/+bug/1839355 | 19:57 |
openstack | Launchpad bug 1839355 in OpenStack Object Storage (swift) "container-sharder should keep cleaving when there are no rows" [Undecided,In progress] - Assigned to Matthew Oliver (matt-0) | 19:57 |
timburke | i'm starting to understand why s3 treats a PUT to an already-existing container as a client error ;-) | 19:58 |
openstackgerrit | Tim Burke proposed openstack/swift master: py3: Switch swift-dsvm-functional-py3 to run tests under py3 https://review.opendev.org/677047 | 20:10 |
clayg | tdasilva: so, i guess in the old copy design, were we like forwarding x-delete-at headers across to old versions and now that's broken/different? | 20:10 |
clayg | like if you uploaded an object x-delete-after: 30 days, then 3 days later you overwrite it - the backup version get's PUT with a new expirery queue entry pointing at it in the new location but with the delete-at carried forward (e.g. it'll expire after 27 days) | 20:11 |
clayg | cause we could probably make that behavior mostly work until an expiration makes a symlink broken | 20:12 |
*** e0ne has quit IRC | 20:56 | |
clayg | did rledisez make any progress on p 1840780 | 21:10 |
patchbot | No data found for patch 1840780 | 21:10 |
clayg | errr.. lp bug #1840780 | 21:10 |
openstack | Launchpad bug 1840780 in OpenStack Object Storage (swift) "Eventlet exception "do not call blocking functions from the mainloop"" [Undecided,New] https://launchpad.net/bugs/1840780 | 21:10 |
*** BjoernT_ has quit IRC | 21:40 | |
*** zaitcev_ has quit IRC | 22:09 | |
*** zaitcev_ has joined #openstack-swift | 22:23 | |
*** ChanServ sets mode: +v zaitcev_ | 22:23 | |
timburke | gdi -- i hate it when i do a rebase, fix up the obvious conflicts, continue the rebase, then run tests under py3 to discover the *non-obvious* conflicts, get everything squared, git review... and then realize i forgot to commit and git review did a reset --hard :-( | 22:25 |
zaitcev_ | wait, git review can do that?! | 22:26 |
timburke | https://opendev.org/opendev/git-review/src/branch/master/git_review/cmd.py#L880 | 22:26 |
timburke | i think it maybe has something to do with me configuring [rebase]autoStash = true ? | 22:28 |
openstackgerrit | Tim Burke proposed openstack/swift master: Autovivify X-Versions-Location container https://review.opendev.org/265015 | 22:28 |
zaitcev_ | That's at the level of "del" with no arguments deleting the whole current directory. | 22:29 |
zaitcev_ | I think I read about it in "The Brief History of The Hackerdom". | 22:30 |
*** swifterdarrell has joined #openstack-swift | 22:36 | |
*** ChanServ sets mode: +v swifterdarrell | 22:36 | |
timburke | hmm. do we have any probe tests that exercise versioning corner cases? | 22:38 |
*** swifterdarrell has quit IRC | 22:40 | |
*** swifterdarrell has joined #openstack-swift | 22:40 | |
*** ChanServ sets mode: +v swifterdarrell | 22:40 | |
swifterdarrell | timburke: I remembered how IRC works! | 22:41 |
timburke | swifterdarrell \o/ | 22:41 |
timburke | now i won't have to translate your findings for rledisez and alecuyer! | 22:41 |
*** zaitcev_ is now known as zaitcev | 22:50 | |
*** rcernin has joined #openstack-swift | 22:55 | |
*** rcernin is now known as rcernin|brb | 23:00 | |
*** tkajinam has joined #openstack-swift | 23:03 | |
*** rcernin|brb has quit IRC | 23:09 | |
*** rcernin has joined #openstack-swift | 23:10 | |
*** persia has left #openstack-swift | 23:55 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!