openstackgerrit | Merged openstack/swift master: Continue logging deprecation warnings for run_pause https://review.opendev.org/761474 | 00:24 |
---|---|---|
*** gyee has quit IRC | 00:53 | |
*** klamath_atx has quit IRC | 01:42 | |
openstackgerrit | Tim Burke proposed openstack/swift master: Increase container_update_timeout in in-process func tests https://review.opendev.org/761692 | 01:42 |
openstackgerrit | Merged openstack/swift master: Add librsvg2-* to bindep.txt https://review.opendev.org/761593 | 01:43 |
*** klamath_atx has joined #openstack-swift | 02:11 | |
*** yuxin_ has quit IRC | 02:34 | |
*** zamba has quit IRC | 02:34 | |
*** yuxin_ has joined #openstack-swift | 02:34 | |
openstackgerrit | Merged openstack/swift master: Refactor audit shard tests https://review.opendev.org/744525 | 02:37 |
*** zamba has joined #openstack-swift | 02:41 | |
*** rcernin has quit IRC | 02:54 | |
*** rcernin has joined #openstack-swift | 03:13 | |
*** ykarel|away has joined #openstack-swift | 05:01 | |
*** ykarel|away is now known as ykarel | 05:02 | |
*** evrardjp has quit IRC | 05:33 | |
*** evrardjp has joined #openstack-swift | 05:33 | |
*** rcernin has quit IRC | 05:36 | |
*** rcernin has joined #openstack-swift | 05:44 | |
*** rcernin has quit IRC | 05:57 | |
*** rcernin has joined #openstack-swift | 06:04 | |
*** rcernin has quit IRC | 06:21 | |
*** rpittau|afk is now known as rpittau | 06:47 | |
*** rcernin has joined #openstack-swift | 07:03 | |
openstackgerrit | Ade Lee proposed openstack/swift master: replace md5 with swift utils version https://review.opendev.org/751966 | 07:54 |
*** rcernin has quit IRC | 08:09 | |
*** rcernin has joined #openstack-swift | 08:52 | |
*** rcernin has quit IRC | 09:06 | |
*** rcernin has joined #openstack-swift | 11:40 | |
*** rcernin has quit IRC | 12:08 | |
*** ykarel has quit IRC | 12:40 | |
*** ykarel has joined #openstack-swift | 12:41 | |
rledisez | clayg: to deploy, we create a virtualenv /opt/swift-<version+build id> and we then create a package (debian, but it does not matter) of that directory. we decided this way to remove the dependencies with the OS. We also deploy our own python build with openssl, libec, … embedded to reduce the OS dependencies to the very minimal (libc and zlib I think) | 12:44 |
rledisez | i'm in the situation where I need to shard a shard (who said "deep" container? :)). | 12:49 |
rledisez | from documentation I understand it's the exact same command except it must run against the shard db file: | 12:49 |
rledisez | swift-manage-shard-ranges </path/to/container-shard.db> find_and_replace 500000 --enable | 12:49 |
rledisez | is that correct? | 12:49 |
acoles | rledisez: I believe that is correct https://docs.openstack.org/swift/latest/overview_container_sharding.html#sharding-a-shard-container but I suggest that you wait for clayg or timburke to reply because they have experience of doing this | 14:38 |
*** rpittau is now known as rpittau|afk | 15:18 | |
clayg | i mean, i haven't sharded a container form the commandline in prod in awhile 😬 | 15:31 |
clayg | but that seems to be about what I run in dev! | 15:31 |
clayg | the command does the scan "inline" - so for big databases it's going to take a minute | 15:32 |
timburke | rledisez, yeah, same process | 15:40 |
ade_lee | timburke, anything else still needed on https://review.opendev.org/751966 ? | 15:43 |
patchbot | patch 751966 - swift - replace md5 with swift utils version - 12 patch sets | 15:43 |
timburke | ade_lee, looks like it's ready for review -- i'll see if i can do that in the not-too-distant future | 15:54 |
rledisez | clayg: timburke thx for the feedback. same question to shrink, the command is not documented actually. is it the same command on the root container? | 15:54 |
ade_lee | timburke, thanks! | 15:54 |
timburke | rledisez, you'll need to pick up https://review.opendev.org/#/c/741721/ -- command will look like `swift-manage-shard-ranges </path/to/root.db> shrink <shard-name>` | 15:58 |
patchbot | patch 741721 - swift - add swift-manage-shard-ranges shrink command - 8 patch sets | 15:58 |
rledisez | ok, thx! I don't have to shrink yet, but i'll add this to my bookmarks :) | 15:59 |
timburke | (we should probably look at being able to do something like `swift-manage-shard-ranges </path/to/root.db> shrink --below-size <N>`) | 15:59 |
timburke | rledisez, i'll likely try to pull out the consistency-enginechanges into a leading patch, and let the manage-shard-ranges change stay separate. we'll see what i can swing with the probe test in p 744256 -- so far i've had a hard time nailing down ordering issues to the point that i can make meaningful assertions :-/ | 16:01 |
patchbot | https://review.opendev.org/#/c/744256/ - swift - sharding: probe test to exercise manual shrinking - 3 patch sets | 16:01 |
*** gyee has joined #openstack-swift | 16:33 | |
*** ykarel has quit IRC | 17:05 | |
*** ykarel_ has joined #openstack-swift | 17:05 | |
*** patchbot has quit IRC | 17:19 | |
*** ykarel_ has quit IRC | 17:19 | |
*** ade_lee has quit IRC | 18:41 | |
*** ade_lee has joined #openstack-swift | 18:41 | |
*** ade_lee has quit IRC | 18:42 | |
*** lxkong has quit IRC | 19:39 | |
openstackgerrit | Merged openstack/swift master: Increase container_update_timeout in in-process func tests https://review.opendev.org/761692 | 20:48 |
openstackgerrit | Tim Burke proposed openstack/swift master: ring: Allow 32-bit (or even 8-bit) device IDs https://review.opendev.org/761794 | 21:17 |
openstackgerrit | Tim Burke proposed openstack/swift master: tests: Increase container-update timeouts for rolling upgrade jobs https://review.opendev.org/761796 | 21:33 |
*** lxkong has joined #openstack-swift | 21:58 | |
openstackgerrit | Tim Burke proposed openstack/swift master: Have REPLICATE with suffixes just append to hashes.invalid https://review.opendev.org/758636 | 22:55 |
openstackgerrit | Tim Burke proposed openstack/swift master: Stop invalidating suffixes post-SSYNC https://review.opendev.org/761801 | 22:55 |
timburke | i've been seeing some spotty ignored exceptions during unit test runs lately -- look like http://paste.openstack.org/show/799790/ | 22:57 |
timburke | has anybody else seen that? | 22:58 |
timburke | :-/ i'm really not sure how to try to deal with those unit test failures in the gate that ultimately coe down to something like "ERROR with Container server 127.0.0.1:47901/sda1 re: Trying to PUT /a/dd1f94cfad8c4ae1afa1d34139e507d8: Timeout (20.0s)" | 23:26 |
timburke | 20s is a *long time*, even in the gate. it's *really hard* to justify increasing that | 23:27 |
openstackgerrit | Merged openstack/swift master: Remove the unused coding style modules https://review.opendev.org/759790 | 23:42 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!