Friday, 2020-11-06

openstackgerritMerged openstack/swift master: Continue logging deprecation warnings for run_pause  https://review.opendev.org/76147400:24
*** gyee has quit IRC00:53
*** klamath_atx has quit IRC01:42
openstackgerritTim Burke proposed openstack/swift master: Increase container_update_timeout in in-process func tests  https://review.opendev.org/76169201:42
openstackgerritMerged openstack/swift master: Add librsvg2-* to bindep.txt  https://review.opendev.org/76159301:43
*** klamath_atx has joined #openstack-swift02:11
*** yuxin_ has quit IRC02:34
*** zamba has quit IRC02:34
*** yuxin_ has joined #openstack-swift02:34
openstackgerritMerged openstack/swift master: Refactor audit shard tests  https://review.opendev.org/74452502:37
*** zamba has joined #openstack-swift02:41
*** rcernin has quit IRC02:54
*** rcernin has joined #openstack-swift03:13
*** ykarel|away has joined #openstack-swift05:01
*** ykarel|away is now known as ykarel05:02
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-swift05:33
*** rcernin has quit IRC05:36
*** rcernin has joined #openstack-swift05:44
*** rcernin has quit IRC05:57
*** rcernin has joined #openstack-swift06:04
*** rcernin has quit IRC06:21
*** rpittau|afk is now known as rpittau06:47
*** rcernin has joined #openstack-swift07:03
openstackgerritAde Lee proposed openstack/swift master: replace md5 with swift utils version  https://review.opendev.org/75196607:54
*** rcernin has quit IRC08:09
*** rcernin has joined #openstack-swift08:52
*** rcernin has quit IRC09:06
*** rcernin has joined #openstack-swift11:40
*** rcernin has quit IRC12:08
*** ykarel has quit IRC12:40
*** ykarel has joined #openstack-swift12:41
rledisezclayg: to deploy, we create a virtualenv /opt/swift-<version+build id> and we then create a package (debian, but it does not matter) of that directory. we decided this way to remove the dependencies with the OS. We also deploy our own python build with openssl, libec, … embedded to reduce the OS dependencies to the very minimal (libc and zlib I think)12:44
rledisezi'm in the situation where I need to shard a shard (who said "deep" container? :)).12:49
rledisezfrom documentation I understand it's the exact same command except it must run against the shard db file:12:49
rledisezswift-manage-shard-ranges </path/to/container-shard.db> find_and_replace 500000 --enable12:49
rledisezis that correct?12:49
acolesrledisez: I believe that is correct https://docs.openstack.org/swift/latest/overview_container_sharding.html#sharding-a-shard-container but I suggest that you wait for clayg or timburke to reply because they have experience of doing this14:38
*** rpittau is now known as rpittau|afk15:18
claygi mean, i haven't sharded a container form the commandline in prod in awhile 😬15:31
claygbut that seems to be about what I run in dev!15:31
claygthe command does the scan "inline" - so for big databases it's going to take a minute15:32
timburkerledisez, yeah, same process15:40
ade_leetimburke, anything else still needed on https://review.opendev.org/751966 ?15:43
patchbotpatch 751966 - swift - replace md5 with swift utils version - 12 patch sets15:43
timburkeade_lee, looks like it's ready for review -- i'll see if i can do that in the not-too-distant future15:54
rledisezclayg: timburke thx for the feedback. same question to shrink, the command is not documented actually. is it the same command on the root container?15:54
ade_leetimburke, thanks!15:54
timburkerledisez, you'll need to pick up https://review.opendev.org/#/c/741721/ -- command will look like `swift-manage-shard-ranges </path/to/root.db> shrink <shard-name>`15:58
patchbotpatch 741721 - swift - add swift-manage-shard-ranges shrink command - 8 patch sets15:58
rledisezok, thx! I don't have to shrink yet, but i'll add this to my bookmarks :)15:59
timburke(we should probably look at being able to do something like `swift-manage-shard-ranges </path/to/root.db> shrink --below-size <N>`)15:59
timburkerledisez, i'll likely try to pull out the consistency-enginechanges into a leading patch, and let the manage-shard-ranges change stay separate. we'll see what i can swing with the probe test in p 744256 -- so far i've had a hard time nailing down ordering issues to the point that i can make meaningful assertions :-/16:01
patchbothttps://review.opendev.org/#/c/744256/ - swift - sharding: probe test to exercise manual shrinking - 3 patch sets16:01
*** gyee has joined #openstack-swift16:33
*** ykarel has quit IRC17:05
*** ykarel_ has joined #openstack-swift17:05
*** patchbot has quit IRC17:19
*** ykarel_ has quit IRC17:19
*** ade_lee has quit IRC18:41
*** ade_lee has joined #openstack-swift18:41
*** ade_lee has quit IRC18:42
*** lxkong has quit IRC19:39
openstackgerritMerged openstack/swift master: Increase container_update_timeout in in-process func tests  https://review.opendev.org/76169220:48
openstackgerritTim Burke proposed openstack/swift master: ring: Allow 32-bit (or even 8-bit) device IDs  https://review.opendev.org/76179421:17
openstackgerritTim Burke proposed openstack/swift master: tests: Increase container-update timeouts for rolling upgrade jobs  https://review.opendev.org/76179621:33
*** lxkong has joined #openstack-swift21:58
openstackgerritTim Burke proposed openstack/swift master: Have REPLICATE with suffixes just append to hashes.invalid  https://review.opendev.org/75863622:55
openstackgerritTim Burke proposed openstack/swift master: Stop invalidating suffixes post-SSYNC  https://review.opendev.org/76180122:55
timburkei've been seeing some spotty ignored exceptions during unit test runs lately -- look like http://paste.openstack.org/show/799790/22:57
timburkehas anybody else seen that?22:58
timburke:-/ i'm really not sure how to try to deal with those unit test failures in the gate that ultimately coe down to something like "ERROR with Container server 127.0.0.1:47901/sda1 re: Trying to PUT /a/dd1f94cfad8c4ae1afa1d34139e507d8: Timeout (20.0s)"23:26
timburke20s is a *long time*, even in the gate. it's *really hard* to justify increasing that23:27
openstackgerritMerged openstack/swift master: Remove the unused coding style modules  https://review.opendev.org/75979023:42

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!