*** Underknowledge has quit IRC | 01:08 | |
*** Underknowledge has joined #openstack-swift | 01:09 | |
*** gyee has quit IRC | 01:17 | |
*** Underknowledge2 has joined #openstack-swift | 01:51 | |
*** Underknowledge has quit IRC | 01:54 | |
*** Underknowledge2 is now known as Underknowledge | 01:54 | |
*** rcernin has quit IRC | 02:00 | |
*** rcernin has joined #openstack-swift | 02:29 | |
*** rcernin has quit IRC | 02:29 | |
*** aluria has quit IRC | 02:29 | |
*** rcernin has joined #openstack-swift | 02:30 | |
*** aluria has joined #openstack-swift | 02:33 | |
*** fingo has quit IRC | 02:34 | |
*** Underknowledge has quit IRC | 02:38 | |
*** fingo has joined #openstack-swift | 02:44 | |
*** rcernin has quit IRC | 02:44 | |
*** rcernin has joined #openstack-swift | 03:16 | |
*** dasp has quit IRC | 03:34 | |
*** dasp has joined #openstack-swift | 03:45 | |
*** psachin has joined #openstack-swift | 03:51 | |
*** evrardjp has quit IRC | 05:33 | |
*** evrardjp has joined #openstack-swift | 05:33 | |
openstackgerrit | Matthew Oliver proposed openstack/swift master: Add a config file option to swift-manage-shard-ranges https://review.opendev.org/c/openstack/swift/+/774584 | 05:35 |
---|---|---|
*** m75abrams has joined #openstack-swift | 05:35 | |
*** rcernin has quit IRC | 07:44 | |
*** rpittau|afk is now known as rpittau | 07:52 | |
*** Underknowledge has joined #openstack-swift | 09:11 | |
openstackgerrit | Alistair Coles proposed openstack/swift master: Add a config file option to swift-manage-shard-ranges https://review.opendev.org/c/openstack/swift/+/774584 | 10:47 |
acoles | mattoliverau: fixed py3 error that was squashed in with my test fixups ^^ | 10:48 |
openstackgerrit | Merged openstack/python-swiftclient stable/ussuri: Add release note for 3.9.1 https://review.opendev.org/c/openstack/python-swiftclient/+/769551 | 10:55 |
*** dsariel has joined #openstack-swift | 11:51 | |
*** psachin has quit IRC | 13:01 | |
*** jv_ has quit IRC | 13:55 | |
*** jv_ has joined #openstack-swift | 14:00 | |
*** takamatsu has joined #openstack-swift | 14:17 | |
*** jv_ has quit IRC | 14:33 | |
*** jv_ has joined #openstack-swift | 14:34 | |
openstackgerrit | Alistair Coles proposed openstack/swift master: Fix race in diskfile.relink_paths https://review.opendev.org/c/openstack/swift/+/778474 | 14:40 |
*** jv_ has quit IRC | 14:59 | |
*** jv_ has joined #openstack-swift | 15:07 | |
*** takamatsu has quit IRC | 16:11 | |
*** m75abrams has quit IRC | 16:48 | |
*** jv_ has quit IRC | 17:01 | |
*** hoonetorg has quit IRC | 17:01 | |
*** stand has quit IRC | 17:01 | |
*** klamath_atx has quit IRC | 17:01 | |
*** lifeless_ has quit IRC | 17:01 | |
*** mahatic has quit IRC | 17:01 | |
*** timss has quit IRC | 17:01 | |
*** openstackgerrit has quit IRC | 17:02 | |
*** stand has joined #openstack-swift | 17:05 | |
*** jv_ has joined #openstack-swift | 17:07 | |
*** hoonetorg has joined #openstack-swift | 17:07 | |
*** mahatic has joined #openstack-swift | 17:07 | |
*** klamath_atx has joined #openstack-swift | 17:07 | |
*** lifeless_ has joined #openstack-swift | 17:07 | |
*** timss has joined #openstack-swift | 17:07 | |
*** tepper.freenode.net sets mode: +v mahatic | 17:07 | |
*** fingo has quit IRC | 18:10 | |
*** fingo has joined #openstack-swift | 18:10 | |
*** rpittau is now known as rpittau|afk | 18:11 | |
acoles | gerrit announcements seems to be broken | 18:37 |
acoles | mattoliverau: timburke__ clayg pls note https://review.opendev.org/c/openstack/swift/+/778530 Fix os.stat/os.link race in diskfile.relink_paths [NEW] | 18:37 |
acoles | and https://review.opendev.org/c/openstack/swift/+/778540 Add unit test for diskfile.relink_paths [NEW] | 18:38 |
*** fingo has quit IRC | 18:44 | |
*** fingo has joined #openstack-swift | 18:46 | |
*** fingo has quit IRC | 18:46 | |
*** fingo has joined #openstack-swift | 18:47 | |
DHE | looking at the API doc, ?multipart-manifest=delete will delete the segment files when deleting the large object, but only for SLO types? looking at https://docs.openstack.org/api-ref/object-store/index.html | 19:21 |
timburke__ | DHE, yes, that's correct. if it's not an SLO, that same request will 400 | 19:28 |
*** fingo has quit IRC | 19:38 | |
*** fingo has joined #openstack-swift | 19:39 | |
*** lifeless_ is now known as lifeless | 19:56 | |
*** klamath_atx has quit IRC | 20:05 | |
*** klamath_atx has joined #openstack-swift | 20:07 | |
*** rcernin has joined #openstack-swift | 20:46 | |
timburke__ | almost meeting time | 20:53 |
mattoliverau | morning | 20:55 |
seongsoocho | morning !! | 20:55 |
kota_ | morning all | 20:58 |
*** openstackgerrit has joined #openstack-swift | 20:59 | |
openstackgerrit | Alistair Coles proposed openstack/swift master: WIP: relinker: only invalidate hash when link is created https://review.opendev.org/c/openstack/swift/+/778579 | 20:59 |
*** gyee has joined #openstack-swift | 21:01 | |
*** rcernin has quit IRC | 21:17 | |
*** irclogbot_2 has quit IRC | 21:33 | |
*** tristanC has quit IRC | 21:33 | |
*** irclogbot_2 has joined #openstack-swift | 21:34 | |
*** tristanC has joined #openstack-swift | 21:34 | |
seongsoocho | Is there fast(???) way to count diskfiles on disk? | 21:47 |
DHE | most filesystems offer an inode count with `df -i` which is not the same thing, but may be useful in making an estimate | 21:50 |
seongsoocho | and I rechecked the relinker log file, there are almost 100 millions diskfiles are relinked on one node. | 21:52 |
seongsoocho | In my mornitoring dashboard, It took approximately 2 days to complete relink job per disk.... | 21:55 |
*** rcernin has joined #openstack-swift | 22:05 | |
*** rcernin has quit IRC | 22:11 | |
*** timburke_ has joined #openstack-swift | 22:11 | |
*** ChanServ sets mode: +v timburke_ | 22:11 | |
*** rcernin has joined #openstack-swift | 22:11 | |
*** timburke__ has quit IRC | 22:13 | |
seongsoocho | DHE: Thanks. `df -i` says, there are 20,000,000 inode are used. so.. there are almost 10,000,000 disk files in disk before the relink job. | 22:15 |
seongsoocho | https://usercontent.irccloud-cdn.com/file/Z1kgKEkM/image.png | 22:15 |
DHE | sounds about right | 22:18 |
DHE | I'd say less than half would be the right estimate | 22:19 |
DHE | 20 million inodes would probably be in the 9.5 to 10 million objects range | 22:19 |
timburke_ | that would about line up with OVH's findings when looking at the lots-of-small-files work | 22:32 |
DHE | I'm just estimating since each object would be in its own private directory (give or take replication shenanigans), so double. And of course there's more than that for hash prefixes/suffixes, so more than double | 22:35 |
DHE | well, in the other direction, so less than half | 22:36 |
*** rcernin has quit IRC | 22:56 | |
*** rcernin has joined #openstack-swift | 23:01 | |
*** timburke__ has joined #openstack-swift | 23:01 | |
*** ChanServ sets mode: +v timburke__ | 23:01 | |
*** timburke_ has quit IRC | 23:04 | |
*** rcernin has quit IRC | 23:26 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!