openstackgerrit | Timur Alperovich proposed openstack/swift: Silence "Client disconnected" warnings on reads. https://review.openstack.org/363316 | 00:06 |
---|---|---|
openstackgerrit | Timur Alperovich proposed openstack/swift: Silence "Client disconnected" warnings on reads. https://review.openstack.org/363316 | 00:07 |
*** takashi has joined #openstack-swift | 00:07 | |
*** manous_ has quit IRC | 00:12 | |
openstackgerrit | Merged openstack/swift: Close the iterators in string_along. https://review.openstack.org/363199 | 00:15 |
*** chlong has quit IRC | 00:16 | |
*** mingyu has quit IRC | 00:25 | |
*** abhitechie has joined #openstack-swift | 00:26 | |
*** takashi has quit IRC | 00:26 | |
*** dfflanders has joined #openstack-swift | 00:26 | |
*** mingyu has joined #openstack-swift | 00:33 | |
*** Vinsh has quit IRC | 00:38 | |
clayg | timburke: ok, at the urging of a couple of core in #python-dev I poked the bees nest on that bug -> http://bugs.python.org/issue22233 | 00:38 |
clayg | timburke: now i'm wondering if you have your py3proxy branch somewhere we could build python 3.6 with the patch and see if it acctually fixes the issue? | 00:38 |
*** Vinsh has joined #openstack-swift | 00:39 | |
*** mingyu has quit IRC | 00:41 | |
*** Suyi_1 has quit IRC | 00:43 | |
*** mingyu has joined #openstack-swift | 00:47 | |
*** m_kazuhiro has joined #openstack-swift | 00:53 | |
*** asettle has joined #openstack-swift | 00:54 | |
*** delattec has quit IRC | 00:56 | |
*** trananhkma has joined #openstack-swift | 00:57 | |
openstackgerrit | Merged openstack/python-swiftclient: Convert numeric and boolean header values to strings https://review.openstack.org/360725 | 00:58 |
*** asettle has quit IRC | 00:59 | |
*** _JZ_ has quit IRC | 01:02 | |
kota_ | good morning | 01:05 |
mattoliverau | kota_: morning | 01:06 |
kota_ | mattolivearu: o// | 01:07 |
*** dmorita has quit IRC | 01:21 | |
zhengyin | koata_, mattoliverau: good morning | 01:27 |
mattoliverau | zhengyin: morning :) | 01:28 |
*** abhitechie has quit IRC | 01:33 | |
*** chlong has joined #openstack-swift | 01:40 | |
*** _JZ_ has joined #openstack-swift | 01:49 | |
*** arnoldchen has joined #openstack-swift | 02:04 | |
*** bkopilov has quit IRC | 02:05 | |
*** Vinsh has quit IRC | 02:07 | |
*** Vinsh has joined #openstack-swift | 02:10 | |
*** ChanServ sets mode: +v jrichli | 02:19 | |
*** diogogmt has quit IRC | 02:19 | |
*** tqtran has quit IRC | 02:22 | |
*** nadeem has joined #openstack-swift | 02:31 | |
*** gyee has quit IRC | 02:31 | |
*** Jeffrey4l_ has joined #openstack-swift | 02:38 | |
*** ChubYann has quit IRC | 02:42 | |
*** ChubYann has joined #openstack-swift | 02:56 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/89250 | 03:10 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 03:10 |
*** tqtran has joined #openstack-swift | 03:21 | |
*** dmorita has joined #openstack-swift | 03:21 | |
*** bkopilov has joined #openstack-swift | 03:22 | |
*** dmorita has quit IRC | 03:26 | |
*** mingyu has quit IRC | 03:33 | |
*** arnoldchen has quit IRC | 03:33 | |
*** Vinsh has quit IRC | 03:37 | |
*** Vinsh has joined #openstack-swift | 03:40 | |
*** dmorita has joined #openstack-swift | 03:42 | |
*** diogogmt has joined #openstack-swift | 03:44 | |
*** dmorita has quit IRC | 03:46 | |
*** arnoldchen has joined #openstack-swift | 03:53 | |
*** mingyu has joined #openstack-swift | 03:53 | |
*** mingyu has quit IRC | 03:53 | |
*** arnoldchen has quit IRC | 03:58 | |
*** abhitechie has joined #openstack-swift | 04:00 | |
*** bkopilov_ has joined #openstack-swift | 04:03 | |
*** bkopilov_ has quit IRC | 04:03 | |
*** bkopilov_ has joined #openstack-swift | 04:04 | |
*** arnoldchen has joined #openstack-swift | 04:04 | |
*** arnoldchen has quit IRC | 04:09 | |
*** cschwede has quit IRC | 04:17 | |
*** cschwede has joined #openstack-swift | 04:17 | |
*** _JZ_ has quit IRC | 04:27 | |
*** arnoldchen has joined #openstack-swift | 04:31 | |
*** SkyRocknRoll has joined #openstack-swift | 04:35 | |
*** arnoldchen has quit IRC | 04:36 | |
*** arnoldchen has joined #openstack-swift | 04:36 | |
*** links has joined #openstack-swift | 04:36 | |
*** chlong has quit IRC | 04:38 | |
*** chlong has joined #openstack-swift | 04:39 | |
*** arnoldchen has quit IRC | 04:40 | |
*** arnoldchen has joined #openstack-swift | 04:41 | |
*** Vinsh has quit IRC | 04:42 | |
*** ppai has joined #openstack-swift | 04:43 | |
*** chlong has quit IRC | 04:45 | |
*** chsc has joined #openstack-swift | 04:46 | |
*** chsc has joined #openstack-swift | 04:46 | |
*** Vinsh has joined #openstack-swift | 04:47 | |
*** Jeffrey4l_ has quit IRC | 04:56 | |
*** chlong has joined #openstack-swift | 04:57 | |
*** asettle has joined #openstack-swift | 04:57 | |
*** chsc has quit IRC | 04:58 | |
*** asettle has quit IRC | 05:02 | |
*** psachin has joined #openstack-swift | 05:05 | |
*** zaitcev has quit IRC | 05:07 | |
*** arnoldchen has quit IRC | 05:11 | |
*** suresh_ has joined #openstack-swift | 05:16 | |
*** arnoldchen has joined #openstack-swift | 05:17 | |
*** diogogmt has quit IRC | 05:17 | |
suresh_ | hii all i want to know about "read and write permissions on containers" | 05:18 |
suresh_ | please suggest me some links | 05:18 |
*** arnoldchen has quit IRC | 05:21 | |
*** ppai has quit IRC | 05:24 | |
mattoliverau | suresh_: you can take a look at http://docs.openstack.org/developer/swift/misc.html#module-swift.common.middleware.acl to get an idea of how acls look/work and briefly described http://docs.openstack.org/developer/swift/overview_auth.html I.e. the headers to use. X-Container-Read and X-Container-Write. | 05:31 |
*** ChubYann has quit IRC | 05:32 | |
suresh_ | mattoliverau: thanks | 05:33 |
mattoliverau | suresh_: swiftstack have this https://www.swiftstack.com/docs/cookbooks/swift_usage/container_acl.html but they talk about using there specific usernames. In essence you can define an ACL by .referrer (or just .r) or by user, the latter depends on your auth system. | 05:34 |
suresh_ | mattoliverau: yeah i will read and try these | 05:34 |
suresh_ | mattoliverau: thanks for your response | 05:35 |
mattoliverau | suresh_: no probs | 05:35 |
*** arnoldchen has joined #openstack-swift | 05:35 | |
*** arnoldchen has quit IRC | 05:40 | |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: CompositeRing Support https://review.openstack.org/271920 | 05:45 |
kota_ | just rebased, still working. | 05:45 |
*** arnoldchen has joined #openstack-swift | 05:46 | |
*** arnoldchen has quit IRC | 05:51 | |
*** arnoldchen has joined #openstack-swift | 05:53 | |
*** arnoldchen has quit IRC | 05:57 | |
*** Vinsh has quit IRC | 05:58 | |
*** ppai has joined #openstack-swift | 05:58 | |
*** arnoldchen has joined #openstack-swift | 05:59 | |
*** kei_yama has quit IRC | 06:02 | |
*** Vinsh has joined #openstack-swift | 06:02 | |
*** arnoldchen has quit IRC | 06:03 | |
*** ttrumm has joined #openstack-swift | 06:05 | |
*** arnoldchen has joined #openstack-swift | 06:11 | |
*** pcaruana has joined #openstack-swift | 06:15 | |
*** arnoldchen has quit IRC | 06:15 | |
*** rcernin has joined #openstack-swift | 06:21 | |
*** arnoldchen has joined #openstack-swift | 06:22 | |
*** sheel has joined #openstack-swift | 06:24 | |
*** ttrumm has quit IRC | 06:25 | |
*** ttrumm has joined #openstack-swift | 06:25 | |
*** arnoldchen has quit IRC | 06:26 | |
*** SkyRocknRoll has quit IRC | 06:36 | |
*** arnoldchen has joined #openstack-swift | 06:40 | |
*** arnoldchen has quit IRC | 06:44 | |
*** silor has joined #openstack-swift | 06:46 | |
*** joeljwright1 has joined #openstack-swift | 06:48 | |
*** joeljwright1 has quit IRC | 06:48 | |
*** mingyu has joined #openstack-swift | 06:54 | |
*** ChanServ sets mode: +v cschwede | 06:55 | |
*** mingyu has quit IRC | 06:59 | |
*** hseipp has joined #openstack-swift | 06:59 | |
*** arnoldchen has joined #openstack-swift | 07:03 | |
*** arnoldchen has quit IRC | 07:05 | |
*** arnoldchen has joined #openstack-swift | 07:05 | |
*** tesseract- has joined #openstack-swift | 07:08 | |
*** Vinsh has quit IRC | 07:17 | |
*** Vinsh has joined #openstack-swift | 07:22 | |
*** trananhkma has quit IRC | 07:26 | |
*** arnoldchen has quit IRC | 07:34 | |
*** abhinavtechie has joined #openstack-swift | 07:34 | |
*** arnoldchen has joined #openstack-swift | 07:34 | |
*** abhitechie has quit IRC | 07:37 | |
openstackgerrit | Nguyen Phuong An proposed openstack/swift: Config logABug feature for Swift api-ref https://review.openstack.org/363452 | 07:41 |
*** SkyRocknRoll has joined #openstack-swift | 07:45 | |
*** geaaru has joined #openstack-swift | 07:50 | |
*** silor1 has joined #openstack-swift | 07:54 | |
*** silor has quit IRC | 07:55 | |
*** silor1 is now known as silor | 07:55 | |
*** bkopilov_ has quit IRC | 07:57 | |
*** bkopilov has quit IRC | 07:57 | |
*** bkopilov has joined #openstack-swift | 08:01 | |
*** chlong has quit IRC | 08:06 | |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/swift: [WIP] Testing latest u-c https://review.openstack.org/318441 | 08:10 |
*** kong has quit IRC | 08:22 | |
*** kong has joined #openstack-swift | 08:23 | |
*** silor has quit IRC | 08:31 | |
*** mingyu has joined #openstack-swift | 08:35 | |
*** Vinsh has quit IRC | 08:37 | |
*** Vinsh has joined #openstack-swift | 08:42 | |
*** dmorita has joined #openstack-swift | 08:46 | |
*** nadeem has quit IRC | 08:47 | |
*** ttrumm has quit IRC | 08:49 | |
*** ttrumm has joined #openstack-swift | 08:50 | |
*** dmorita has quit IRC | 08:51 | |
*** ttrumm has quit IRC | 08:55 | |
*** asettle has joined #openstack-swift | 08:58 | |
*** hseipp has quit IRC | 09:01 | |
*** brnelson has quit IRC | 09:23 | |
*** brnelson has joined #openstack-swift | 09:24 | |
*** marok has quit IRC | 09:29 | |
*** marok has joined #openstack-swift | 09:29 | |
*** trananhkma has joined #openstack-swift | 09:36 | |
*** arnoldchen has quit IRC | 09:40 | |
*** abhinavtechie has quit IRC | 09:51 | |
*** Vinsh has quit IRC | 09:53 | |
*** Vinsh has joined #openstack-swift | 09:55 | |
*** manous_ has joined #openstack-swift | 09:59 | |
*** SkyRocknRoll has quit IRC | 10:01 | |
openstackgerrit | Joel Wright proposed openstack/python-swiftclient: Fix tests/unit/test_shell.py copy tests result order https://review.openstack.org/363552 | 10:12 |
*** hosanai has quit IRC | 10:15 | |
*** manous_ has quit IRC | 10:24 | |
suresh_ | hii all, while uploading more than 5 GB file through chunks it is creating "object_name"+segments container | 10:32 |
suresh_ | why it is creating that container | 10:33 |
suresh_ | please someone help | 10:33 |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Enable object server to return non-durable data https://review.openstack.org/215276 | 10:33 |
*** chrichip has joined #openstack-swift | 10:34 | |
joeljwright | suresh_: are you using the python-swiftclient? | 10:35 |
kota_ | suresh_: that is becuase swift doesn't allow > 5GB file as an object in default ( you can change the conf in swift.conf) | 10:35 |
kota_ | joel! | 10:35 |
joeljwright | kota_: hey! | 10:35 |
joeljwright | suresh_: the python swiftclient creates a new container called 'container_segments' for uploading large objects | 10:35 |
kota_ | joeljwright: probably that's default behavioer of swiftclient command line to make SLO? | 10:36 |
joeljwright | suresh_: the manifest file that represents the large object is placed in the original container, all the data goes into container_segments | 10:36 |
joeljwright | suresh_: loads of info about what's happening when uploading >5gb here: http://docs.openstack.org/developer/swift/overview_large_objects.html | 10:37 |
kota_ | yeah, to split the file to small "segments" and make a manifest which you can download the original > 5GB object via the path you want to upload. | 10:37 |
joeljwright | kota_: how's things? Will you be at the summit in October? | 10:37 |
kota_ | joerlwright: I'll be there! | 10:38 |
joeljwright | :) | 10:38 |
*** manous_ has joined #openstack-swift | 10:38 | |
kota_ | joeljwright: i'm looking forward to meeting you there ;-) | 10:38 |
suresh_ | joeljwright: If i delete the manifest file then the data in container_segments will be delete? | 10:39 |
joeljwright | kota_: should be fun. I've been really busy since Austin, just trying to get back into swift stuff again | 10:39 |
kota_ | joeljwright: np, welcome to get back anyway :) | 10:40 |
joeljwright | suresh_: I need to check that | 10:43 |
suresh_ | will you please check once and let me know what is happening when deleteing manifest. | 10:45 |
joeljwright | suresh_: I believe that segments are only deleted if you're using DLO at the moment | 10:49 |
joeljwright | suresh_: deleting an SLO will currently leave the segments in storage I believe | 10:50 |
*** chrichip has quit IRC | 10:50 | |
suresh_ | joeljwrightL: sorry what is DLO and SLO ? | 10:50 |
joeljwright | suresh_: see the link I sent you earlier | 10:51 |
joeljwright | suresh_: DLO == 'dynamic large object', SLO == 'static large object' | 10:51 |
*** chrichip has joined #openstack-swift | 10:51 | |
suresh_ | joeljwright: yeah got it | 10:51 |
*** chrichip has quit IRC | 10:56 | |
suresh_ | joeljwrightL: i uploaded a 10 GB file through python-swift client | 10:56 |
suresh_ | why it is showing less size in swift stat container | 10:56 |
suresh_ | it is showing 12MB in stat of that container | 10:57 |
*** chrichip has joined #openstack-swift | 10:57 | |
joeljwright | suresh_: swift stat container only shows the size of the data in that container; all the object contents are in container_segments | 10:57 |
joeljwright | suresh_: swift stat container_segments will show the size of the data you expect | 10:58 |
suresh_ | joeljwright: yeah thanks for your responses. | 10:58 |
joeljwright | suresh_: np :) | 10:58 |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: EC Fragment Duplication - Foundational Global EC Cluster Support https://review.openstack.org/219165 | 11:00 |
kota_ | rebased | 11:00 |
kota_ | because my landed patch conflicted with my patch :/ | 11:00 |
joeljwright | kota_: glad I'm not the only one who does that :) | 11:01 |
*** abhinavtechie has joined #openstack-swift | 11:01 | |
*** Vinsh has quit IRC | 11:02 | |
kota_ | joeljwright: ;) | 11:03 |
kota_ | it's time to back home, bye guys | 11:04 |
joeljwright | kota_: bye | 11:04 |
openstackgerrit | zheng yin proposed openstack/python-swiftclient: Add commands examples for copy and delete https://review.openstack.org/363581 | 11:07 |
*** Vinsh has joined #openstack-swift | 11:07 | |
*** chrichip has quit IRC | 11:10 | |
*** chrichip has joined #openstack-swift | 11:11 | |
*** bkopilov has quit IRC | 11:11 | |
suresh_ | hii all, how to write in to one object which is in online Is there anyway" | 11:17 |
suresh_ | please someone help | 11:17 |
*** chrichip has quit IRC | 11:18 | |
*** chrichip has joined #openstack-swift | 11:19 | |
*** dmorita has joined #openstack-swift | 11:23 | |
*** SkyRocknRoll has joined #openstack-swift | 11:25 | |
*** chrichip has quit IRC | 11:26 | |
*** chrichip has joined #openstack-swift | 11:27 | |
*** dmorita has quit IRC | 11:27 | |
*** ttrumm has joined #openstack-swift | 11:41 | |
*** dfflanders has quit IRC | 11:41 | |
*** ttrumm has quit IRC | 11:41 | |
*** ttrumm has joined #openstack-swift | 11:42 | |
*** chrichip has quit IRC | 11:44 | |
*** chrichip has joined #openstack-swift | 11:45 | |
*** asettle has quit IRC | 11:53 | |
*** asettle has joined #openstack-swift | 11:58 | |
*** asettle has quit IRC | 11:58 | |
*** asettle has joined #openstack-swift | 11:59 | |
*** chrichip has quit IRC | 12:00 | |
*** chrichip has joined #openstack-swift | 12:00 | |
*** tongli has quit IRC | 12:03 | |
*** Jeffrey4l_ has joined #openstack-swift | 12:10 | |
*** sheel has quit IRC | 12:16 | |
*** Vinsh has quit IRC | 12:17 | |
*** dmorita has joined #openstack-swift | 12:19 | |
*** Vinsh has joined #openstack-swift | 12:20 | |
*** dmorita has quit IRC | 12:24 | |
*** suresh_ has quit IRC | 12:31 | |
*** openstackgerrit has quit IRC | 12:34 | |
*** openstackgerrit has joined #openstack-swift | 12:34 | |
*** trananhkma has quit IRC | 12:39 | |
*** abhinavtechie has quit IRC | 12:44 | |
*** abhinavtechie has joined #openstack-swift | 12:44 | |
*** bkopilov has joined #openstack-swift | 12:46 | |
*** tongli has joined #openstack-swift | 12:47 | |
*** tongli has quit IRC | 12:48 | |
*** tongli has joined #openstack-swift | 12:49 | |
*** m_kazuhiro has quit IRC | 12:54 | |
openstackgerrit | Christian Schwede proposed openstack/swift: More TestAccountController test updates https://review.openstack.org/363628 | 12:59 |
openstackgerrit | Christian Schwede proposed openstack/swift: More Test[Account|Container]Controller test updates https://review.openstack.org/363628 | 13:05 |
*** ttrumm has quit IRC | 13:07 | |
*** ttrumm has joined #openstack-swift | 13:08 | |
*** psachin has quit IRC | 13:09 | |
*** abhinavtechie has quit IRC | 13:11 | |
*** abhinavtechie has joined #openstack-swift | 13:12 | |
*** StraubTW has joined #openstack-swift | 13:17 | |
*** SkyRocknRoll has quit IRC | 13:22 | |
*** klamath has joined #openstack-swift | 13:22 | |
*** klamath has quit IRC | 13:22 | |
*** klamath has joined #openstack-swift | 13:23 | |
*** takashi has joined #openstack-swift | 13:23 | |
*** Vinsh has quit IRC | 13:27 | |
*** zul has quit IRC | 13:30 | |
*** Vinsh has joined #openstack-swift | 13:30 | |
*** zul has joined #openstack-swift | 13:33 | |
*** chrichip has quit IRC | 13:40 | |
*** chrichip has joined #openstack-swift | 13:41 | |
*** ttrumm has quit IRC | 13:43 | |
*** ttrumm has joined #openstack-swift | 13:44 | |
*** chrichip has quit IRC | 13:46 | |
*** chrichip has joined #openstack-swift | 13:47 | |
*** ttrumm has quit IRC | 13:48 | |
*** jamielennox|away is now known as jamielennox | 13:55 | |
*** chsc has joined #openstack-swift | 13:56 | |
openstackgerrit | Christian Schwede proposed openstack/swift: Fix swiftdir option and usage of storage policy aliases https://review.openstack.org/344693 | 13:56 |
*** psachin has joined #openstack-swift | 13:57 | |
openstackgerrit | Merged openstack/swift: Add unit case https://review.openstack.org/350471 | 13:57 |
*** tongli_ has joined #openstack-swift | 13:58 | |
*** abhinavtechie has quit IRC | 13:59 | |
*** links has quit IRC | 14:00 | |
*** tongli has quit IRC | 14:01 | |
*** jamielennox is now known as jamielennox|away | 14:01 | |
*** chrichip has quit IRC | 14:02 | |
*** jamielennox|away is now known as jamielennox | 14:02 | |
*** chrichip has joined #openstack-swift | 14:03 | |
*** baojg has joined #openstack-swift | 14:05 | |
*** silor has joined #openstack-swift | 14:07 | |
openstackgerrit | Mohit Motiani proposed openstack/swift: Add regions and zones in ring-builder.py https://review.openstack.org/350625 | 14:10 |
*** manous_ has quit IRC | 14:21 | |
*** manous_ has joined #openstack-swift | 14:21 | |
*** psachin has quit IRC | 14:22 | |
*** ppai has quit IRC | 14:27 | |
openstackgerrit | Merged openstack/swift: Add test to validate the error strings in test_expirer https://review.openstack.org/360914 | 14:28 |
*** Vinsh has quit IRC | 14:42 | |
*** Vinsh has joined #openstack-swift | 14:49 | |
*** ChubYann has joined #openstack-swift | 14:51 | |
*** m_kazuhiro has joined #openstack-swift | 14:52 | |
*** abhitechie has joined #openstack-swift | 14:53 | |
*** m_kazuhiro has quit IRC | 14:59 | |
*** m_kazuhiro has joined #openstack-swift | 15:01 | |
*** tongli_ has quit IRC | 15:01 | |
*** ttrumm has joined #openstack-swift | 15:02 | |
*** tongli has joined #openstack-swift | 15:02 | |
*** dmellado is now known as dmellado|mtg | 15:04 | |
*** m_kazuhiro has quit IRC | 15:04 | |
*** manous_ has quit IRC | 15:04 | |
*** jamielennox is now known as jamielennox|away | 15:05 | |
*** tongli has quit IRC | 15:07 | |
*** diogogmt has joined #openstack-swift | 15:14 | |
*** tongli has joined #openstack-swift | 15:14 | |
*** tongli has quit IRC | 15:18 | |
*** pcaruana has quit IRC | 15:22 | |
*** rcernin has quit IRC | 15:22 | |
*** ttrumm has quit IRC | 15:28 | |
*** dmellado|mtg is now known as dmellado | 15:33 | |
*** Vinsh_ has joined #openstack-swift | 15:34 | |
notmyname | good morning | 15:36 |
*** tesseract- has quit IRC | 15:36 | |
*** Vinsh has quit IRC | 15:37 | |
*** _JZ_ has joined #openstack-swift | 15:38 | |
*** rcernin has joined #openstack-swift | 15:54 | |
*** sheel has joined #openstack-swift | 15:57 | |
*** links has joined #openstack-swift | 16:10 | |
*** ouchkernel has joined #openstack-swift | 16:11 | |
*** asettle has quit IRC | 16:12 | |
*** tongli has joined #openstack-swift | 16:13 | |
*** asettle has joined #openstack-swift | 16:13 | |
*** nikivi has joined #openstack-swift | 16:14 | |
*** chrichip has quit IRC | 16:16 | |
*** asettle has quit IRC | 16:17 | |
*** chrichip has joined #openstack-swift | 16:17 | |
*** dmorita has joined #openstack-swift | 16:23 | |
*** tongli_ has joined #openstack-swift | 16:26 | |
*** chsc has quit IRC | 16:27 | |
*** jith_ has joined #openstack-swift | 16:27 | |
*** dmorita has quit IRC | 16:28 | |
*** tongli has quit IRC | 16:29 | |
*** tongli_ has quit IRC | 16:30 | |
*** tongli has joined #openstack-swift | 16:32 | |
*** mingyu has quit IRC | 16:32 | |
*** mingyu has joined #openstack-swift | 16:32 | |
*** mingyu has quit IRC | 16:32 | |
*** ukaynar has joined #openstack-swift | 16:32 | |
*** tongli has quit IRC | 16:36 | |
timburke | clayg: you could, but it'd probably be better to test with python-swiftclient. following https://review.openstack.org/#/c/360135/ the functests should generally all pass, but definitely don't if you've got, say, u'\u5605' in your account tempurl key | 16:38 |
patchbot | patch 360135 - python-swiftclient - Make functests py3-compatible | 16:38 |
*** tongli has joined #openstack-swift | 16:38 | |
*** aswadr_ has joined #openstack-swift | 16:39 | |
*** abhitechie has quit IRC | 16:40 | |
*** tongli has quit IRC | 16:43 | |
*** dmorita has joined #openstack-swift | 16:43 | |
*** tongli has joined #openstack-swift | 16:44 | |
*** tongli has quit IRC | 16:48 | |
*** daemontool has joined #openstack-swift | 16:50 | |
*** chsc has joined #openstack-swift | 16:56 | |
*** tongli has joined #openstack-swift | 16:57 | |
*** tongli has quit IRC | 17:02 | |
*** chsc has quit IRC | 17:03 | |
*** nadeem has joined #openstack-swift | 17:04 | |
notmyname | FYI swift is mentioned here several times. https://news.ycombinator.com/item?id=12392081 | 17:08 |
notmyname | a common issue raised is "really hard to initially set up" (however, good once that happens) | 17:09 |
*** baojg has quit IRC | 17:10 | |
*** tongli has joined #openstack-swift | 17:12 | |
*** tongli has quit IRC | 17:17 | |
timburke | notmyname: i'm a little sad to not see swift mentioned more in https://news.ycombinator.com/item?id=12398303 | 17:21 |
ahale_ | large scale object storage seems much harder to run than to set up, the day to day things that go along with having a lot of machines with a lot of disks | 17:22 |
*** tongli has joined #openstack-swift | 17:24 | |
notmyname | timburke: I see one mention of swift in the comments (and positive) | 17:25 |
notmyname | ahale_: it's not hard when you have A(hale)aaS | 17:27 |
ahale_ | hah | 17:28 |
*** tongli has quit IRC | 17:28 | |
* notmyname is choosing tshirt colors right now | 17:29 | |
*** tongli has joined #openstack-swift | 17:30 | |
*** ttrumm has joined #openstack-swift | 17:31 | |
*** tongli_ has joined #openstack-swift | 17:31 | |
*** mingyu has joined #openstack-swift | 17:33 | |
*** StraubTW has quit IRC | 17:33 | |
*** tongli_ has quit IRC | 17:34 | |
*** tongli has quit IRC | 17:35 | |
*** tongli_ has joined #openstack-swift | 17:35 | |
*** mingyu has quit IRC | 17:38 | |
*** tongli_ has quit IRC | 17:39 | |
*** pcaruana has joined #openstack-swift | 17:39 | |
*** tongli has joined #openstack-swift | 17:40 | |
*** ttrumm has quit IRC | 17:43 | |
*** tongli has quit IRC | 17:43 | |
*** tongli has joined #openstack-swift | 17:44 | |
*** ttrumm has joined #openstack-swift | 17:44 | |
*** tongli has quit IRC | 17:46 | |
*** tongli has joined #openstack-swift | 17:46 | |
*** ttrumm has quit IRC | 17:48 | |
*** tongli has quit IRC | 17:50 | |
*** zaitcev has joined #openstack-swift | 17:50 | |
*** ChanServ sets mode: +v zaitcev | 17:50 | |
*** tongli has joined #openstack-swift | 17:50 | |
*** ukaynar has quit IRC | 17:51 | |
openstackgerrit | Timur Alperovich proposed openstack/swift: Silence "Client disconnected" warnings on reads. https://review.openstack.org/363316 | 17:54 |
*** tongli has quit IRC | 17:58 | |
*** tongli has joined #openstack-swift | 17:58 | |
*** tongli_ has joined #openstack-swift | 18:00 | |
*** geaaru has quit IRC | 18:02 | |
jrichli | im really excited about the shirts! great design | 18:02 |
*** diogogmt has quit IRC | 18:02 | |
*** tongli has quit IRC | 18:03 | |
*** chsc has joined #openstack-swift | 18:03 | |
*** chsc has joined #openstack-swift | 18:03 | |
*** thumpba has joined #openstack-swift | 18:05 | |
clayg | timburke: awesome, full ack | 18:08 |
*** tongli has joined #openstack-swift | 18:11 | |
*** tongli_ has quit IRC | 18:14 | |
*** Suyi_ has joined #openstack-swift | 18:18 | |
*** ukaynar has joined #openstack-swift | 18:19 | |
*** ukaynar has quit IRC | 18:22 | |
*** tongli has quit IRC | 18:43 | |
*** tongli has joined #openstack-swift | 18:44 | |
openstackgerrit | Thiago da Silva proposed openstack/swift: Add option to set default version mode https://review.openstack.org/361439 | 18:45 |
*** tongli_ has joined #openstack-swift | 18:46 | |
*** diogogmt has joined #openstack-swift | 18:48 | |
*** tongli has quit IRC | 18:48 | |
*** thumpba has quit IRC | 18:49 | |
*** thumpba has joined #openstack-swift | 18:49 | |
tdasilva | jrichli: now you can actually add a +2 on patch 357559 ;) | 18:54 |
patchbot | https://review.openstack.org/#/c/357559/ - swift - Include metadata in PUT/POST responses | 18:54 |
*** sheel has quit IRC | 18:56 | |
*** diogogmt has quit IRC | 18:57 | |
jrichli | tdasilva: you are right! | 18:59 |
* jrichli goes to retest and re-review | 18:59 | |
jrichli | its gonna take awhile to be comfortable with that, me thinks! | 19:00 |
*** links has quit IRC | 19:13 | |
*** silor has quit IRC | 19:17 | |
tdasilva | jrichli: congrats again! :) | 19:23 |
*** daemontool has quit IRC | 19:23 | |
jrichli | tdasilva: thanks! | 19:23 |
zaitcev | hip hip Jamie! | 19:24 |
zaitcev | But now you have to become comfortable to review all the dusty crannies, like ACLs | 19:25 |
jrichli | zaitcev: true. I look forward to learning about the 'dusty crannies'! | 19:25 |
*** aswadr_ has quit IRC | 19:31 | |
*** McMurlock1 has joined #openstack-swift | 19:33 | |
redbo | ಠ_ಠ| 19:40 |
notmyname | timburke: (/cc joeljwright) looks like the main outstanding things for swiftclient have been merged | 19:53 |
joeljwright | notmyname: I think so, will check through my review list | 20:01 |
notmyname | joeljwright: thanks. I'm cleaning up the changelog now. will push in a few minutes | 20:01 |
joeljwright | notmyname: patch 184956 could do with landing | 20:09 |
patchbot | https://review.openstack.org/#/c/184956/ - python-swiftclient - Accept gzip-encoded API responses | 20:09 |
openstackgerrit | John Dickinson proposed openstack/python-swiftclient: authors/changelog updates for 3.1.0 release https://review.openstack.org/361775 | 20:10 |
joeljwright | but I guess we can live without it | 20:11 |
notmyname | joeljwright: hmm...looks like it had already been approved | 20:11 |
joeljwright | need to go and collect my wife from the station - be back for the meeting | 20:11 |
notmyname | I'll ping mattoliverau about it in the meeting, but I want to have a commit SHA for release today | 20:13 |
*** diogogmt has joined #openstack-swift | 20:14 | |
*** nikivi has quit IRC | 20:16 | |
*** tongli_ has quit IRC | 20:16 | |
*** mingyu has joined #openstack-swift | 20:23 | |
openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Fix intermittent test failure https://review.openstack.org/361537 | 20:27 |
*** mingyu has quit IRC | 20:28 | |
timur | I noticed there's been a couple of times where I can't get the test artifact after a failure. Most recently here: https://review.openstack.org/#/c/363316/ (the cluster-swift-tox-func-ec). Is that likely a temporary CI issue? | 20:28 |
patchbot | patch 363316 - swift - Silence "Client disconnected" warnings on reads. | 20:28 |
*** nikivi has joined #openstack-swift | 20:29 | |
*** Jeffrey4l__ has joined #openstack-swift | 20:34 | |
*** Jeffrey4l_ has quit IRC | 20:35 | |
notmyname | dont' land https://review.openstack.org/#/c/361775/ quite yet. there's something on it I want to bring up in the meeting (reno) | 20:40 |
patchbot | patch 361775 - python-swiftclient - authors/changelog updates for 3.1.0 release | 20:40 |
kota_ | good morning | 20:54 |
mattoliverau | Morning | 20:56 |
*** m_kazuhiro has joined #openstack-swift | 20:56 | |
notmyname | mattoliverau: summary from scrollback... can you look at https://review.openstack.org/#/c/184956/ ? you previously gave a +2, but it got rebased and a test added. it would be nice to have in a release, but if that happens, we need to land it in the next few hours | 20:57 |
patchbot | patch 184956 - python-swiftclient - Accept gzip-encoded API responses | 20:57 |
notmyname | meeting in 2 minutes in #openstack-meeting | 20:58 |
mattoliverau | notmyname: I can do that thing :) I'll will look post meeting | 21:00 |
notmyname | thanks | 21:00 |
notmyname | clayg: ping (meeting) | 21:01 |
openstackgerrit | Tim Burke proposed openstack/swift: Include correct version in install-guide https://review.openstack.org/363938 | 21:10 |
*** thumpba has quit IRC | 21:41 | |
timburke | on reno, i wonder if we could define custom section headers? i could see some value in being able to group features by target audience: here are new things available to you as a client, or a middleware writer, or an operator (or on the client side, as a CLI user vs as a developer) | 21:45 |
clayg | RE the term "cross-project" and esp. as it relates to "liasons" - i've just come to realize I misunderstood the meaning of "cross-project" for a long time | 21:46 |
clayg | I used to think it had something to with like Swift working with barbican to deliver some sweet OpenStack encrypted security cloud infrasture capabilities awesomesauce - but it turns out "cross-project" is not that at all | 21:47 |
notmyname | clayg: +1000 | 21:48 |
clayg | "cross-project" means "shit in OpenStack that's not about building cloud infrastrucutre software" like if you work on Hacking that's cross-project, or like the gate, or like reno, or a process for | 21:48 |
*** diogogmt has quit IRC | 21:48 | |
clayg | ... I mean really my point is that I heard cross project I thought it ment OpenStack projects working together to deliver awsome cloud infrastrucutre - but it's really like EVERYTHING that makes up OpenStack that I don't pay attention to | 21:49 |
clayg | i'm like... literally the WORST possible at corss project :'( | 21:49 |
mattoliverau | lol | 21:49 |
kota_ | ah, make sense. cross-project... that is becoming it seems working across projects to me | 21:50 |
kota_ | i meant "common things for all projects" | 21:51 |
mattoliverau | I work with the stable PTL (he's on my team) so it might make sense if I step up and be the stable liason.. that way he can always poke me in person :) | 21:51 |
notmyname | mattoliverau: if the past is any indicator, that will happen about zero times ;-) | 21:53 |
mattoliverau | notmyname: lol, great even better, but it'll look like we are participating :P | 21:53 |
*** chrichip has quit IRC | 21:54 | |
clarkb | clayg: I think its meant to be both... and I am sorry you don't feel that the work others do is important for building clouds. Who needs documentation right? | 21:54 |
*** chrichip has joined #openstack-swift | 21:55 | |
clayg | nadeem: I'm not sure it's a given that having to manage two directories with a .git subdir will ruin the community? | 22:01 |
*** m_kazuhiro has quit IRC | 22:02 | |
clayg | nadeem: I think most of us already commit and work in different places - including swift and python-swiftclient - if the split is the way that works best for the TC we should be open to that - it's still the right direction | 22:02 |
clayg | clarkb: I love documentation. It feels good to write documentation on a new feature. It's like cleaning your room - you put it off because it seems like a boring/annoying chore - but you know you should - and once you do - aww man - it feels so GOOOD! | 22:04 |
clayg | or fixing bugs in old docs - yum | 22:04 |
clayg | i just don't know how to do it anywhere besides the repos and code I pay attention to - and I suck at paying attention to documentation that other people wrote :'( | 22:05 |
clarkb | yes I think that specific reason is why cross project includes "shit in openstack thats not about building cloud infrastructure" | 22:06 |
*** joeljwright has quit IRC | 22:06 | |
clayg | yeah it's not a knock on anyone excep me - my understanding - my short coming | 22:06 |
clayg | admiting you ahve a problem is like a first tep right! | 22:06 |
pdardeau | clayg: it's a tough crowd :-) | 22:07 |
clayg | it's just i'm not sure i'm an island in this regard either - i think the term itself (granted partially aided by my own willful ignorance) has allowed me to misconstrue the nature of the criteques that have been built up over the years | 22:11 |
*** dmorita has quit IRC | 22:11 | |
clayg | so... just like a public admission I'm working on my mental models here people - it's been eye opening | 22:12 |
*** mingyu has joined #openstack-swift | 22:12 | |
clarkb | well I think its both things. It is helpling swift and barbican and whoever else work on neat features but also to help people do things like documentation and test their software and so on using a common set of tools and expectatiosn so we don't all have to relearn it every time we clone a new project | 22:12 |
notmyname | I think my perspective is that there's other projects that provide functionality (eg barbican with crypto stuff), and in my mind they're all equal. eg barbican provides something, so does the -infra team | 22:14 |
*** asettle has joined #openstack-swift | 22:14 | |
notmyname | so working with barbican or keystone is just the same as working with docs or release or infra | 22:14 |
clayg | notmyname: clarkb: gah - i feel like I disagree with both of those statements :P | 22:14 |
clayg | it's almost contrary to waht I'm trying to say | 22:14 |
clayg | like for swift <=> barbican - we have API's mostly for that | 22:15 |
notmyname | we make sure that where we integrate to consume the functionality provided we do it well and in a way that doesn't break other people | 22:15 |
notmyname | yeah, APIs are where it's at | 22:15 |
notmyname | and as a member of openstack, we provide an api for storage and we want to work with other projects to make sure it works well | 22:15 |
clayg | and when we work on stuff to integrate and consume - that's... i mean it requires people across projects working - but that's - you don't get cross project credit for that :D | 22:15 |
clayg | you get cross project creds if *everyone* benifits - never do something that helps you if you can do something that helps everyone | 22:16 |
*** mingyu has quit IRC | 22:16 | |
clayg | i'm still working on this here - spitballin' - i may not have it nailed down yet | 22:16 |
clarkb | one example that comes to mind is sorting out cinder volume multi attach. Thats api that has had to involve nova nd cinder because REST api is involved as well as libvirt among other things (as I understand it) | 22:17 |
clayg | i still think that's <10% of "cross-project" | 22:17 |
clayg | people *want* it to >50% of "cross-project" but mostly that only effects cinder & nova and it doesn't "count" - not anymore than swift working with zaqar or searchlight | 22:18 |
clarkb | Oh I don't care about percentages I just want openstack to be able to talk to each other so that we can fix problems | 22:18 |
clarkb | and historically we have sucked at that | 22:18 |
*** asettle has quit IRC | 22:19 | |
*** dmorita has joined #openstack-swift | 22:21 | |
clayg | clarkb: i ... don't really have a context to place that statement in :\ | 22:21 |
clarkb | one example is for a very long long time we said nova net is deprecated stop using it. But at the same time neutron was not implementing the features that nova net had that users wanted because nova and neutron never actually seemed to communicate about what was necessary to make nova net go away | 22:22 |
clayg | if nova and cinder want to "fix" multi-attach - they just do it - i really think it's worthwhile to seperate *that* as "cross-project" to whatever the *other* "cross-project" is | 22:22 |
clarkb | its only been in the last cycle or two where we actually started having those discussions and now we might actually be able to delete nova net. Its amazing how quickly that happened once we started doing this | 22:22 |
clarkb | but without it we got nowhere just had ltos of angry devs and users | 22:22 |
clarkb | clayg: history has shown that it just doesn't hapepn though. ANyways people like liasons hopeflly open up those doors and allow us to have those conversations allowing the just do it to happen | 22:23 |
clayg | we're definately conflating some different things with the same term - and I think swift as a project and more imporantly as a community is FUCKING GREAT an fixing shit and getting shit done - you gotta real use-case problem - i don't care where you from - let's fix it | 22:23 |
clarkb | eh | 22:24 |
clarkb | I was told no :{ | 22:24 |
clarkb | er :P | 22:24 |
clarkb | would you please please fix your logging? If I ask now does it count more? | 22:24 |
clarkb | swift logs are almost unindexable because they don't care enough information along with them and they are not configurable to do so | 22:24 |
patchbot | You've given me 5 invalid commands within the last 60 seconds; I'm now ignoring you for 10 minutes. | 22:24 |
clayg | patchbot: you are out of control bro! | 22:25 |
clarkb | definitely keep the existing formats for backward compat (I had no problem with this before and continue to not have a problem with that) but it would be really ncie to be able to at least opt into a log format that is useful | 22:25 |
clarkb | I don't even care if you use oslo logging | 22:25 |
clayg | clarkb: you know - i probably didn't put 2 + 2 together here - notmyname was saying something to me about logging - first he or I had ever heard of it - coming up recently? I don't know all the details? | 22:25 |
clarkb | I asked for this years ago | 22:25 |
clarkb | but I know other people have been banging the drum more. I mostly gave up years ago when I was told no | 22:26 |
clayg | clarkb: you know - honestly - I probably don't understand the problem or requirements really all that well | 22:28 |
clarkb | The big problems are missing timestamps in many places and where we do have timestamps they don't have subsecond resolution | 22:29 |
clayg | clarkb: but I will say that if it would really make a big difference to you - I'd love to take up the torch | 22:29 |
clayg | ... sorry - my first gut reaction to that is to fix the rsyslog formatting | 22:30 |
clarkb | yes thats the other problem | 22:30 |
clarkb | you only support rsyslog | 22:30 |
clarkb | please support at least python logging, its in stdlib doesn't add anymore deps to swift and continues to support syslog | 22:30 |
clarkb | there are also at least two major formats in use. the apache common log format then the else format | 22:33 |
clayg | aren't proxy logs mostly in the apache format? (with extra fields) | 22:34 |
*** klamath has quit IRC | 22:34 | |
clarkb | its a mix | 22:34 |
clarkb | things like authorizing user show up not in apache format, but then the top level GET is apache format | 22:35 |
clarkb | I also think we have a lack of log levels as a result? I would have to go digging more | 22:36 |
clayg | clarkb: most folks already use the proxy_logging configuration to send just proxy access logs to a seperate logger - it's not clear to me how things that aren't really access log statements would be converted to the apache format | 22:36 |
clarkb | but log levels tend to be very useful for "oh something just broken let me grep/search/whatever for ERROR" | 22:36 |
clarkb | at least the logs we end up with in the gate for swift seem to be levelless | 22:37 |
jrichli | i suspect its the way we integrate our logging with devstack. | 22:38 |
clarkb | clayg: apache has a non HTTP request type of format which swift doesn't seem to follow | 22:38 |
jrichli | when i split out my logs in my saio, i can grep for ERROR in the error logfile | 22:38 |
clarkb | for error logs and such | 22:38 |
clarkb | which means you can't use standard recipes for parsing eg apache logs to deal with swift logs | 22:39 |
clarkb | I guess its specifically the proxy as the other services use the else format too | 22:40 |
clayg | jrichli: i was just looking at the code for "log_custom_handlers" - apparently you can configure swift logging to do basically anything you want | 22:42 |
clayg | clarkb: i agree with jrichli there's probably a gap with how devstack want's to configure logging - but irc is probably not the greatest forum to caputre requirements :'( | 22:43 |
clarkb | sorry was mistaken the other services do appear to be pretty consistent bout doig apache's format its the proxy where we have the mix and things get annoying to deal with | 22:45 |
clayg | *really*? that's backwards as I would understand swift logging. and outside of request logging to my knowledge there is no "format" that I know of other than how the logger format and syslog have been configured | 22:47 |
clarkb | just looking at the semi random sample of eg http://logs.openstack.org/38/363838/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/a796242/logs/screen-s-account.txt.gz compared to the proxy log from the same thing | 22:48 |
clarkb | that file is all apache format | 22:48 |
clarkb | http://logs.openstack.org/38/363838/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/a796242/logs/screen-s-proxy.txt.gz is not | 22:49 |
clayg | most of the messages i'm seeing emitted from the proxy log there are coming from the keystone components :( | 22:50 |
clayg | what *are* those curl lines!? | 22:50 |
clayg | god help us if someone that acctually deploys swift has logs like that :D | 22:51 |
clarkb | those are your defaults aiui | 22:51 |
clarkb | as devstack isn't configuring logging its just saying go | 22:51 |
timburke | clayg: makes sense to me; non-proxy does very little logging other than requests (short of bugs like the one fixed in https://review.openstack.org/#/c/285754/) | 22:52 |
patchbot | patch 285754 - swift - Require account/container metadata be UTF-8 (MERGED) | 22:52 |
timburke | clayg: the curl lines are largely (entirely?) to do with keystone auth | 22:52 |
clayg | timburke: yeah I see that - but the version we package doesn't make that much noise - and if it did - we'd figure out some way to shut it up ;) | 22:52 |
clayg | clarkb: this is where I think the conversation gets to turn back to what I was trying to say about 'cross-project' vs "cross-project" the problem is that keystone and swift need to get together and come up with a better interface to handle logs - someone just needs to make the devstack logging configuration better for swift + keystone | 22:54 |
* notmyname had stepped out and is back now | 22:54 | |
clayg | I'm not sure how much *additional* work would be needed in devstack's swift configuration logging to meet all of your requirements - or maybe your complaint is that it "shouldn't" take anything "just say go" | 22:54 |
clarkb | sure I think that is fine. But the last time I broached the subject it was met with our logs are perfect and we can't break our users (I never asked for that anyways) so no | 22:55 |
clarkb | so its not just having keystone + swift + devsatck work together | 22:55 |
clarkb | its being willing to have the conversation in the first place | 22:55 |
clarkb | clayg: and yes ideally there would be zero config for that. swift logs should work sanely out of the box | 22:55 |
clayg | i'm not sure if i was in that earlier converstation - but it's quite possible - because I really think i've had a long term misunderstanding about the terms | 22:56 |
*** _JZ_ has quit IRC | 22:57 | |
clayg | obviously we're somehow missing each other a little bit here - but i think i'm trying to suggest that if keystone + swift + devstack logging just met your requirements - you'd acctually be pretty damn happy | 22:57 |
clarkb | but this is probably why your users are asking you to use oslo logging because by default oslo logging has a sane setup out of the box (at least the projects that use it do). I don't want to get into the argument of whether ot not you should use oslo.logging this is solveable with and without doing so. But possible this si whwere some of that comes from | 22:57 |
clayg | clarkb: somehow when you tell me what my users want i feel like we're placing ourselves at odds :\ | 22:59 |
clarkb | clayg: you were the one that brought up people wanting oslo logging earlier... just saying that I think some of the motivation there is to have logs taht work out of the box | 22:59 |
clayg | as far as sane setup out of the box - i guess it depends who's box it's coming out of maybe? idk. | 22:59 |
clarkb | not necessarily that I or $user really care if you use oslo logging | 23:00 |
clarkb | and thats being used as a proxy for make logs better and if we focused on making logs better maybe the other fight goes away I dunno | 23:00 |
notmyname | clarkb: I'm not sure if what you're saying is that there's something about swift's logs that are broken or that the swift team is unwilling to change anything about logging | 23:01 |
clarkb | notmyname: both | 23:01 |
clayg | rofl | 23:02 |
clarkb | the logs are very hard to use to track down problems (I think the links above are decent examples of that) | 23:02 |
clayg | clarkb: I hope we've put in a bunch of effort over the years to make you this jaded! otherwise I'd feel that's fairly counter productive. :D | 23:02 |
clarkb | and I have asked multiple times in the past grantedits been yaers since the last occasion for swift to please fix it | 23:02 |
clayg | clarkb: i mean... again... i'm not sure that's super producive - but you're welcome to vent a little bit - I'm even *sorry* you feel that way | 23:03 |
notmyname | clarkb: but I can't fix "it's hard to find problems". http://docs.openstack.org/developer/swift/logs.html | 23:03 |
clarkb | notmyname: please see scrollback I gave many examples of where things are bad | 23:03 |
clayg | clarkb: but bro... like do you have a bug we can reference with the use-case and requirements? | 23:03 |
*** Trixboxer has quit IRC | 23:04 | |
clarkb | clayg: I am sure there is likely a bug from a few years ago that can be drug up. I don't know what it is off the top of my head | 23:04 |
clarkb | I had to get neutronand glance and a few others to work on these things too and there was a big bug iirc but swift was not interested. | 23:04 |
clayg | clarkb: I do hope we can find it (i'm looking) because I think it cuts to heart of my point about 'cross-project' vs. "cross-project" | 23:05 |
clarkb | notmyname: specifically only syslog is supported (please support other writers python logging is good at this), please do subsecond timestamp resolution (you would get this for free with python logging), use apache logging format consistently so that existing tools can be used to parse those logs | 23:05 |
clayg | Instead of "logging sucks for me" we hear "you need to change your log format" and instead of "let me help you configure your system to meet your requirements" we say "i'm not going to break my users to fix it so the default logging configuration meets your alone needs" | 23:06 |
clarkb | or I guess apache logging format isn't a hard requirement just be consistent | 23:06 |
clarkb | clayg: as I said I have no interest in breaking your existing users | 23:06 |
clarkb | I think we cuold get by with making it opt in | 23:07 |
notmyname | python logging and syslog are orthogonal. we actually use python's logging module to send stuff to syslog | 23:07 |
clayg | clarkb: i know - we're still talking past each other - it's *amazing* people are able to communicate on IRC at all with out some prior human experience with each other :D | 23:07 |
clarkb | notmyname: right let me clarify. Allow me to configure python logging using its configuration format. Last I checked you hardcoded syslog so I can't use other handlers and loggers | 23:07 |
clayg | clarkb: there's a way you can configure custom handlers | 23:07 |
clayg | clarkb: you could configure syslog to ignore (or not write) logs from swift or confugre swift to dump to /dev/null or w/e - or you can configure syslog to do whatever you want | 23:08 |
clarkb | clayg: but I can't edit the format either right? which is what the loggers do iirc | 23:08 |
*** nikivi has quit IRC | 23:09 | |
clayg | either way - MY point - YOU shouldn't have to do anything - that's not "cross-project" - that's 'cross-project' - if swift was good at "cross-project" we'd fix devstack to meet your requirements :D | 23:09 |
*** Trixboxer has joined #openstack-swift | 23:09 | |
clayg | clarkb: see I thought handlers had formatters :D | 23:09 |
*** McMurlock1 has quit IRC | 23:09 | |
clayg | handler.setFormatter seems like a thing | 23:10 |
clarkb | I think the flow is logger -> formatter -> handler | 23:11 |
clarkb | so you'd need to be able to create formatters and set them on handlers | 23:11 |
clarkb | ah its actually logger -> handler via the handle method which runs the formaters | 23:12 |
*** mingyu has joined #openstack-swift | 23:12 | |
clayg | clarkb: ok, so we don't have to write any code in IRC here ;) - I think you had like three things somewhere that would make a great requirements for fixing swift's logging in your environment | 23:13 |
clayg | there it is -> [23:04] clarkb | notmyname: specifically only syslog is supported (please support other writers python logging is good at this), please do subsecond timestamp resolution (you would get this for free with python logging), use apache logging format consistently so that existing tools can be used to parse those logs | 23:14 |
*** jamielennox|away is now known as jamielennox | 23:14 | |
*** mingyu has quit IRC | 23:17 | |
*** manous has joined #openstack-swift | 23:17 | |
*** manous has quit IRC | 23:22 | |
*** jamielennox is now known as jamielennox|away | 23:22 | |
clayg | clarkb: hey man, look - even if nothing else - THANK YOU - for stepping up and raising your voice - those logs are *truly* terrible -> https://bugs.launchpad.net/swift/+bug/1619073 | 23:23 |
openstack | Launchpad bug 1619073 in OpenStack Object Storage (swift) "Swift logs in devstack are terrible" [Undecided,New] | 23:23 |
*** manous has joined #openstack-swift | 23:23 | |
clarkb | clayg: and tahnk you for being willing to listen | 23:23 |
*** jamielennox|away is now known as jamielennox | 23:28 | |
*** manous has quit IRC | 23:28 | |
*** kei_yama has joined #openstack-swift | 23:31 | |
*** chrichip has quit IRC | 23:36 | |
*** jamielennox is now known as jamielennox|away | 23:36 | |
*** manous_ has joined #openstack-swift | 23:37 | |
*** chrichip has joined #openstack-swift | 23:37 | |
*** hosanai has joined #openstack-swift | 23:38 | |
*** ChanServ sets mode: +v hosanai | 23:38 | |
*** chsc has quit IRC | 23:39 | |
*** chrichip has quit IRC | 23:42 | |
*** chrichip has joined #openstack-swift | 23:43 | |
*** manous_ has quit IRC | 23:44 | |
*** manous_ has joined #openstack-swift | 23:44 | |
*** manous_ has quit IRC | 23:45 | |
*** diogogmt has joined #openstack-swift | 23:46 | |
*** nadeem has quit IRC | 23:51 | |
*** Suyi_ has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!