*** haomaiwang has quit IRC | 00:01 | |
*** haomaiwang has joined #openstack-swift | 00:01 | |
*** dewsday has quit IRC | 00:02 | |
*** siva_krishnan has joined #openstack-swift | 00:14 | |
*** daemontool has joined #openstack-swift | 00:17 | |
*** bill_az has quit IRC | 00:35 | |
*** arch-nemesis has quit IRC | 00:39 | |
*** mingyu has quit IRC | 00:43 | |
*** mingyu has joined #openstack-swift | 00:44 | |
*** Jeffrey4l has joined #openstack-swift | 00:44 | |
*** trifon has quit IRC | 00:45 | |
*** itlinux has joined #openstack-swift | 00:52 | |
*** Jeffrey4l has quit IRC | 00:57 | |
*** haomaiwang has quit IRC | 01:01 | |
*** haomaiwang has joined #openstack-swift | 01:01 | |
*** garthb has quit IRC | 01:03 | |
torgomatic | anyone know how to run just one functional test with .functests? I tried "./.functests test.functional.test_object:TestObject.test_read_write" like worked with nosetests, but I guess we're using ostestr now (whatever that is) and what i typed doesn't work. | 01:10 |
---|---|---|
torgomatic | also "./.functests --regex test.functional...." doesn't work either, FWIW | 01:11 |
torgomatic | okay; got it; it's now "./.functests --no-discover test.functional.test_object.TestObject.test_read_write"; sort of like before, but with extra args and the module:ClassName is now module.ClassName (: to .) | 01:16 |
*** dmorita has quit IRC | 01:22 | |
*** _JZ_ has quit IRC | 01:23 | |
*** dmorita has joined #openstack-swift | 01:23 | |
*** pdardeau has joined #openstack-swift | 01:31 | |
clayg | torgomatic: can you not still run them with nosetests? I was asking timburke how he manages with all this testr crazyness in python-swiftclient - and he was like yeah when I want to run a test I still use nose | 01:38 |
*** zhill has quit IRC | 01:52 | |
*** ChubYann has quit IRC | 01:56 | |
*** haomaiwang has quit IRC | 02:01 | |
*** lyrrad has quit IRC | 02:01 | |
*** haomaiwang has joined #openstack-swift | 02:01 | |
*** gyee has quit IRC | 02:06 | |
*** zhill has joined #openstack-swift | 02:07 | |
torgomatic | clayg: that's probably a good idea too; I was just used to using .functests | 02:08 |
*** zhill has quit IRC | 02:11 | |
*** klrmn has quit IRC | 02:17 | |
*** thurloat is now known as thurloat_isgone | 02:21 | |
*** asettle is now known as asettle-afk | 02:23 | |
*** forcebanana has quit IRC | 02:24 | |
*** mingyu has quit IRC | 02:35 | |
*** mingyu has joined #openstack-swift | 02:36 | |
*** dmorita has quit IRC | 02:42 | |
*** rickyrem1 has joined #openstack-swift | 02:42 | |
*** dmorita has joined #openstack-swift | 02:44 | |
*** rickyrem has quit IRC | 02:44 | |
*** rickyrem1 has quit IRC | 02:51 | |
*** asettle-afk has quit IRC | 02:53 | |
*** rickyrem has joined #openstack-swift | 02:57 | |
*** sanchitmalhotra has joined #openstack-swift | 03:00 | |
*** haomaiwang has quit IRC | 03:01 | |
*** haomaiwang has joined #openstack-swift | 03:01 | |
*** sgundur has left #openstack-swift | 03:05 | |
*** vinsh has joined #openstack-swift | 03:11 | |
vinsh | Hey! When using a dedicated replication network (different port for replicate and non replicate object-servers) AND making use of "servers_per_port". Do you need to configure a different port for each disks' replication port the same as the standard port? http://docs.openstack.org/developer/swift/deployment_guide.html#running-object-servers-per-disk Is not clear about this combo. | 03:13 |
*** klrmn has joined #openstack-swift | 03:14 | |
vinsh | So in that readme example.. "replication_port" might be 6004 6005 6004 6005. compared to "port" being 6000 6001 6000 6001 In that 2 node 2 disk example. ?? | 03:15 |
clayg | vinsh: you do not need to configure a seperate port - you can configure the replication server's port and *not* configure the replication server to use servers per port | 03:15 |
clayg | vinsh: no, i wouldn't configure it it that way - we just use one replication server with multiple workers for all disks (same replication port for all devices on the server) | 03:16 |
vinsh | Hey clayg! I'm finally working on the session feedback you gave me from months ago :) this is priority number one. I wonder which has the most benifit for servers_per_port... standard port or replcation_port ? | 03:16 |
vinsh | cool. Understood | 03:16 |
clayg | there's not a lot of traffic that goes over the object server replication port (the rsync port is unrelated) | 03:16 |
vinsh | I'm trying to get better perf out of my EC cluster... hope this gives me some boost in operations | 03:17 |
vinsh | Good to know, I was thinking this was the case.. but needed to confirm. | 03:17 |
clayg | vinsh: also since it's background work it tpooling of the listdirs in the suffix rehashing causes some stutter in response time's as observed from the remote object-replciator - they're not particuarlly latency sensitive clients | 03:17 |
clayg | oic | 03:17 |
clayg | well if you're looking at background reconstruction load in your ec cluster it's going to be quite different - in that it uses ssync as the primary data transport instead of rsync | 03:19 |
vinsh | servers_per_port should be an improvement from just using "workers" as I am now. I'll roll this out and test | 03:19 |
vinsh | Yeah, true.. but it shouldn't have to reconstruct much.. unless data goes missing | 03:19 |
clayg | yes for the standard write path - ec or replicated - servers_per_pork (wokers per disk) is better overall latency and throughput | 03:19 |
clayg | vinsh: correct | 03:20 |
vinsh | I think I abused my cluster with ssbench a bit to hard. Even after deleting all objects and containers.. the logs on object nodes are a stream of messages similar to: "Feb 9 03:20:09 localhost swift-object-server: 24.26.92.208:6003/d100/8312 Unexpected response: ":ERROR: 500 'ERROR: With :UPDATES: 14 failures to 0 successes'"" | 03:21 |
vinsh | Its like its trying to reconstruct or confirm deleted objects still. | 03:21 |
vinsh | But that's another investigation ;) | 03:21 |
vinsh | I think the only way I solved this in the past was to wipe the account/container drives clean. stop the ghost churn. | 03:22 |
clayg | weeeeelll, it's maybe some issue with misplaced frags - or some bug related to moving tombstones - there was a few patches for EC reconstructor early on, and few outstanding fixes (all acoles stuff, great stuff, although nothing critical that I'm aware of) | 03:25 |
clayg | ... you might want to do testing with the latest possible release/master you can get ahold of | 03:26 |
vinsh | I'm running 2.5.0-0ubuntu1~cloud0.. so not the most current... but the most current ubuntu has published. | 03:26 |
clayg | yeah 2.5.0 was liberty - there was some good stuff between then and 2.6.0 related to ec i'm *pretty* sure | 03:27 |
* vinsh wants 2.6.0 goodness | 03:27 | |
vinsh | clayg: Thanks for being such a helpful dude :) | 03:28 |
clayg | vinsh: it's all a front - ask anyone - i'm an asshole | 03:29 |
vinsh | ! :-D ! | 03:29 |
*** sanchitmalhotra has quit IRC | 03:33 | |
*** sanchitmalhotra has joined #openstack-swift | 03:35 | |
* vinsh gets to building master instead of waiting on cononical's package team. | 03:36 | |
*** sgundur has joined #openstack-swift | 03:38 | |
*** sgundur has left #openstack-swift | 03:38 | |
*** links has joined #openstack-swift | 03:41 | |
*** forcebanana has joined #openstack-swift | 03:44 | |
*** asettle-afk has joined #openstack-swift | 03:46 | |
*** asettle-afk is now known as asettle | 03:49 | |
*** diazjf has joined #openstack-swift | 03:54 | |
*** diazjf1 has joined #openstack-swift | 03:55 | |
*** diazjf has quit IRC | 03:58 | |
*** diazjf1 has quit IRC | 03:58 | |
*** haomaiwang has quit IRC | 04:01 | |
*** haomaiwa_ has joined #openstack-swift | 04:01 | |
*** rjaiswal has quit IRC | 04:08 | |
mahatic | good morning | 04:13 |
*** asettle has quit IRC | 04:18 | |
*** asettle has joined #openstack-swift | 04:19 | |
*** zhill has joined #openstack-swift | 04:28 | |
openstackgerrit | Merged openstack/swift: Speed up functional testing https://review.openstack.org/277465 | 04:31 |
*** daemontool has quit IRC | 04:32 | |
*** daemontool has joined #openstack-swift | 04:32 | |
*** haomaiwa_ has quit IRC | 05:01 | |
*** haomaiwang has joined #openstack-swift | 05:01 | |
*** dmorita has quit IRC | 05:06 | |
mattoliverau | mahatic: morning (sorry for late response) | 05:09 |
mahatic | mattoliverau: :) have a nice evening | 05:10 |
*** klrmn has quit IRC | 05:14 | |
*** SkyRocknRoll has joined #openstack-swift | 05:17 | |
*** rickyrem has quit IRC | 05:18 | |
*** daemontool_ has joined #openstack-swift | 05:21 | |
*** daemontool has quit IRC | 05:22 | |
*** krishna has joined #openstack-swift | 05:30 | |
*** dmorita has joined #openstack-swift | 05:37 | |
*** sanchitmalhotra1 has joined #openstack-swift | 05:51 | |
*** sanchitmalhotra has quit IRC | 05:53 | |
*** haomaiwang has quit IRC | 06:01 | |
*** haomaiwang has joined #openstack-swift | 06:01 | |
*** trifon has joined #openstack-swift | 06:02 | |
*** SkyRocknRoll has quit IRC | 06:07 | |
openstackgerrit | Christian Berendt proposed openstack/swift: Remove executable flag from sample config file https://review.openstack.org/277704 | 06:33 |
*** SkyRocknRoll has joined #openstack-swift | 06:36 | |
mahatic | mattoliverau: oh I got to read the scrollback only now; congrats on the house! | 06:39 |
*** haomaiwang has quit IRC | 07:01 | |
*** haomaiwang has joined #openstack-swift | 07:01 | |
*** dmorita has quit IRC | 07:03 | |
*** natarej_ has quit IRC | 07:21 | |
*** natarej_ has joined #openstack-swift | 07:21 | |
*** zaitcev has quit IRC | 07:26 | |
*** mingyu has quit IRC | 07:32 | |
*** mingyu has joined #openstack-swift | 07:32 | |
*** dmorita has joined #openstack-swift | 07:33 | |
*** asettle is now known as asettle-afk | 07:34 | |
*** cbartz has joined #openstack-swift | 07:36 | |
*** Zyric has quit IRC | 07:37 | |
*** dmorita has quit IRC | 07:37 | |
*** geaaru has joined #openstack-swift | 07:39 | |
*** SkyRocknRoll has quit IRC | 07:40 | |
*** Zyric has joined #openstack-swift | 07:45 | |
*** lyrrad has joined #openstack-swift | 07:49 | |
*** lyrrad has quit IRC | 07:54 | |
*** haomaiwang has quit IRC | 08:01 | |
*** haomaiwa_ has joined #openstack-swift | 08:01 | |
*** mvk has joined #openstack-swift | 08:04 | |
openstackgerrit | Merged openstack/swift: Changed EC backend from jerasure to liberasurecode in examples and docs https://review.openstack.org/274416 | 08:04 |
*** Zyric has quit IRC | 08:04 | |
*** mingyu has quit IRC | 08:05 | |
*** mingyu has joined #openstack-swift | 08:05 | |
*** rledisez has joined #openstack-swift | 08:08 | |
*** Zyric has joined #openstack-swift | 08:14 | |
*** Jeffrey4l has joined #openstack-swift | 08:23 | |
*** asettle-afk has quit IRC | 08:33 | |
*** asettle-afk has joined #openstack-swift | 08:45 | |
*** mvk has quit IRC | 08:49 | |
*** asettle-afk has quit IRC | 08:50 | |
*** acoles_ is now known as acoles | 08:55 | |
*** bkumar has joined #openstack-swift | 08:59 | |
*** mingyu has quit IRC | 09:00 | |
*** haomaiwa_ has quit IRC | 09:01 | |
*** mingyu has joined #openstack-swift | 09:01 | |
*** haomaiwang has joined #openstack-swift | 09:01 | |
acoles | mattoliverau: wow! I love the idea of having "Surf Beach" as a line in my address :D | 09:03 |
acoles | mattoliverau: the balcony looks like it would accommodate a hackathon :P | 09:04 |
*** mvk has joined #openstack-swift | 09:17 | |
acoles | torgomatic: clayg fwiw nosetests can still be used to run func tests individually (and collectively) e.g. nosetests ./test/functional/test_object.py:TestObject.test_too_small_x_timestamp | 09:21 |
acoles | or if you are feeling lucky, nosetests ./test/functional/test_object.py -m too_small | 09:22 |
*** joeljwright has joined #openstack-swift | 09:26 | |
*** ChanServ sets mode: +v joeljwright | 09:26 | |
*** mvk has quit IRC | 09:29 | |
*** zhill has quit IRC | 09:30 | |
*** mvk has joined #openstack-swift | 09:30 | |
*** SkyRocknRoll has joined #openstack-swift | 09:33 | |
*** asettle-afk has joined #openstack-swift | 09:39 | |
*** asettle-afk is now known as asettle | 09:39 | |
*** daemontool has joined #openstack-swift | 09:39 | |
*** daemontool_ has quit IRC | 09:40 | |
*** zhill has joined #openstack-swift | 09:51 | |
*** zhill has quit IRC | 09:56 | |
*** takashi has quit IRC | 10:00 | |
*** haomaiwang has quit IRC | 10:01 | |
*** haomaiwa_ has joined #openstack-swift | 10:01 | |
*** Jeffrey4l has quit IRC | 10:07 | |
*** silor has joined #openstack-swift | 10:36 | |
*** silor1 has joined #openstack-swift | 10:41 | |
*** silor has quit IRC | 10:42 | |
*** silor1 is now known as silor | 10:42 | |
*** km has quit IRC | 10:44 | |
*** zhill has joined #openstack-swift | 10:52 | |
*** zhill has quit IRC | 10:59 | |
*** haomaiwa_ has quit IRC | 11:01 | |
*** haomaiwang has joined #openstack-swift | 11:01 | |
*** mvk has quit IRC | 11:07 | |
*** mvk has joined #openstack-swift | 11:08 | |
openstackgerrit | Donagh McCabe proposed openstack/swift: Added links to API reference and usage guides https://review.openstack.org/276342 | 11:14 |
*** jmccarthy has quit IRC | 11:25 | |
*** jmccarthy has joined #openstack-swift | 11:27 | |
*** bkumar has quit IRC | 11:32 | |
*** sanchitmalhotra1 has quit IRC | 11:34 | |
*** mingyu_ has joined #openstack-swift | 11:42 | |
*** mingyu has quit IRC | 11:45 | |
*** zhill has joined #openstack-swift | 11:55 | |
*** zhill has quit IRC | 11:59 | |
*** kei_yama has quit IRC | 11:59 | |
*** haomaiwang has quit IRC | 12:01 | |
*** haomaiwang has joined #openstack-swift | 12:01 | |
*** thurloat_isgone is now known as thurloat | 12:22 | |
*** asettle has quit IRC | 12:35 | |
*** asettle has joined #openstack-swift | 12:35 | |
*** asettle has quit IRC | 12:38 | |
*** openstackgerrit_ has joined #openstack-swift | 12:39 | |
openstackgerrit | Christopher Bartz proposed openstack/swift: Adds storage policy option to recon https://review.openstack.org/276629 | 12:40 |
*** marcusvrn_ has joined #openstack-swift | 12:44 | |
*** SkyRocknRoll has quit IRC | 12:53 | |
*** zhill has joined #openstack-swift | 12:55 | |
openstackgerrit | Christian Berendt proposed openstack/swift: Remove executable flag from sample config file https://review.openstack.org/277704 | 12:57 |
*** mrmoje has joined #openstack-swift | 12:59 | |
*** zhill has quit IRC | 13:00 | |
*** haomaiwang has quit IRC | 13:01 | |
*** haomaiwang has joined #openstack-swift | 13:01 | |
*** links has quit IRC | 13:17 | |
*** bill_az has joined #openstack-swift | 13:25 | |
*** jordanP has joined #openstack-swift | 13:41 | |
*** daemontool has quit IRC | 13:42 | |
*** dmorita has joined #openstack-swift | 13:46 | |
*** haomaiwang has quit IRC | 13:46 | |
*** mrmoje has quit IRC | 13:46 | |
*** haomaiwa_ has joined #openstack-swift | 13:47 | |
*** mrmoje has joined #openstack-swift | 13:47 | |
*** openstackgerrit_ has quit IRC | 13:56 | |
*** zhill has joined #openstack-swift | 13:56 | |
*** rickyrem has joined #openstack-swift | 13:57 | |
*** daemontool has joined #openstack-swift | 13:59 | |
*** zhill has quit IRC | 14:00 | |
*** haomaiwa_ has quit IRC | 14:01 | |
*** haomaiwa_ has joined #openstack-swift | 14:01 | |
*** dmorita has quit IRC | 14:05 | |
*** petertr7_away is now known as petertr7 | 14:05 | |
*** haomaiwa_ has quit IRC | 14:08 | |
*** andrey-mp has joined #openstack-swift | 14:11 | |
andrey-mp | hello. what happens with swift3 project? I'm waiting for review since last August - https://review.openstack.org/#/c/211933/ | 14:16 |
*** daemontool_ has joined #openstack-swift | 14:16 | |
*** links has joined #openstack-swift | 14:16 | |
andrey-mp | who is it possible to review it? | 14:16 |
*** daemontool has quit IRC | 14:17 | |
cbartz | andrey-mp: if nobody is answering you here, try to put it on the agenda of the swift meeting: https://wiki.openstack.org/wiki/Meetings/Swift | 14:18 |
andrey-mp | thank you! | 14:19 |
*** andrey-mp has quit IRC | 14:22 | |
*** rledisez has quit IRC | 14:28 | |
*** rledisez has joined #openstack-swift | 14:29 | |
*** rledisez has quit IRC | 14:30 | |
*** rledisez has joined #openstack-swift | 14:30 | |
*** portante has quit IRC | 14:30 | |
*** portante has joined #openstack-swift | 14:33 | |
*** jordanP has quit IRC | 14:39 | |
*** tongli has joined #openstack-swift | 14:40 | |
glange | or try again here later, a lot of people here are on west coast time | 14:44 |
*** cbartz has left #openstack-swift | 14:49 | |
*** amit213 has quit IRC | 14:51 | |
*** proteusguy_ has quit IRC | 14:53 | |
*** links has quit IRC | 14:54 | |
*** zhill has joined #openstack-swift | 14:57 | |
*** sgundur has joined #openstack-swift | 15:01 | |
*** zhill has quit IRC | 15:01 | |
*** _JZ_ has joined #openstack-swift | 15:03 | |
*** proteusguy_ has joined #openstack-swift | 15:07 | |
acoles | or try #swift3 channel, or look for kota_ in here | 15:10 |
*** cdelatte has joined #openstack-swift | 15:14 | |
*** dmorita has joined #openstack-swift | 15:21 | |
*** _JZ__ has joined #openstack-swift | 15:23 | |
*** _JZ_ has quit IRC | 15:26 | |
*** sgundur has left #openstack-swift | 15:27 | |
*** petertr7 is now known as petertr7_away | 15:38 | |
*** mragupat has joined #openstack-swift | 15:38 | |
*** sgundur has joined #openstack-swift | 15:45 | |
*** marcusvrn_ has quit IRC | 15:47 | |
*** dmorita has quit IRC | 15:56 | |
*** zhill has joined #openstack-swift | 15:58 | |
*** esker has joined #openstack-swift | 16:01 | |
*** garthb has joined #openstack-swift | 16:02 | |
*** arch-nemesis has joined #openstack-swift | 16:02 | |
*** zhill has quit IRC | 16:03 | |
*** bjkeller has joined #openstack-swift | 16:04 | |
*** mvk has quit IRC | 16:07 | |
*** geaaru has quit IRC | 16:09 | |
*** daemontool__ has joined #openstack-swift | 16:12 | |
*** daemontool__ is now known as daemontool | 16:13 | |
*** daemontool_ has quit IRC | 16:15 | |
*** petertr7_away is now known as petertr7 | 16:18 | |
openstackgerrit | Chaozhe Chen(ccz) proposed openstack/python-swiftclient: Use "# noqa" instead of "#flake8: noqa" https://review.openstack.org/277927 | 16:19 |
*** diazjf has joined #openstack-swift | 16:27 | |
*** dmorita has joined #openstack-swift | 16:28 | |
*** petertr7 is now known as petertr7_away | 16:35 | |
*** petertr7_away is now known as petertr7 | 16:38 | |
*** nadeem has joined #openstack-swift | 16:40 | |
openstackgerrit | Alistair Coles proposed openstack/swift: Merge branch 'master' into feature/crypto https://review.openstack.org/277950 | 16:42 |
acoles | jrichli: mahatic ^^ requirements.txt changed so we need this to pass gate checks | 16:43 |
jrichli | acoles: ok, thx | 16:44 |
mahatic | acoles: thanks | 16:44 |
notmyname | good morning | 16:44 |
acoles | good morning | 16:45 |
*** zaitcev has joined #openstack-swift | 16:45 | |
*** ChanServ sets mode: +v zaitcev | 16:45 | |
jrichli | good morning | 16:45 |
mahatic | Morning! | 16:46 |
openstackgerrit | Mingyu Li proposed openstack/swift: Order the devices by (region, zone, ip, device) in the output of swift-ring-builder https://review.openstack.org/277956 | 16:49 |
*** esker has quit IRC | 16:49 | |
*** zhill has joined #openstack-swift | 16:58 | |
*** mragupat has quit IRC | 17:00 | |
*** mragupat has joined #openstack-swift | 17:01 | |
*** d0ugal has quit IRC | 17:02 | |
*** zhill has quit IRC | 17:03 | |
*** daemontool has quit IRC | 17:06 | |
*** gyee has joined #openstack-swift | 17:12 | |
*** lyrrad has joined #openstack-swift | 17:17 | |
*** bjkeller has left #openstack-swift | 17:21 | |
*** bjkeller1 has joined #openstack-swift | 17:21 | |
*** asettle has joined #openstack-swift | 17:21 | |
*** venkat has joined #openstack-swift | 17:24 | |
venkat | Hi all | 17:25 |
-openstackstatus- NOTICE: Gerrit is restarting now, to alleviate current performance impact and WebUI errors. | 17:25 | |
venkat | sometimes I am getting the following error for memcache | 17:25 |
venkat | STDERR: ERROR:root:Timeout getting a connection to memcached: 127.0.0.1:11211 | 17:25 |
venkat | what is the reason | 17:25 |
venkat | max_connections = 2 | 17:25 |
*** asettle has quit IRC | 17:26 | |
*** rickyrem has quit IRC | 17:27 | |
*** mragupat has quit IRC | 17:32 | |
*** dmorita has quit IRC | 17:32 | |
*** mragupat has joined #openstack-swift | 17:33 | |
venkat | Hi someone can answer | 17:34 |
*** venkat has quit IRC | 17:35 | |
*** mragupat has quit IRC | 17:36 | |
*** mragupat has joined #openstack-swift | 17:37 | |
jrichli | venkat: have you looked at why your connection might be timing out? maybe some details on that investigation would help. | 17:40 |
*** rledisez has quit IRC | 17:41 | |
*** klrmn has joined #openstack-swift | 17:47 | |
*** ntt has quit IRC | 17:50 | |
*** silor has quit IRC | 17:50 | |
*** jordanP has joined #openstack-swift | 17:55 | |
*** joeljwright has quit IRC | 18:00 | |
*** dmorita has joined #openstack-swift | 18:01 | |
*** jordanP has quit IRC | 18:03 | |
*** bjkeller1 has quit IRC | 18:04 | |
*** bjkeller has joined #openstack-swift | 18:05 | |
*** mrmoje has quit IRC | 18:08 | |
*** zhill has joined #openstack-swift | 18:08 | |
*** zhill has quit IRC | 18:08 | |
*** manous_ has joined #openstack-swift | 18:09 | |
manous_ | hello | 18:09 |
manous_ | how can i get API KEY for use netdrive ? | 18:09 |
openstackgerrit | Alistair Coles proposed openstack/swift: Decrypt multipart mime doc https://review.openstack.org/248377 | 18:11 |
*** zhill_desktop has joined #openstack-swift | 18:13 | |
*** asettle has joined #openstack-swift | 18:17 | |
*** petertr7 is now known as petertr7_away | 18:18 | |
*** _JZ__ has quit IRC | 18:20 | |
*** asettle has quit IRC | 18:21 | |
*** delattec has joined #openstack-swift | 18:23 | |
*** daemontool has joined #openstack-swift | 18:25 | |
*** cdelatte has quit IRC | 18:26 | |
*** acoles is now known as acoles_ | 18:29 | |
*** _JZ_ has joined #openstack-swift | 18:30 | |
*** esker has joined #openstack-swift | 18:30 | |
*** zhill has joined #openstack-swift | 18:32 | |
*** mragupat_ has joined #openstack-swift | 18:32 | |
*** bjkeller has quit IRC | 18:32 | |
*** mragupat has quit IRC | 18:36 | |
*** zhill_desktop has quit IRC | 18:39 | |
*** ChubYann has joined #openstack-swift | 18:44 | |
*** delatte has joined #openstack-swift | 18:48 | |
*** delattec has quit IRC | 18:51 | |
*** ober37 has joined #openstack-swift | 18:57 | |
clayg | ohai! | 18:58 |
siva_krishnan | Hi all! just had one quick question on ACL's. Can admin user grant read-write or full access to the non-existent user ? | 19:06 |
jrichli | summit voting is open | 19:07 |
clayg | jrichli: oh no! | 19:08 |
clayg | siva_krishnan: sure! | 19:08 |
*** daemontool_ has joined #openstack-swift | 19:10 | |
*** daemontool__ has joined #openstack-swift | 19:11 | |
pdardeau | curiosity is killing me. what is the non-existent user? a placeholder of some kind? | 19:11 |
*** daemontool has quit IRC | 19:12 | |
klrmn | pdardeau: i would guess a user that doesn't exist yet…or at least that swift hasn't created an account for yet. | 19:12 |
siva_krishnan | +1 klrmn | 19:14 |
*** daemontool_ has quit IRC | 19:14 | |
*** esker has quit IRC | 19:16 | |
*** esker has joined #openstack-swift | 19:17 | |
*** esker has quit IRC | 19:19 | |
*** forcebanana has quit IRC | 19:23 | |
siva_krishnan | clayg: can you please let me know if it would be possible for an admin user to grant read-write access to user who is not existing in the system | 19:33 |
notmyname | didn't he already answer "yes"? | 19:33 |
*** ChubYann has quit IRC | 19:33 | |
*** esker has joined #openstack-swift | 19:34 | |
*** mingyu_ has quit IRC | 19:34 | |
*** esker has joined #openstack-swift | 19:34 | |
notmyname | siva_krishnan: there's no validation against an identity system when you set ACLs. so you can set it to any arbitrary string. of course, if it does end up matching something in the identity system, then you get what you expect (ie ACL functionality) | 19:35 |
notmyname | so you can set the ACL values to anything you want. doesn't have to be a real user that exists right now | 19:35 |
*** mingyu has joined #openstack-swift | 19:35 | |
pdardeau | notmyname: thanks for elaborating | 19:35 |
siva_krishnan | notmyname: thanks for the info. | 19:37 |
*** can8dnSix has joined #openstack-swift | 19:41 | |
*** ChubYann has joined #openstack-swift | 19:44 | |
*** forcebanana has joined #openstack-swift | 19:45 | |
*** bjkeller has joined #openstack-swift | 19:50 | |
*** esker has quit IRC | 19:56 | |
*** can8dnSix has quit IRC | 19:59 | |
*** ober37 has left #openstack-swift | 20:06 | |
*** ober37 has joined #openstack-swift | 20:06 | |
*** ober37 has left #openstack-swift | 20:06 | |
*** petertr7_away is now known as petertr7 | 20:07 | |
*** rcernin has joined #openstack-swift | 20:08 | |
*** manous_ has quit IRC | 20:14 | |
jrichli | notmyname: should I indicate "docimpact" on the commit message for patch 252791? | 20:33 |
patchbot | jrichli: https://review.openstack.org/#/c/252791/ - swift - Change POST-as-COPY to preserve the DLO manifest c... | 20:33 |
notmyname | jrichli: that is a good question | 20:40 |
notmyname | jrichli: the definition and what happens with docimpact has been changing lately | 20:40 |
notmyname | jrichli: why do you think it should or should not have docimpact? | 20:40 |
jrichli | notmyname: it includes doc changes. in particular, it is clarifying that a client must provide the x-object-manifest when POSTing to a dlo manifest. This behavior was something that had to be discussed on the related bug report. | 20:43 |
jrichli | notmyname: but it doesn't seem like all doc changes require the docimpact, so i don't know where the line is drawn. | 20:43 |
notmyname | ok, thanks. I asked because it is and has been so confusing as to when to use it! it's good to hear what other people think it's supposed to mean | 20:45 |
notmyname | in general, docimpact is supposed to be for when a patch changes something that is documented in the openstack-manuals repo | 20:47 |
notmyname | which raises the question, what's in the openstack-manuals repo? and I don't know ;-) | 20:47 |
notmyname | however, docimpact is likely changing so that it will open a bug on swift itself saying something like "this patch had a docimpact tag" | 20:48 |
notmyname | and much of the openstack-manuals content is moving into our own in-tree repo anyway | 20:49 |
notmyname | (like at least some of the API docs) | 20:49 |
notmyname | so all that being said, basically adding docimapct has one real result: asettle will come ask what to do with it | 20:49 |
jrichli | lol. Well, asettle could point me to what is currently in the openstack-manuals, right? | 20:50 |
notmyname | in theory. she and I talked a bunch about this last week in australia | 20:51 |
jrichli | i would think that is straightforward : look at the repo in github? not so much? | 20:51 |
notmyname | jrichli: it's the stuff hosted at http://docs.openstack.org | 20:52 |
jrichli | ok, so thats what i frequently look at :-) | 20:52 |
*** esker has joined #openstack-swift | 20:53 | |
jrichli | notmyname: so I would just make a proposal for how to add this specification into that format? and asettle can decide if it doesn't belong at that level I suppose | 20:55 |
notmyname | jrichli: IMO we'll probably stop using docimpact. but for now there's not really any harm in adding it. | 20:55 |
notmyname | and asettle hangs out in here. it's just before 8am for her now, so she'll probably be around in 90minutes or so | 20:55 |
jrichli | ok. thanks! | 20:56 |
*** mrmoje has joined #openstack-swift | 20:59 | |
*** esker has quit IRC | 20:59 | |
notmyname | redbo_: do you remember why swift's timestamp resolution is decimillisecond? | 21:00 |
openstackgerrit | Michael Barton proposed openstack/swift: go: GREP middleware https://review.openstack.org/217381 | 21:00 |
redbo_ | notmyname: nope | 21:01 |
*** redbo_ is now known as redbo | 21:01 | |
*** ChanServ sets mode: +v redbo | 21:01 | |
*** daemontool has joined #openstack-swift | 21:02 | |
*** daemontool__ has quit IRC | 21:02 | |
openstackgerrit | Michael Barton proposed openstack/swift: go: GREP middleware https://review.openstack.org/217381 | 21:03 |
*** _JZ_ has quit IRC | 21:04 | |
openstackgerrit | Clay Gerrard proposed openstack/python-swiftclient: more tests for pseudo/dir https://review.openstack.org/278090 | 21:15 |
mrmoje | clayg, timburke: muchos gracias! | 21:17 |
glange | decimilliseconds == microseconds, I think | 21:19 |
glange | no, that's not right | 21:21 |
*** mrmoje has quit IRC | 21:22 | |
glange | it's also decideciseconds | 21:22 |
glange | er, centicentiseconds | 21:23 |
glange | like a second centipede | 21:23 |
*** mrmoje has joined #openstack-swift | 21:24 | |
*** daemontool_ has joined #openstack-swift | 21:24 | |
*** daemontool has quit IRC | 21:27 | |
mattoliverau | morning | 21:30 |
*** mrmoje has quit IRC | 21:32 | |
*** mrmoje has joined #openstack-swift | 21:34 | |
*** mrmoje has quit IRC | 21:40 | |
pdardeau | good morning mattoliverau | 21:43 |
vinsh | Hey all.. when using "servers_per_port" does the "bind_port" setting matter? | 21:50 |
vinsh | do you just set bind_port to every port you are using for each disk? | 21:50 |
notmyname | vinsh: bind_port matters, but worker doesn't | 21:51 |
vinsh | Suppose I have 30 disks and thus 30 different ports for "servers_per_port". what do I choose for "bind_port" ? | 21:51 |
notmyname | vinsh: and yes, you'd end up with one object server config for each drive (each with a different bind_port setting). and then each drive in the ring would have a different port | 21:51 |
vinsh | ah-hah! | 21:52 |
vinsh | bind_port appears only under the DEFAULT section from what I can tell | 21:53 |
openstackgerrit | Shashirekha Gundur proposed openstack/swift: change default ports for servers https://review.openstack.org/274840 | 21:53 |
*** petertr7 is now known as petertr7_away | 21:55 | |
*** peyton has quit IRC | 21:58 | |
clayg | notmyname: I always thought it had to do with float precision of six-digit literal flots! | 21:59 |
vinsh | notmyname: Can you describe the config section a bit more? | 21:59 |
openstackgerrit | Merged openstack/swift: Insert versioned_writes in correct pipeline position https://review.openstack.org/273073 | 21:59 |
vinsh | If I start an object server with servers_per_port set. it starts x number of servers per port defined for that ip in the ring. | 21:59 |
notmyname | clayg: yeah. or maybe some platforms don't give microseconds? | 21:59 |
vinsh | I can't then start another object server because that port is now in use. | 22:00 |
clayg | notmyname: some python floats can be "equal" even tho they have different first six digits (1455054922.062829 == 1455054922.0628289) | 22:00 |
clayg | notmyname: ^ i don't think that's true for the first five digits? | 22:00 |
*** esker has joined #openstack-swift | 22:00 | |
notmyname | ah, interesting | 22:00 |
notmyname | by which I mean "that's terrible" | 22:01 |
notmyname | ;-) | 22:01 |
notmyname | vinsh: suppose you have 3 drives A, B, C | 22:01 |
notmyname | vinsh: and you have servers_per_port set to 2 | 22:01 |
clayg | notmyname: i mean if you're giving 10 digits to the before the decimal you ony have so much precision afterwards - and the answer of how "how much" was 5 digits | 22:01 |
clayg | at least that's always what I told myself | 22:02 |
notmyname | vinsh: so you'd end up with 3 config files. each with a different bind_port. eg 10001, 10002, 10003 | 22:02 |
vinsh | so object-server/1.conf 2.conf 3.conf maybe. | 22:02 |
notmyname | vinsh: so you start each of these object servers, and they will each make 2 workers | 22:02 |
notmyname | yeah | 22:02 |
vinsh | ah. but they create 6 | 22:02 |
vinsh | not just 2 | 22:02 |
clayg | 6 object-server conf? that's baller | 22:03 |
notmyname | and in your ring, you'll add the 3 drives and importantly add them with their specific ports | 22:03 |
vinsh | In notmyname's example. when I start the first server. it starts 6. not just 2. | 22:03 |
notmyname | vinsh: create 6? ie 3 servers each with 2 child? | 22:03 |
vinsh | yes | 22:03 |
notmyname | vinsh: ah, that's not right. you need to make sure the ring is updated | 22:03 |
notmyname | vinsh: with different ports | 22:04 |
vinsh | https://gist.github.com/anonymous/db24938f2c603f3c6106 | 22:04 |
notmyname | so that each will only start workers for it's "local" drives. where local == drives with the same ip and port as the loaded config | 22:04 |
*** peyton has joined #openstack-swift | 22:05 | |
*** esker has quit IRC | 22:05 | |
notmyname | you repeat ports in there | 22:05 |
notmyname | oh wait | 22:05 |
notmyname | sorry. you're right | 22:05 |
*** ober37 has joined #openstack-swift | 22:05 | |
vinsh | I PRONMISE to put up a doc review/update once I can make more sense of how this is done :) | 22:06 |
vinsh | *PROMISE | 22:06 |
notmyname | :-) | 22:06 |
*** ober37 has quit IRC | 22:06 | |
notmyname | I've set it up myself. it's just been a while :-) | 22:06 |
notmyname | what's your workers_per_port setting? | 22:07 |
notmyname | servers_per_port | 22:07 |
vinsh | https://gist.github.com/anonymous/19903ced8cf5a6853491 | 22:07 |
vinsh | thats object-server/1.conf for example. | 22:07 |
timburke | notmyname: clayg: oh, of course! we've only got a 52-bit significand in a 64-bit float and 1e5 < (1<<53) / 1e10 < 1e6 | 22:08 |
vinsh | since that node has 4 drives. starting this file will start 8 workers total. | 22:08 |
vinsh | but that file only has a bind_port for 1/4 ports used in the ring. | 22:08 |
*** trifon has quit IRC | 22:09 | |
* notmyname wonders if swifterdarrell is busy | 22:09 | |
openstackgerrit | Ben Keller proposed openstack/swift: Headers now use a case incensitive dictionary https://review.openstack.org/274906 | 22:09 |
vinsh | Oh. I can omit bing_port from 1.conf and servers start no problem | 22:11 |
vinsh | *bind | 22:11 |
vinsh | Which makes sense I guess.. since thats what servers_per_port is all about.. using the ring to spawn wokers per port per local ip | 22:11 |
notmyname | you shouldn't be able to omit bind_port. it's been required for a while | 22:14 |
notmyname | vinsh: http://docs.openstack.org/developer/swift/deployment_guide.html#running-object-servers-per-disk | 22:15 |
vinsh | well. I can omit it and it works | 22:16 |
vinsh | that deployment guide makes no mention of different config sections per server port | 22:16 |
vinsh | I have read it 10 times over :) | 22:16 |
*** diazjf has quit IRC | 22:20 | |
*** asettle has joined #openstack-swift | 22:24 | |
notmyname | asettle: good morning. jrichli had a question for you earlier | 22:24 |
notmyname | about docimpact | 22:24 |
asettle | notmyname: what can I help with? | 22:24 |
jrichli | asettle: I was thinking we might want to make doc updates for patch 252791 | 22:25 |
patchbot | jrichli: https://review.openstack.org/#/c/252791/ - swift - Change POST-as-COPY to preserve the DLO manifest c... | 22:25 |
asettle | Yep, let me look | 22:26 |
jrichli | thx | 22:26 |
asettle | jrichli: so you're looking at getting this content moved into the openstack-manuals side of things? | 22:27 |
jrichli | asettle: once this patch would be merged, I would think we could add a statement about having to specify the "x-object-manifest" for a DLO manifest in the Object POST area. | 22:28 |
jrichli | yes, into openstack-manuals | 22:29 |
asettle | Give meeee a minuteeee :) if you want, I am happy to be assigned to this patch so I can monitor when it's merged. Let me just double check we actually have DLO info in the manuals. | 22:30 |
asettle | If not, would you like that to be added into the os-manuals? | 22:30 |
asettle | The whole thing, that is. | 22:30 |
jrichli | asettle: I dont feel that is my call ... I know that DLO is at least mentioned in some spots now, such as "the manifest is returned in the X-Object-Manifest response header for dynamic large objects" | 22:32 |
asettle | Yep, okay. Fair :) sorry, throwing out ideas... I literally just woke up. Haha. | 22:33 |
jrichli | asettle: no worries. good morning! | 22:33 |
asettle | Haha thank you! :) | 22:34 |
*** esker has joined #openstack-swift | 22:34 | |
asettle | Okay, I'll look into this for you. If possible jrichli could you please file a bug in OS manuals, tag swift and assign me? Explain what it is you're looking to add and I'll ensure that information gets added in :) | 22:35 |
jrichli | ok, will do | 22:35 |
notmyname | vinsh: ok, after some code diving... | 22:39 |
vinsh | o/ | 22:39 |
asettle | jrichli: thank you kindly :) | 22:40 |
notmyname | vinsh: you want one config file. set servers_per_port to whatever. make sure you have a different port for each drive in the ring. it would seem that bind_port should be removed (instead of it being ignored) | 22:40 |
notmyname | vinsh: so yeah. what you got to, I think :-) | 22:41 |
jrichli | asettle notmyname: thank you | 22:41 |
vinsh | Perfect, I concur with your read notmyname. Thank's for looking at this with me! | 22:41 |
notmyname | vinsh: good luck! (I've seen it improve performance in clusters) | 22:41 |
vinsh | cranking up our EC cluster by using server_per_port. | 22:41 |
vinsh | video team wants more I/O. I'll give them more I/O ;) | 22:42 |
vinsh | I wonder servers_per_port makes sense for account/container rings. probably not as much. | 22:42 |
*** esker has quit IRC | 22:46 | |
torgomatic | vinsh: might still be worth doing. the point of it is to distribute the blocking file IO among multiple processes so there can be lots of concurrent IOs going. sqlite locking adds some overhead, but there's still disk IO going on | 22:49 |
vinsh | So account/container servers will use this feature? | 22:49 |
vinsh | I think I'll give this a try! | 22:49 |
clayg | vinsh: not until someone writes that code - I don't think it'll work as-is - object-server only | 22:50 |
vinsh | d'oh :D | 22:50 |
* vinsh wants turbo everything. | 22:50 | |
vinsh | One last question for the day... when using EC.. has the ccount/container ring been setup using EC or is it strictly the object ring? | 22:52 |
*** esker has joined #openstack-swift | 22:52 | |
vinsh | oh nevermind. | 22:53 |
vinsh | there is no "swift-account|container-reconstructor" | 22:53 |
vinsh | duh. | 22:53 |
notmyname | right. accounts and containers are only replicated. no separate storage policies there | 22:53 |
torgomatic | oh. heh. forgot about that little detail. | 22:56 |
*** tongli has quit IRC | 22:56 | |
*** rcernin has quit IRC | 22:58 | |
*** daemontool__ has joined #openstack-swift | 23:02 | |
*** daemontool_ has quit IRC | 23:04 | |
jrichli | asettle: I was only allowed to add you as a subscriber to the bug, but not allowed to assign to anyone outside of my IBM Stackers team. unless i am doing it wrong ;-) | 23:05 |
asettle | jrichli: haha oh right! OKay. let me go take a look :) | 23:06 |
asettle | Excellente, fixed that :) | 23:07 |
*** bjkeller has left #openstack-swift | 23:07 | |
jrichli | asettle: thx! | 23:08 |
asettle | No problem :) if i'm not online, feel free to just subscribe me to bug reports - i'll keep an eye out for them. | 23:09 |
asettle | If not, just email me | 23:09 |
asettle | alexandra.settle@rackspace.com | 23:09 |
asettle | I'm Australia BNE... which is like... something smoething +10 (it's early, don't judge me) | 23:09 |
asettle | Next week I'll be UK though, so I'll be online a little more often for the US | 23:09 |
jrichli | asettle: great! I already had to look you up on linkedin to find out whether to use the id/email you had for rackspace or redhat :-) | 23:10 |
asettle | HAHA OHHHH yes apologies. Racker ;) | 23:11 |
asettle | I really should make that clearer somewhere. | 23:11 |
jrichli | asettle: np. Have fun in the UK! | 23:11 |
asettle | Will do! Thank you :) | 23:11 |
*** Jeffrey4l has joined #openstack-swift | 23:15 | |
notmyname | jrichli: also, asettle will join us for the hackathon | 23:16 |
asettle | Oh yes, I'll be there. | 23:16 |
*** daemontool_ has joined #openstack-swift | 23:20 | |
*** daemontool__ has quit IRC | 23:22 | |
*** daemontool_ has quit IRC | 23:28 | |
*** kei_yama has joined #openstack-swift | 23:28 | |
*** daemontool has joined #openstack-swift | 23:29 | |
torgomatic | the best part about centimillisecond precision is that it'll be too much someday | 23:31 |
*** ho_ has quit IRC | 23:44 | |
*** ho_ has joined #openstack-swift | 23:49 | |
ho_ | good morning! | 23:50 |
*** nadeem has quit IRC | 23:51 | |
mattoliverau | ho_: morning | 23:52 |
ho_ | mattoliverau: morning! | 23:54 |
*** mragupat_ has quit IRC | 23:57 | |
*** peyton has quit IRC | 23:58 | |
*** peyton has joined #openstack-swift | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!