torgomatic | I find I am confused about some stuff in the DB replicator | 00:00 |
---|---|---|
torgomatic | so in db_replicator.Replicator._repl_to_node, we have this "info" variable that's a dict with stuff in it | 00:01 |
torgomatic | and we want to make a REPLICATE request to a remote server and have that stuff be on the other end | 00:02 |
torgomatic | but instead of sending the dict as JSON, we flatten it into an array key-by-key and then send that as JSON | 00:02 |
torgomatic | so... would there be any harm in just sending the whole dict as JSON? I'm trying to add storage_policy_index to that ball of stuff, and the unpack-and-repack dance makes it harder than (IMO) it should be | 00:03 |
*** shri1 has joined #openstack-swift | 00:11 | |
*** shri has quit IRC | 00:11 | |
*** miurahr has joined #openstack-swift | 00:20 | |
*** miurahr has left #openstack-swift | 00:20 | |
*** matsuhashi has joined #openstack-swift | 00:23 | |
pconstantine | torgomatic: looks like RELICATE call expects array and makes sure it's array | 00:26 |
torgomatic | pconstantine: true, but I can change that too | 00:27 |
pconstantine | torgomatic: if not hasattr(args, 'pop'): | 00:27 |
pconstantine | return HTTPBadRequest(body='Invalid object type') | 00:27 |
pconstantine | torgomatic: backward compatible REST API and all that jazz | 00:28 |
pconstantine | won't be BC anymore.... | 00:28 |
torgomatic | oh, that array... yeah, basically instead of ['sync', 1, 2, 'blurgh'] I'd have ['sync', {'one': 1, 'two': 2, 'blah': 'blurgh'}] | 00:28 |
torgomatic | it's basically [method, *args] | 00:28 |
torgomatic | also, I'm not terribly worried about compatibility for the REPLICATE verb since nobody outside the cluster uses it, and I can control the replicator code too | 00:28 |
torgomatic | might be worth keeping a little shim for one release, but it's not like I'll go breaking clients | 00:29 |
*** sungju has quit IRC | 00:30 | |
*** lnxnut has joined #openstack-swift | 00:32 | |
*** fifieldt_ has joined #openstack-swift | 00:33 | |
*** davidhun has quit IRC | 00:40 | |
acoles- | pconstantine: thanks for putting your patch up, I just reviewed & left comment. sorry again for the pain this caused. | 00:54 |
*** davidhun has joined #openstack-swift | 01:03 | |
*** tsg has quit IRC | 01:03 | |
*** tdasilva has quit IRC | 01:04 | |
*** shri1 has quit IRC | 01:12 | |
*** therve has quit IRC | 01:15 | |
*** therve has joined #openstack-swift | 01:15 | |
*** lnxnut has quit IRC | 01:27 | |
*** lnxnut has joined #openstack-swift | 01:27 | |
*** lnxnut has quit IRC | 01:31 | |
*** erlon has quit IRC | 01:32 | |
*** fifieldt_ has quit IRC | 01:44 | |
*** nosnos has joined #openstack-swift | 01:46 | |
openstackgerrit | A change was merged to openstack/swift: Fix fd leak from get_logger() in python 2.6 https://review.openstack.org/63195 | 01:56 |
*** miurahr has joined #openstack-swift | 02:04 | |
*** dmorita has joined #openstack-swift | 02:05 | |
*** miurahr has quit IRC | 02:18 | |
*** miurahr has joined #openstack-swift | 02:36 | |
portante | yeah for 63195 | 02:40 |
*** foexle_ has joined #openstack-swift | 02:40 | |
*** foexle has quit IRC | 02:44 | |
*** miurahr has quit IRC | 02:47 | |
luisbg | \o/ both my help strings commits in python-swiftclient finished and approved by Jenkins | 02:47 |
*** csd has quit IRC | 03:25 | |
*** sfineberg has quit IRC | 03:25 | |
*** sfineberg has joined #openstack-swift | 03:32 | |
*** foexle_ has quit IRC | 03:58 | |
*** Dharmit has joined #openstack-swift | 04:23 | |
*** lnxnut has joined #openstack-swift | 04:29 | |
openstackgerrit | A change was merged to openstack/python-swiftclient: swift.1 manpage fix for groff warnings https://review.openstack.org/74249 | 04:52 |
openstackgerrit | A change was merged to openstack/python-swiftclient: Add LengthWrapper in put_object to honor content_length param https://review.openstack.org/76102 | 04:52 |
openstackgerrit | A change was merged to openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/75592 | 04:53 |
*** matsuhashi has quit IRC | 05:00 | |
*** nshaikh has joined #openstack-swift | 05:00 | |
*** lnxnut has quit IRC | 05:02 | |
*** madhuri has quit IRC | 05:06 | |
openstackgerrit | Eiichi Aikawa proposed a change to openstack/python-swiftclient: Fix the parameter order of assertEqual in swiftclient test https://review.openstack.org/76461 | 05:12 |
*** Anju has quit IRC | 05:21 | |
openstackgerrit | Pete Zaitcev proposed a change to openstack/swift: Pluggable Back-ends for account and container servers https://review.openstack.org/47713 | 05:24 |
*** Midnightmyth has joined #openstack-swift | 05:43 | |
*** Anju has joined #openstack-swift | 05:49 | |
*** zaitcev has quit IRC | 05:59 | |
*** haomaiw__ has quit IRC | 06:41 | |
*** haomaiwang has joined #openstack-swift | 06:42 | |
*** saju_m has joined #openstack-swift | 06:48 | |
*** Midnightmyth has quit IRC | 06:48 | |
*** chandan_kumar has joined #openstack-swift | 06:54 | |
openstackgerrit | Eiichi Aikawa proposed a change to openstack/python-swiftclient: Fix the parameter order of assertEqual in swiftclient test https://review.openstack.org/76461 | 06:57 |
*** gyee has quit IRC | 07:00 | |
*** haomaiw__ has joined #openstack-swift | 07:02 | |
*** haomaiwang has quit IRC | 07:05 | |
*** Dharmit has quit IRC | 07:26 | |
*** csd has joined #openstack-swift | 07:41 | |
*** nshaikh has left #openstack-swift | 07:43 | |
*** foexle has joined #openstack-swift | 07:49 | |
*** kris_ha has quit IRC | 07:52 | |
*** foexle has quit IRC | 07:53 | |
*** foexle has joined #openstack-swift | 07:55 | |
*** csd has quit IRC | 07:55 | |
*** saju_m has quit IRC | 08:10 | |
*** saju_m has joined #openstack-swift | 08:10 | |
*** chandan_kumar has quit IRC | 08:16 | |
*** saju_m has quit IRC | 08:25 | |
*** saju_m has joined #openstack-swift | 08:26 | |
*** chandan_kumar has joined #openstack-swift | 08:29 | |
*** chandankumar_ has joined #openstack-swift | 08:32 | |
*** chandan_kumar has quit IRC | 08:35 | |
*** Dharmit has joined #openstack-swift | 08:39 | |
*** acoles- has quit IRC | 08:47 | |
*** ppai has joined #openstack-swift | 08:52 | |
*** mlipchuk has joined #openstack-swift | 08:52 | |
*** saju_m has quit IRC | 08:52 | |
openstackgerrit | Yongli He proposed a change to openstack/swift: Exception message should not be localize https://review.openstack.org/76801 | 09:02 |
*** nacim has joined #openstack-swift | 09:05 | |
*** Anju has quit IRC | 09:24 | |
*** Anju has joined #openstack-swift | 09:35 | |
*** madhuri has joined #openstack-swift | 09:36 | |
*** grapsus_ has quit IRC | 09:38 | |
*** grapsus_ has joined #openstack-swift | 09:38 | |
*** xga has joined #openstack-swift | 09:53 | |
*** grapsus_ has quit IRC | 09:53 | |
*** grapsus_ has joined #openstack-swift | 09:53 | |
*** xga has quit IRC | 10:02 | |
*** mkollaro has joined #openstack-swift | 10:33 | |
*** saju_m has joined #openstack-swift | 10:35 | |
*** Trixboxer has joined #openstack-swift | 10:36 | |
*** kris_h has joined #openstack-swift | 10:48 | |
*** mkollaro has quit IRC | 10:52 | |
*** mkollaro has joined #openstack-swift | 10:52 | |
*** nosnos has quit IRC | 11:14 | |
*** MessedUpHare has joined #openstack-swift | 11:26 | |
MessedUpHare | Hi All - i'm just researching swift - and I wanted to know if there is a plugin architecture to allow a REST call to directly return the output of an executable on the storage host? | 11:27 |
MessedUpHare | searching around - i'm a bit swamped with the other openstack features | 11:27 |
ctennis | by on the storage host you mean on the OS of the machine running swift vs. within the swift storage system itself? | 11:28 |
MessedUpHare | either really - just server-side instead of client-side | 11:28 |
MessedUpHare | just the ability to execute an application against an object and return the output | 11:29 |
ctennis | there's no plugin that exists currently to do so, but certainly one could be written | 11:29 |
MessedUpHare | what is the plugin architecture called? (so i can go about trying to write one) | 11:29 |
MessedUpHare | .. i'm a bit lost at where to start | 11:30 |
ctennis | it's essentially WSGI middleware for python, which is just a web services library | 11:31 |
ctennis | as an examply of a small contained plugin is here: https://github.com/fujita/swift3/blob/master/swift3/middleware.py | 11:31 |
MessedUpHare | ok - thanks :) | 11:31 |
ctennis | which provides an S3 interface for swift in a single file | 11:31 |
ctennis | might be a template to use for inspiration | 11:31 |
*** xga has joined #openstack-swift | 11:34 | |
*** xga has quit IRC | 11:35 | |
*** xga has joined #openstack-swift | 11:36 | |
*** MessedUpHare has quit IRC | 11:37 | |
*** xga has quit IRC | 11:39 | |
*** xga has joined #openstack-swift | 11:39 | |
*** miurahr has joined #openstack-swift | 11:41 | |
*** miurahr has left #openstack-swift | 11:42 | |
*** xga has quit IRC | 11:44 | |
*** akscram has quit IRC | 11:45 | |
*** akscram has joined #openstack-swift | 11:45 | |
openstackgerrit | Constantine Peresypkin proposed a change to openstack/swift: fix gatekeeper response headers behavior https://review.openstack.org/76709 | 11:49 |
*** tdasilva has joined #openstack-swift | 12:00 | |
*** ppai has quit IRC | 12:03 | |
*** dmorita has quit IRC | 12:13 | |
*** miurahr has joined #openstack-swift | 12:13 | |
*** miurahr has left #openstack-swift | 12:14 | |
*** ppai has joined #openstack-swift | 12:16 | |
pconstantine | File "/opt/swift/swauth/swauth/swift_version.py", line 17, in parse | 12:25 |
pconstantine | major = int(parts.pop(0)) | 12:25 |
pconstantine | ValueError: invalid literal for int() with base 10: '7d7e8e5' | 12:25 |
pconstantine | what is that??? | 12:25 |
pconstantine | why is that??? | 12:25 |
pconstantine | why only one node has that, although other nodes have exactly the same code-base? | 12:25 |
pconstantine | and ALL nodes have 7d7e8e5 in their PKG-INFO | 12:26 |
*** dmsimard has joined #openstack-swift | 12:28 | |
*** fbo_away is now known as fbo | 12:34 | |
*** miurahr has joined #openstack-swift | 12:38 | |
*** miurahr has left #openstack-swift | 12:39 | |
portante | a pbr thing? | 12:45 |
portante | pconstantine: swauth could be bit my the pbr work in swift | 12:46 |
portante | just a guess without looking | 12:46 |
*** xga has joined #openstack-swift | 12:49 | |
*** saju_m has quit IRC | 12:53 | |
*** xga has quit IRC | 12:58 | |
pconstantine | swauth? tell me more... | 13:15 |
portante | your post above | 13:17 |
portante | or earlier | 13:18 |
portante | swift_version.py from /opt/swift/swauth/swauth/... | 13:18 |
portante | it might not be able to handle pbr versions | 13:18 |
portante | when you install top-of-tree, pbr will create a version using the commit number | 13:18 |
portante | pconstantine: gotta run, back in a bit | 13:19 |
*** miurahr has joined #openstack-swift | 13:21 | |
pconstantine | portante: very strange, this is what I have on my machine:1.12.0.114.g7d7e8e5 | 13:24 |
pconstantine | for the same code | 13:24 |
pconstantine | where does it pull its version from? | 13:24 |
*** kris_h has quit IRC | 13:32 | |
*** ppai has quit IRC | 13:42 | |
*** kris_h has joined #openstack-swift | 13:45 | |
pconstantine | portante: found it, tags were not pulled in the repo | 13:45 |
pconstantine | no tags - no correct version | 13:45 |
*** acoles has joined #openstack-swift | 13:56 | |
*** mvenesio has joined #openstack-swift | 14:08 | |
*** miurahr has quit IRC | 14:11 | |
*** miurahr has joined #openstack-swift | 14:22 | |
*** Dharmit has quit IRC | 14:44 | |
*** Dharmit has joined #openstack-swift | 14:47 | |
*** dmsimard1 has joined #openstack-swift | 15:13 | |
*** davidhadas has joined #openstack-swift | 15:13 | |
*** lnxnut has joined #openstack-swift | 15:14 | |
*** xga has joined #openstack-swift | 15:15 | |
*** foexle_ has joined #openstack-swift | 15:17 | |
*** sfineberg_ has joined #openstack-swift | 15:20 | |
*** swifterdarrell_ has joined #openstack-swift | 15:20 | |
*** dmsimard has quit IRC | 15:21 | |
*** mkollaro has quit IRC | 15:21 | |
*** nacim has quit IRC | 15:21 | |
*** chandankumar_ has quit IRC | 15:21 | |
*** foexle has quit IRC | 15:21 | |
*** sfineberg has quit IRC | 15:21 | |
*** davidhadas_ has quit IRC | 15:21 | |
*** swifterdarrell has quit IRC | 15:21 | |
*** swifterdarrell_ is now known as swifterdarrell | 15:21 | |
*** xga has quit IRC | 15:21 | |
*** Midnightmyth has joined #openstack-swift | 15:26 | |
*** chandankumar_ has joined #openstack-swift | 15:29 | |
*** mkollaro has joined #openstack-swift | 15:32 | |
*** mkollaro has quit IRC | 15:32 | |
*** mkollaro has joined #openstack-swift | 15:32 | |
*** nacim has joined #openstack-swift | 15:38 | |
*** ChanServ sets mode: +v swifterdarrell | 15:41 | |
*** dmsimard1 has quit IRC | 15:49 | |
*** miurahr has quit IRC | 15:55 | |
*** Midnightmyth has quit IRC | 15:57 | |
*** Dharmit has quit IRC | 16:09 | |
*** smcdowell has joined #openstack-swift | 16:12 | |
*** smcdowell is now known as physcx | 16:13 | |
*** Dharmit has joined #openstack-swift | 16:15 | |
*** zaitcev has joined #openstack-swift | 16:32 | |
*** ChanServ sets mode: +v zaitcev | 16:32 | |
*** mkollaro has quit IRC | 16:42 | |
zaitcev | The story or argument order in assertEquals sure got my day off to a good start https://review.openstack.org/76461 (wait, what) https://bugs.launchpad.net/ceilometer/+bug/1277104 (hooooly shiiit) http://bugs.python.org/issue20798 | 16:53 |
zaitcev | Guys you aren's some fucking cogs in a machine, use your agency for good once in a while. | 16:53 |
zaitcev | (I'm amazed at number of people who went along and started filing patches like busy beavers without a second thought... and they even manhandled Dolph!!) | 16:54 |
*** tsnider has joined #openstack-swift | 16:58 | |
* gholt does a spit-take | 17:01 | |
gholt | Shouldn't it be assertEqual anyway? *ducks* | 17:05 |
*** mkollaro has joined #openstack-swift | 17:08 | |
*** gdrudy1 has quit IRC | 17:08 | |
*** gdrudy1 has joined #openstack-swift | 17:09 | |
*** tsnider has quit IRC | 17:10 | |
*** xga has joined #openstack-swift | 17:18 | |
*** xga has quit IRC | 17:22 | |
*** davidhun has quit IRC | 17:22 | |
*** mvenesio_ has joined #openstack-swift | 17:23 | |
*** Dharmit has quit IRC | 17:25 | |
*** mvenesio has quit IRC | 17:26 | |
*** kris_h has quit IRC | 17:38 | |
pconstantine | -2 ? hmm, never though about that, do some guys have -3 or -11 option? | 17:45 |
*** dtalton has joined #openstack-swift | 17:45 | |
*** dtalton has left #openstack-swift | 17:46 | |
*** shri has joined #openstack-swift | 17:59 | |
*** shri1 has joined #openstack-swift | 18:02 | |
*** shri has quit IRC | 18:04 | |
*** nacim has quit IRC | 18:14 | |
torgomatic | it sort of boggles my mind that there's so much kerfuffle about the order of args to assertEqual, and that's mostly because == is a symmetric operator | 18:16 |
*** mlipchuk has quit IRC | 18:18 | |
*** bvandenh_ has quit IRC | 18:29 | |
*** krtaylor has quit IRC | 18:32 | |
*** chandan_kumar has joined #openstack-swift | 18:35 | |
*** saju_m has joined #openstack-swift | 18:37 | |
*** saju_m has quit IRC | 18:41 | |
*** mintdee has joined #openstack-swift | 18:41 | |
*** mintdee has left #openstack-swift | 18:42 | |
*** acoles has left #openstack-swift | 18:48 | |
*** krtaylor has joined #openstack-swift | 18:50 | |
*** saju_m has joined #openstack-swift | 18:51 | |
*** dtalton has joined #openstack-swift | 18:56 | |
*** mkollaro has quit IRC | 18:59 | |
*** dtalton has quit IRC | 19:00 | |
*** krtaylor has quit IRC | 19:15 | |
*** krtaylor has joined #openstack-swift | 19:17 | |
*** chandan_kumar has quit IRC | 19:24 | |
torgomatic | notmyname: swiftclient fix landed. you should go put your PTL hat on and release swiftclient. | 19:29 |
luisbg | torgomatic, have a minute? | 19:31 |
torgomatic | luisbg: sure | 19:31 |
luisbg | torgomatic, thanks for your +1 to my help strings fix | 19:32 |
torgomatic | sure | 19:32 |
luisbg | the second part is approved by Jenkins now, https://review.openstack.org/#/c/76630/ | 19:32 |
torgomatic | so... some punctuation, whitespace, and mention a couple defaults? | 19:33 |
luisbg | torgomatic, and moving the help= to the end of a few functions, to keep the order constant | 19:33 |
torgomatic | sure, why not? | 19:33 |
luisbg | torgomatic, but yes, that is the gist of it | 19:33 |
luisbg | torgomatic, heh :) I know, surface small stuff | 19:34 |
torgomatic | I'm not belittling it, just making sure I understand the scope | 19:34 |
luisbg | I have 4 patches waiting final review in gerrit (2 of them being these for swift), so want to get them through before I continue doing more | 19:35 |
torgomatic | sometimes there's code changes in patches like this, and I want to make sure I don't miss one of those :) | 19:35 |
*** saju_m has quit IRC | 19:35 | |
luisbg | torgomatic, I understand, I wasn't belittling either, I understand we all start somewhere | 19:35 |
luisbg | and a completely new contributor sending big changes is going to raise some eyebrows :P | 19:35 |
luisbg | torgomatic, thanks! :) now I just need a second reviewer, will wait | 19:36 |
*** mkollaro has joined #openstack-swift | 19:37 | |
*** csd has joined #openstack-swift | 19:39 | |
*** chandan_kumar has joined #openstack-swift | 19:50 | |
clayg | anyone know how to get ahold of fujita? https://github.com/fujita/swift3/pull/66 | 20:14 |
*** therve_ has joined #openstack-swift | 20:20 | |
*** therve_ has quit IRC | 20:25 | |
*** gyee has joined #openstack-swift | 20:25 | |
*** booi has quit IRC | 20:40 | |
*** nthacker has joined #openstack-swift | 20:41 | |
nthacker | Hi All! I would like to know if there is a tool/script that I can use to test a swift multi-node deployment. The objective is to just run through a list of operations and verify compliance | 20:42 |
nthacker | I'd like it to run something like that on a proxy node using the test user (system:root) | 20:42 |
nthacker | does anyone have any ideas/suggestions? | 20:42 |
*** csd has quit IRC | 20:52 | |
*** shri1 has quit IRC | 21:13 | |
*** mvenesio_ has quit IRC | 21:28 | |
*** csd has joined #openstack-swift | 21:41 | |
*** chandan_kumar has quit IRC | 21:45 | |
*** shri has joined #openstack-swift | 21:45 | |
*** lnxnut has quit IRC | 21:51 | |
*** lnxnut has joined #openstack-swift | 21:53 | |
*** lnxnut has quit IRC | 21:54 | |
*** lnxnut has joined #openstack-swift | 21:54 | |
physcx | Anyone here a swift tuning guru and think they can help me identify what is bottlenecking the throughput of my cluster? At this point we've tried just about everything we can find online and we still aren't sure why we are only getting a fraction of our network bandwidth available. | 21:55 |
*** Midnightmyth has joined #openstack-swift | 21:56 | |
*** lnxnut_ has joined #openstack-swift | 21:58 | |
*** lnxnut has quit IRC | 21:58 | |
luisbg | physcx, I recommend you ask in the mailing list, people are super busy this week | 22:03 |
luisbg | and the mailing list is better for long form conversations were you want input from multiple sources | 22:03 |
physcx | luisbg, alright i'll try that thx | 22:04 |
luisbg | physcx, sorry I can't be of more help | 22:05 |
physcx | luisbg, would the general openstack list be appropriate or is there a more specific one for swift questions? | 22:17 |
luisbg | no, all questions go in the general one | 22:19 |
luisbg | just add [Swift] on the beginning of the subject | 22:19 |
*** lnxnut_ has quit IRC | 22:24 | |
*** lnxnut has joined #openstack-swift | 22:29 | |
*** lnxnut has quit IRC | 22:33 | |
*** acoles has joined #openstack-swift | 22:40 | |
*** miurahr has joined #openstack-swift | 22:43 | |
*** lnxnut has joined #openstack-swift | 22:44 | |
*** lnxnut has quit IRC | 22:48 | |
*** Midnightmyth has quit IRC | 23:02 | |
*** openstackgerrit has quit IRC | 23:45 | |
*** acoles has quit IRC | 23:45 | |
*** mkollaro has quit IRC | 23:46 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!