*** tgohad has joined #openstack-swift | 00:03 | |
*** tusharsg has quit IRC | 00:06 | |
*** rameshg87 has left #openstack-swift | 00:09 | |
*** dmsimard_away is now known as dmsimard | 00:09 | |
*** tusharsg has joined #openstack-swift | 00:13 | |
*** annegent_ has joined #openstack-swift | 00:16 | |
*** tgohad has quit IRC | 00:16 | |
*** dmsimard is now known as dmsimard_away | 00:20 | |
*** tongli has quit IRC | 00:20 | |
*** tongli has joined #openstack-swift | 00:21 | |
*** annegent_ has quit IRC | 00:24 | |
*** tdasilva has joined #openstack-swift | 00:24 | |
*** dmsimard_away is now known as dmsimard | 00:25 | |
*** dmorita has joined #openstack-swift | 00:29 | |
*** dmorita has quit IRC | 00:31 | |
*** dmorita has joined #openstack-swift | 00:35 | |
*** shri has quit IRC | 00:39 | |
*** dmsimard is now known as dmsimard_away | 00:47 | |
*** dmsimard_away is now known as dmsimard | 01:35 | |
*** nosnos has joined #openstack-swift | 01:40 | |
*** bkopilov has quit IRC | 01:41 | |
*** dmsimard is now known as dmsimard_away | 01:42 | |
*** haomaiwang has joined #openstack-swift | 01:50 | |
*** kype has joined #openstack-swift | 01:51 | |
kype | Hi guys, when you do a swift update. Does it get pushed to all 3 primary locations as well, or only pushed to one location and then the replicator takes care of updating the replicates? | 01:51 |
---|---|---|
*** haomaiwang has quit IRC | 01:52 | |
*** bkopilov has joined #openstack-swift | 01:53 | |
*** haomaiwa_ has joined #openstack-swift | 01:53 | |
*** tdasilva has quit IRC | 01:56 | |
*** haomaiw__ has joined #openstack-swift | 02:08 | |
*** haomaiwa_ has quit IRC | 02:11 | |
*** haomaiw__ has quit IRC | 02:12 | |
*** haomaiwang has joined #openstack-swift | 02:12 | |
*** zaitcev has quit IRC | 02:13 | |
*** haomaiwang has quit IRC | 02:13 | |
*** haomaiwang has joined #openstack-swift | 02:13 | |
*** tusharsg has quit IRC | 02:21 | |
openstackgerrit | A change was merged to openstack/python-swiftclient: Fix context sensitive help for info and tempurl https://review.openstack.org/106009 | 02:25 |
*** haomaiw__ has joined #openstack-swift | 02:29 | |
*** haomaiwang has quit IRC | 02:32 | |
*** bkopilov has quit IRC | 02:41 | |
*** bkopilov has joined #openstack-swift | 02:41 | |
*** tongli has quit IRC | 03:03 | |
*** tsg has joined #openstack-swift | 03:12 | |
mattoliverau | kype: it will attempt to push to all 3 at once. | 03:40 |
*** nosnos has quit IRC | 03:40 | |
kype | mattoliverau: In that case its a consistent storage policy isnt it? Because all updates are synced at once | 03:41 |
kype | There is no chance for one file to remain unupdated | 03:41 |
*** ho has joined #openstack-swift | 03:45 | |
notmyname | kype: no that is incorrect. it's possible that not all of the replicas get updated (there are various reasons why). swift is eventually consistent | 03:50 |
mattoliverau | kype: its not consistent, it'll try and update all three at once and will return a success so long as two are successful. The third will be fixed by the replicator and auditor. Eventually consistent. | 03:52 |
kype | Oh okay in the case an update to one node fails | 03:52 |
kype | Ah i understand now, thanks notmyname | 03:53 |
kype | and mattoliverau | 03:53 |
notmyname | mattoliverau: kype: (not to mention what happens to handoff replicas during error conditions or capacity adjustments) | 03:54 |
mattoliverau | What notmyname said :) hopefully my sentences make sense, over been traveling for over 30 hours and my last flight was redirected.. Am now in a different Australian city waiting for a new flight! Woo jet lag! | 03:55 |
*** chandankumar has joined #openstack-swift | 04:03 | |
*** shakamunyi has joined #openstack-swift | 04:05 | |
*** nosnos has joined #openstack-swift | 04:06 | |
*** shakamunyi has quit IRC | 04:08 | |
*** haomaiw__ has quit IRC | 04:30 | |
*** haomaiwa_ has joined #openstack-swift | 04:31 | |
*** tsg has quit IRC | 04:43 | |
*** tsg has joined #openstack-swift | 04:48 | |
*** anand_ts has joined #openstack-swift | 04:56 | |
*** ppai has joined #openstack-swift | 05:16 | |
*** bvandenh has joined #openstack-swift | 05:19 | |
*** chandankumar has quit IRC | 05:25 | |
*** patchbot has quit IRC | 05:28 | |
*** notmyname has quit IRC | 05:28 | |
*** notmyname has joined #openstack-swift | 05:30 | |
*** ChanServ sets mode: +v notmyname | 05:30 | |
*** haomaiwa_ has quit IRC | 05:30 | |
*** haomaiwang has joined #openstack-swift | 05:30 | |
*** psharma has joined #openstack-swift | 05:43 | |
*** bvandenh has quit IRC | 05:44 | |
*** tsg has quit IRC | 05:49 | |
*** bkopilov has quit IRC | 05:54 | |
*** haomai___ has joined #openstack-swift | 05:55 | |
*** haomaiwang has quit IRC | 05:58 | |
*** k4n0 has joined #openstack-swift | 05:59 | |
*** haomai___ has quit IRC | 06:00 | |
*** chandankumar has joined #openstack-swift | 06:01 | |
*** haomaiwang has joined #openstack-swift | 06:01 | |
*** haomaiw__ has joined #openstack-swift | 06:02 | |
*** haomaiwang has quit IRC | 06:05 | |
*** gyee has quit IRC | 06:17 | |
*** chandankumar has quit IRC | 06:39 | |
*** kype has quit IRC | 06:42 | |
*** mmcardle has joined #openstack-swift | 06:46 | |
*** JelleB is now known as a1|away | 07:10 | |
*** bkopilov has joined #openstack-swift | 07:33 | |
*** a1|away is now known as JelleB | 07:34 | |
*** foexle has joined #openstack-swift | 07:43 | |
*** k4n0 has quit IRC | 07:51 | |
*** foexle has quit IRC | 07:54 | |
*** nacim has joined #openstack-swift | 07:55 | |
*** foexle has joined #openstack-swift | 07:56 | |
*** k4n0 has joined #openstack-swift | 08:04 | |
*** bvandenh has joined #openstack-swift | 08:12 | |
*** els13 has joined #openstack-swift | 08:29 | |
els13 | hi everyone, is this the right place to ask newbie swift questions? | 08:30 |
*** k4n0 has quit IRC | 08:32 | |
*** acoles_away is now known as acoles | 08:33 | |
charz | els13: welcome | 08:36 |
els13 | well I hope it is. I'm following some cookbook to set up a openstack test environment. in the chapter of swift, one creates a swift server with all the swift services on it, like proxy, container object server etc. one also creates four nodes on this server to simulate replication. after running swift-dispersion-populate, the replicator processes go kinda ham and the server is at a load of 60 | 08:37 |
els13 | any idea on how I can troubleshoot this, or is this to be expected if 4 nodes run on one VM? | 08:37 |
els13 | charz: thanks and hi :-) | 08:39 |
psharma | els13, SAIO setup is definitely not suitable for load testing , however i am not sure what you meant by 'load of 60' | 08:44 |
els13 | the cpu load as reported by linux | 08:44 |
els13 | as in system crawls almost to a halt | 08:45 |
*** tsg has joined #openstack-swift | 08:45 | |
*** k4n0 has joined #openstack-swift | 08:48 | |
*** tsg has quit IRC | 08:51 | |
*** ppai has quit IRC | 09:07 | |
*** k4n0 has quit IRC | 09:19 | |
*** ppai has joined #openstack-swift | 09:25 | |
*** openstackgerrit has quit IRC | 09:31 | |
*** openstackgerrit has joined #openstack-swift | 09:32 | |
*** haomaiw__ has quit IRC | 09:33 | |
*** haomaiwang has joined #openstack-swift | 09:34 | |
els13 | hmm, actually it's only some part of the container that causes such high cpu load | 09:37 |
*** k4n0 has joined #openstack-swift | 09:37 | |
*** DisneyRicky has quit IRC | 09:38 | |
*** DisneyRicky has joined #openstack-swift | 09:46 | |
*** DisneyRicky has quit IRC | 09:51 | |
*** IRTermite has quit IRC | 09:54 | |
*** amandap has quit IRC | 09:54 | |
*** ahale_ has quit IRC | 09:54 | |
*** dosaboy has quit IRC | 09:54 | |
*** dmsimard_away has quit IRC | 09:54 | |
*** creiht has quit IRC | 09:54 | |
*** yliu has quit IRC | 09:54 | |
*** bsdkurt has quit IRC | 09:54 | |
*** mariusv has quit IRC | 09:54 | |
*** charz has quit IRC | 09:54 | |
*** ctennis has quit IRC | 09:54 | |
*** yliu has joined #openstack-swift | 09:54 | |
*** creiht has joined #openstack-swift | 09:54 | |
*** ChanServ sets mode: +v creiht | 09:54 | |
*** mariusv has joined #openstack-swift | 09:55 | |
*** dosaboy has joined #openstack-swift | 09:55 | |
*** IRTermite has joined #openstack-swift | 09:55 | |
*** bsdkurt has joined #openstack-swift | 09:55 | |
*** ctennis has joined #openstack-swift | 09:55 | |
*** dmsimardz has joined #openstack-swift | 09:56 | |
*** dmsimardz is now known as dmsimard | 09:56 | |
*** ahale has joined #openstack-swift | 09:56 | |
*** amandap has joined #openstack-swift | 09:56 | |
*** charz has joined #openstack-swift | 09:56 | |
*** nosnos has quit IRC | 09:58 | |
*** nosnos has joined #openstack-swift | 09:58 | |
*** zslot has joined #openstack-swift | 10:00 | |
*** nosnos has quit IRC | 10:03 | |
*** zslot has quit IRC | 10:07 | |
*** zslot has joined #openstack-swift | 10:08 | |
*** ctennis has quit IRC | 10:10 | |
*** ctennis has joined #openstack-swift | 10:10 | |
*** haomaiw__ has joined #openstack-swift | 10:19 | |
*** haomaiwang has quit IRC | 10:23 | |
openstackgerrit | Pawel Palucki proposed a change to openstack/swift: type tradeoff -> trade off https://review.openstack.org/108638 | 10:33 |
openstackgerrit | Pawel Palucki proposed a change to openstack/swift: typo tradeoff -> trade off https://review.openstack.org/108638 | 10:35 |
*** ho has quit IRC | 10:43 | |
*** DisneyRicky has joined #openstack-swift | 11:10 | |
*** nosnos has joined #openstack-swift | 11:13 | |
*** k4n0 has quit IRC | 11:28 | |
*** nosnos has quit IRC | 11:40 | |
*** tongli has joined #openstack-swift | 11:48 | |
*** dmorita has quit IRC | 12:13 | |
*** psharma has quit IRC | 12:24 | |
*** mrsnivvel has joined #openstack-swift | 12:28 | |
*** mkollaro has joined #openstack-swift | 12:44 | |
*** erlon has joined #openstack-swift | 12:48 | |
*** mmcardle has quit IRC | 12:51 | |
*** anand_ts has quit IRC | 13:00 | |
*** mmcardle has joined #openstack-swift | 13:03 | |
*** DisneyRicky has quit IRC | 13:11 | |
*** tdasilva has joined #openstack-swift | 13:14 | |
acoles | portante: some keystone v3 setup steps here: https://gist.github.com/alistairncoles/ae9d5f92063b58afeb88 | 13:24 |
acoles | portante: if you have keystone running then just the openstackclient pieces are relevant (and the bash script) to setup non-default domain user & project | 13:25 |
acoles | portante: i am just working through the steps on a devstack machine...(but hit the pki token too long issue :( ) | 13:26 |
*** minisot has joined #openstack-swift | 13:28 | |
*** ppai has quit IRC | 13:32 | |
portante | :( thanks acoles | 13:37 |
minisot | hi all, is there any possibility to mark the zone as read-only? | 13:39 |
*** sts has joined #openstack-swift | 13:42 | |
sts | hello folks. is there a way to specify the region for a user in keystone? | 13:42 |
openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/89250 | 13:48 |
*** mmcardle has quit IRC | 13:55 | |
minisot | what this error "ERROR Container update failed (saving for async update later): 411 response from", how to fix? | 14:06 |
*** chandankumar has joined #openstack-swift | 14:06 | |
acoles | portante: added comment to gist https://gist.github.com/alistairncoles/ae9d5f92063b58afeb88 showing two config changes needed to run devstack swift with keystone v3 | 14:10 |
acoles | portante: that plus the script on same gist should get you setup with user/project in a non-default domain | 14:11 |
*** bszabo_ has joined #openstack-swift | 14:17 | |
*** annegent_ has joined #openstack-swift | 14:20 | |
*** annegent_ is now known as annegentle_ | 14:21 | |
*** mrmoje has joined #openstack-swift | 14:27 | |
*** mmcardle has joined #openstack-swift | 14:28 | |
*** rook_ has joined #openstack-swift | 14:37 | |
*** mrsnivvel has quit IRC | 14:41 | |
*** ujjain has quit IRC | 14:44 | |
*** bvandenh has quit IRC | 14:45 | |
*** chandankumar has quit IRC | 14:48 | |
*** ujjain has joined #openstack-swift | 14:49 | |
*** bkopilov has quit IRC | 14:52 | |
*** mrsnivvel has joined #openstack-swift | 14:54 | |
*** mrsnivvel has quit IRC | 15:04 | |
*** chandankumar has joined #openstack-swift | 15:07 | |
*** corvus is now known as jeblair | 15:07 | |
*** nacim has quit IRC | 15:09 | |
*** kevinc_ has joined #openstack-swift | 15:13 | |
*** DisneyRicky has joined #openstack-swift | 15:16 | |
*** mrsnivvel has joined #openstack-swift | 15:20 | |
*** rando has quit IRC | 15:29 | |
*** mdonohoe has joined #openstack-swift | 15:29 | |
*** aerwin has joined #openstack-swift | 15:47 | |
*** els13 has quit IRC | 15:49 | |
*** foexle has quit IRC | 15:53 | |
notmyname | good morning | 16:03 |
notmyname | acoles: I see (via email) that you reviewed the EC docs. thanks. if it's good, go ahead and land it to move that along | 16:06 |
acoles | notmyname: ok | 16:08 |
acoles | notmyname: good morning btw! | 16:08 |
*** wer is now known as werbrb | 16:08 | |
*** annegentle_ has quit IRC | 16:10 | |
*** annegent_ has joined #openstack-swift | 16:11 | |
notmyname | this may be the most awesomely ridiculous thing I've seen in a long time: https://www.stackmonkey.com/blog/for-bitcoin-from-a-twitter-marketing-bot/ | 16:12 |
notmyname | acoles: looks like your fix for the context sensitive help has landed in swiftclient. time for a release | 16:14 |
*** tdasilva has quit IRC | 16:17 | |
acoles | notmyname: yup, and the SP one for upload. | 16:20 |
*** mrmoje has quit IRC | 16:21 | |
*** mwstorer has joined #openstack-swift | 16:25 | |
*** annegent_ has quit IRC | 16:26 | |
notmyname | so according to twitter, the opening oscon keynote was given by a 14 year old who just recently open-sourced a bioinformatics library in scala | 16:27 |
*** bszabo_ has quit IRC | 16:31 | |
*** bszabo has joined #openstack-swift | 16:31 | |
*** gyee has joined #openstack-swift | 16:34 | |
openstackgerrit | A change was merged to openstack/swift: Add X-Delete-At/After support to FormPost https://review.openstack.org/104101 | 16:36 |
*** bszabo has quit IRC | 16:37 | |
notmyname | release done. https://pypi.python.org/pypi/python-swiftclient/2.2.0 | 16:41 |
*** bkopilov has joined #openstack-swift | 16:43 | |
openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 16:45 |
*** acoles is now known as acoles_away | 16:49 | |
*** aerwin has quit IRC | 16:51 | |
*** tdasilva has joined #openstack-swift | 16:59 | |
notmyname | ok, so swiftclient 2.2.0 now can generate tempurls. and ironic needs that. so they bump the global requirements file to specify python-swiftclient>=2.2.0. and now every project is supposed to upgrade their requirements file | 17:05 |
swifterdarrell | notmyname: lol? | 17:15 |
torgomatic | notmyname: you know, I think that's the silver lining to losing the auto-abandon bot... I can mute those global-requirements threads in Gmail, and I never have to see those messages :) | 17:18 |
*** mmcardle has quit IRC | 17:23 | |
*** shri has joined #openstack-swift | 17:28 | |
*** chandankumar has quit IRC | 17:34 | |
openstackgerrit | A change was merged to openstack/swift: Initial Erasure Code Docs https://review.openstack.org/104713 | 17:35 |
*** fifieldt has joined #openstack-swift | 17:35 | |
notmyname | peluse_: ^^ yay! | 17:35 |
notmyname | acoles_away: thanks :-) | 17:35 |
*** zslot has quit IRC | 17:59 | |
*** annegent_ has joined #openstack-swift | 18:10 | |
*** annegent_ has quit IRC | 18:22 | |
*** MooingLemur has quit IRC | 18:31 | |
*** mrmoje has joined #openstack-swift | 18:33 | |
*** werbrb is now known as wer | 18:33 | |
*** fifieldt has quit IRC | 18:39 | |
*** kevinc_ has quit IRC | 18:44 | |
*** shakamunyi has joined #openstack-swift | 18:56 | |
*** fifieldt has joined #openstack-swift | 18:58 | |
*** MooingLemur has joined #openstack-swift | 19:10 | |
*** pberis has quit IRC | 19:15 | |
*** fifieldt has quit IRC | 19:17 | |
*** fifieldt has joined #openstack-swift | 19:17 | |
*** fifieldt has joined #openstack-swift | 19:18 | |
*** fifieldt has quit IRC | 19:18 | |
*** fifieldt has joined #openstack-swift | 19:18 | |
*** kevinc_ has joined #openstack-swift | 19:20 | |
*** pberis has joined #openstack-swift | 19:22 | |
*** mkollaro has quit IRC | 19:24 | |
*** pberis has quit IRC | 19:31 | |
*** pberis has joined #openstack-swift | 19:32 | |
*** kevinc_ has quit IRC | 19:41 | |
*** shakamunyi has quit IRC | 19:42 | |
*** fifieldt has quit IRC | 19:43 | |
*** pberis has quit IRC | 19:46 | |
*** pberis has joined #openstack-swift | 19:49 | |
*** fausto has joined #openstack-swift | 20:13 | |
*** fifieldt has joined #openstack-swift | 20:15 | |
peluse_ | notmyname: awesome! having docs as the first patch on the EC branch is a great start this time I think! | 20:31 |
peluse_ | BTW nice job everyone who worked on the latest swiftclient, some good stuff in there.... | 20:32 |
*** DisneyRicky has quit IRC | 20:37 | |
*** DisneyRicky has joined #openstack-swift | 20:43 | |
*** kevinc_ has joined #openstack-swift | 21:04 | |
*** foexle has joined #openstack-swift | 21:14 | |
*** dmsimard is now known as dmsimard_away | 21:26 | |
*** rook_ has quit IRC | 21:26 | |
*** zaitcev has joined #openstack-swift | 21:30 | |
*** ChanServ sets mode: +v zaitcev | 21:30 | |
mattoliverau | Morning all | 21:32 |
*** shakamunyi has joined #openstack-swift | 21:32 | |
notmyname | mattoliverau: good morning | 21:33 |
mattoliverau | Back in oz and in my normal time zone (well in psudo German Australian timezone) :p | 21:35 |
mattoliverau | Nice work on swiftclient all :) | 21:35 |
notmyname | ya, it's nice to have those last features landed. :-) | 21:35 |
*** foexle has quit IRC | 21:39 | |
openstackgerrit | Pawel Palucki proposed a change to openstack/swift: typo tradeoff -> trade-off https://review.openstack.org/108638 | 21:47 |
peluse_ | ^ so not big deal but I'm pretty sure "tradeoff" is a valid word no? | 21:48 |
openstackgerrit | Pawel Palucki proposed a change to openstack/swift: typo tradeoff -> trade-off https://review.openstack.org/108638 | 21:49 |
*** shakamunyi has quit IRC | 21:56 | |
*** tongli has quit IRC | 21:59 | |
openstackgerrit | John Dickinson proposed a change to openstack/swift: Multithread optimization for object updater https://review.openstack.org/75941 | 22:05 |
notmyname | ^^ "just" a rebase, but please check that I did it correctly (tests pass, ship it!) | 22:06 |
*** tdasilva has quit IRC | 22:07 | |
*** fifieldt has quit IRC | 22:13 | |
torgomatic | notmyname: it worries me a little that there were two dict.copy() calls in the old code but only one in the new | 22:15 |
*** pberis has quit IRC | 22:18 | |
notmyname | (tradeoff vs trade-off) vs (talking about it). I merged it | 22:27 |
*** fifieldt has joined #openstack-swift | 22:28 | |
peluse_ | well-done :) | 22:35 |
*** fausto has quit IRC | 22:57 | |
*** bszabo has joined #openstack-swift | 23:01 | |
*** bszabo has quit IRC | 23:06 | |
openstackgerrit | A change was merged to openstack/swift: Add v2 API to list endpoints middleware https://review.openstack.org/101665 | 23:33 |
notmyname | mattoliverau: around? | 23:41 |
mattoliverau | notmyname: yup :) | 23:42 |
notmyname | mattoliverau: tell me about https://review.openstack.org/#/c/101743/ | 23:42 |
mattoliverau | notmyname: was about to ask if I could add a topic to the next meeting agenda? | 23:43 |
mattoliverau | I'll take a look | 23:43 |
notmyname | mattoliverau: it's your patch | 23:43 |
notmyname | mattoliverau: did we not have any tests testing a 499 response? | 23:43 |
mattoliverau | Hold on let me move to a laptop were I can type faster :) | 23:44 |
mattoliverau | notmyname: it was a resonse to a bug, where there were no tests covering partial writes being handled (or tested) in the object sever. Seeing as there maybe seperate implementations of DiskFile, I thought it mights be imported to still make sure partial wirtes are handled correctly. So I've added 2 tests, mocking the number of bytes written. One which failes in the first chuck and one that fails in the second (to test | 23:49 |
mattoliverau | chuncking in the object server). | 23:49 |
mattoliverau | s/imported/important. | 23:50 |
notmyname | mattoliverau: there is already the test_short_body() test in there that seems to do the same thing. well, I like your's a little better | 23:51 |
mattoliverau | notmyname: oh yeah, that probably does something similar, I've just been working through swift bugs and attempting to fix them, I should look a bit more closely to see if there is already some cross over existing. Sorry. | 23:53 |
notmyname | mattoliverau: and there is only one place in the object server that returns the HTTPClientDisconnect. what do you mean byt he 2 tests failing in 2 different places? | 23:53 |
notmyname | mattoliverau: I'm looking through swifterdarrell's bug report now | 23:54 |
mattoliverau | notmyname: I'm testing the one place twice, but wanted to do better bounds checking, so I fail the first straight away. And the second in a later chunk. | 23:55 |
mattoliverau | Thus I need to make the second test body chunk_size + 6. And then partial write of chunk_size + 5. | 23:56 |
notmyname | ya that makes sense and sounds reasonable | 23:57 |
*** fifieldt has quit IRC | 23:57 | |
openstackgerrit | A change was merged to openstack/swift: typo tradeoff -> trade-off https://review.openstack.org/108638 | 23:58 |
*** kevinc_ has quit IRC | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!