*** kevinc___ has quit IRC | 00:04 | |
*** matsuhashi has joined #openstack-swift | 00:23 | |
*** igor_ has joined #openstack-swift | 00:30 | |
*** igor_ has quit IRC | 00:34 | |
*** dmorita has joined #openstack-swift | 00:38 | |
*** shri has quit IRC | 00:39 | |
*** pberis has quit IRC | 00:46 | |
*** r-daneel has joined #openstack-swift | 01:17 | |
*** igor_ has joined #openstack-swift | 01:31 | |
*** igor_ has quit IRC | 01:35 | |
*** nosnos has joined #openstack-swift | 01:35 | |
*** eglynn has quit IRC | 01:54 | |
*** ZBhatti_ has quit IRC | 01:55 | |
*** saschpe- has quit IRC | 01:57 | |
*** dmorita has quit IRC | 01:58 | |
*** gholt has quit IRC | 01:58 | |
*** r-daneel has quit IRC | 01:59 | |
*** dmorita has joined #openstack-swift | 02:01 | |
*** saschpe has joined #openstack-swift | 02:03 | |
*** gholt has joined #openstack-swift | 02:04 | |
*** ChanServ sets mode: +v gholt | 02:05 | |
*** igor_ has joined #openstack-swift | 02:32 | |
*** haomaiwa_ has joined #openstack-swift | 02:32 | |
*** igor_ has quit IRC | 02:36 | |
*** ZBhatti has joined #openstack-swift | 02:37 | |
*** haomaiwa_ has quit IRC | 02:38 | |
*** gyee has quit IRC | 02:40 | |
*** blazesurfer has joined #openstack-swift | 02:48 | |
blazesurfer | hi all | 02:48 |
---|---|---|
blazesurfer | got a questions around swift rings and changing the ip address of a node in the ring? any body done this before ? | 02:48 |
*** nosnos has quit IRC | 03:03 | |
occupant | can't say i have. this channel has mostly gone to sleep, might wanna try tomorrow. | 03:03 |
*** matsuhashi has quit IRC | 03:29 | |
*** igor_ has joined #openstack-swift | 03:32 | |
*** haomaiwa_ has joined #openstack-swift | 03:34 | |
*** matsuhashi has joined #openstack-swift | 03:36 | |
*** igor_ has quit IRC | 03:37 | |
*** haomaiwa_ has quit IRC | 03:39 | |
*** matsuhashi has quit IRC | 03:43 | |
*** matsuhashi has joined #openstack-swift | 03:43 | |
*** matsuhas_ has joined #openstack-swift | 03:45 | |
*** matsuhashi has quit IRC | 03:45 | |
*** nosnos has joined #openstack-swift | 03:45 | |
openstackgerrit | Pete Zaitcev proposed a change to openstack/swift: Separate Backend from Broker https://review.openstack.org/85909 | 04:00 |
*** ppai has joined #openstack-swift | 04:17 | |
*** matsuhas_ has quit IRC | 04:34 | |
*** matsuhashi has joined #openstack-swift | 04:43 | |
anticw_ | blazesurfer: there isn't really an easy way to do this ... that is edit a device | 04:46 |
anticw_ | though you could certainly hack something up | 04:46 |
*** ppai has quit IRC | 04:52 | |
*** psharma has joined #openstack-swift | 05:04 | |
*** ppai has joined #openstack-swift | 05:10 | |
*** zaitcev has quit IRC | 05:19 | |
*** shakayumi has joined #openstack-swift | 05:30 | |
*** Guest75729 has joined #openstack-swift | 05:30 | |
*** Guest75729 has quit IRC | 05:31 | |
*** sagar_ has joined #openstack-swift | 05:32 | |
*** sagar_ has quit IRC | 05:34 | |
*** igor_ has joined #openstack-swift | 05:34 | |
*** igor_ has quit IRC | 05:38 | |
*** blazesurfer has quit IRC | 05:47 | |
*** nmap911 has quit IRC | 06:02 | |
*** nshaikh has joined #openstack-swift | 06:23 | |
*** jamie_h has joined #openstack-swift | 07:05 | |
*** foexle has joined #openstack-swift | 07:20 | |
*** igor has joined #openstack-swift | 07:42 | |
*** haomaiwang has joined #openstack-swift | 07:42 | |
*** haomaiwang has quit IRC | 07:47 | |
*** acoles_away is now known as acoles | 07:51 | |
*** nacim has joined #openstack-swift | 08:00 | |
*** matsuhashi has quit IRC | 08:48 | |
*** shakayumi has quit IRC | 09:01 | |
*** matsuhashi has joined #openstack-swift | 09:16 | |
openstackgerrit | Christian Berendt proposed a change to openstack/swift: use /usr/bin/env python instead of /usr/bin/python https://review.openstack.org/95115 | 09:27 |
*** dmorita has quit IRC | 09:39 | |
*** nosnos has quit IRC | 09:45 | |
*** ppai has quit IRC | 09:55 | |
*** ccorrigan has quit IRC | 09:55 | |
*** mkollaro has joined #openstack-swift | 10:02 | |
*** ppai has joined #openstack-swift | 10:08 | |
*** matsuhashi has quit IRC | 10:12 | |
*** matsuhas_ has joined #openstack-swift | 10:15 | |
*** openstackstatus has quit IRC | 10:20 | |
*** openstack has joined #openstack-swift | 10:21 | |
*** openstackstatus has joined #openstack-swift | 10:22 | |
*** ChanServ sets mode: +v openstackstatus | 10:22 | |
*** erlon has quit IRC | 10:22 | |
*** erlon has joined #openstack-swift | 10:23 | |
*** fifieldt has quit IRC | 10:31 | |
*** ppai has quit IRC | 10:33 | |
*** ccorrigan has joined #openstack-swift | 10:34 | |
*** acoles is now known as acoles_away | 10:47 | |
*** matsuhas_ has quit IRC | 10:55 | |
*** matsuhashi has joined #openstack-swift | 10:57 | |
*** matsuhashi has quit IRC | 10:58 | |
*** matsuhashi has joined #openstack-swift | 10:58 | |
*** matsuhashi has quit IRC | 10:58 | |
*** matsuhashi has joined #openstack-swift | 10:59 | |
*** igor_ has joined #openstack-swift | 11:05 | |
*** igor has quit IRC | 11:08 | |
*** ccorrigan has quit IRC | 11:23 | |
*** acoles_away is now known as acoles | 11:34 | |
*** nshaikh has quit IRC | 11:42 | |
*** haomaiwang has joined #openstack-swift | 11:49 | |
*** psharma has quit IRC | 11:52 | |
*** gpocentek has quit IRC | 11:52 | |
*** haomaiwang has quit IRC | 11:59 | |
*** matsuhashi has quit IRC | 12:20 | |
*** matsuhashi has joined #openstack-swift | 12:21 | |
*** shakayumi has joined #openstack-swift | 12:23 | |
*** prassee has joined #openstack-swift | 12:25 | |
*** matsuhashi has quit IRC | 12:26 | |
*** prassee has left #openstack-swift | 12:27 | |
*** foexle has quit IRC | 12:28 | |
*** matsuhashi has joined #openstack-swift | 12:37 | |
*** matsuhashi has quit IRC | 12:38 | |
*** matsuhashi has joined #openstack-swift | 12:38 | |
*** matsuhashi has quit IRC | 12:38 | |
*** matsuhashi has joined #openstack-swift | 12:39 | |
*** matsuhashi has quit IRC | 12:43 | |
*** ophuk has quit IRC | 12:51 | |
*** miqui has joined #openstack-swift | 12:54 | |
*** haomaiwang has joined #openstack-swift | 12:56 | |
*** kenhui has joined #openstack-swift | 13:06 | |
*** Ju has quit IRC | 13:07 | |
*** roock has joined #openstack-swift | 13:10 | |
*** haomaiwang has quit IRC | 13:13 | |
roock | hello. i'm currently evaluating openstack swift and i have the problem with "Quarantined object(s)" which are not deleted and filling up my disk. see https://gist.github.com/roock/e3bf6ba2e58166bdd3a4 I couldn't find any documentation. Any help appreciated. Thank you in advanceD! | 13:14 |
acoles | dfg: clayg: i read playback of the xlo stuff you were discussing here yesterday. looks like you found a solution? | 13:20 |
*** tdasilva has joined #openstack-swift | 13:29 | |
*** mrsnivvel has quit IRC | 13:33 | |
*** r-daneel has joined #openstack-swift | 13:44 | |
creiht | roock: That indicates there is an issue with your configuration | 13:46 |
creiht | make sure your hash prefix/suffixes are the same in swift.conf on all of your boxes | 13:47 |
*** bill_az has joined #openstack-swift | 13:47 | |
roock | creiht: ok. thanks i'll check it. can i just remove the whole quarantined/ on the discs which got full? | 13:48 |
*** ujjain has joined #openstack-swift | 13:50 | |
creiht | roock: hrm | 13:50 |
ujjain | so objects are files? | 13:50 |
creiht | ujjain: objects are stored as files on a filesystem | 13:50 |
creiht | roock: that kinda depends | 13:50 |
creiht | if you don't care about your data, the easy answer is fix the configs, and delete it | 13:50 |
roock | it's still a test setup, so i don't care about the data (yet) | 13:51 |
creiht | (since it is an evaluation) | 13:51 |
creiht | yeah that's what I was curious about | 13:51 |
creiht | then deleting should be fine | 13:51 |
creiht | if this were a production system, you might want to keep it around a bit to make sure you don't lose data | 13:52 |
roock | and you were right, i had indeed a typo in the swift.conf - thought i had replaced them all | 13:54 |
roock | thank you very much | 13:57 |
creiht | np | 13:58 |
roock | are there any ways to improve performance by using a small cache storge on the proxy/storage nodes (e.g. small ssd)? | 14:01 |
*** bill_az has quit IRC | 14:02 | |
*** bill_az has joined #openstack-swift | 14:02 | |
*** shakayumi has quit IRC | 14:07 | |
dfg | acoles: ya i think so- i still need to try it out a bit | 14:07 |
acoles | dfg: i played with clayg's patch a bit and it worked ok with func tests. | 14:08 |
*** haomaiwa_ has joined #openstack-swift | 14:09 | |
acoles | dfg: the way clayg copies keystone.identity in make_env is probably better idea than copying all the keystone headers, cos that header set will expand with v3 keystone. kesytone.identity will encapsulate the whole lot. | 14:10 |
*** pberis has joined #openstack-swift | 14:13 | |
dfg | acoles: ok cool. | 14:13 |
*** LIYUEZHO_ has joined #openstack-swift | 14:15 | |
*** LIYUEZHO_ has quit IRC | 14:23 | |
*** kenhui has quit IRC | 14:26 | |
notmyname | cschwede_: to confirm, as far as you know, python-swiftclient is good for a release saying py33 is fully supported. is this correct? | 14:26 |
notmyname | cschwede_: if so, I'll work on cutting a release today | 14:27 |
*** haomaiwa_ has quit IRC | 14:31 | |
cschwede_ | notmyname: Yes, I think so - I run the functional and unit tests as well as some manual command line actions inside a Python 3.3 virtualenv, and everything worked as expected | 14:33 |
cschwede_ | notmyname: looking forward to a py33 release :) | 14:33 |
*** yuanz has joined #openstack-swift | 14:36 | |
notmyname | cschwede_: cool. thanks | 14:38 |
* notmyname is going to attempt the office today | 14:39 | |
notmyname | I'll be back online later | 14:39 |
*** yuanzz has quit IRC | 14:40 | |
*** igor_ has quit IRC | 15:09 | |
*** kevinc___ has joined #openstack-swift | 15:20 | |
*** gyee has joined #openstack-swift | 15:23 | |
*** kenhui has joined #openstack-swift | 15:26 | |
*** haomaiwa_ has joined #openstack-swift | 15:28 | |
*** tdasilva has left #openstack-swift | 15:34 | |
*** kenhui has quit IRC | 15:35 | |
*** kenhui has joined #openstack-swift | 15:35 | |
*** haomaiwa_ has quit IRC | 15:48 | |
openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/89250 | 15:52 |
openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 15:52 |
*** Trixboxer has joined #openstack-swift | 15:56 | |
*** tdasilva has joined #openstack-swift | 15:58 | |
*** kenhui1 has joined #openstack-swift | 16:00 | |
*** kenhui has quit IRC | 16:04 | |
*** mwstorer has joined #openstack-swift | 16:05 | |
notmyname | /back | 16:07 |
notmyname | why did the netifaces req get bumped in global reqs? | 16:09 |
Alex_Gaynor | py3 support I think | 16:10 |
*** praveenkumar has quit IRC | 16:14 | |
*** nacim has quit IRC | 16:15 | |
*** mwstorer has quit IRC | 16:17 | |
*** sneezewort has joined #openstack-swift | 16:21 | |
sneezewort | This might be a dumb question , but is there an exclude option for Swift? | 16:23 |
sneezewort | Fo example: swift upload mystuffcontainer /allstuffdir --exclude /allstuffdir/privatestuff | 16:23 |
notmyname | sneezewort: how do you mean? | 16:23 |
notmyname | ah | 16:23 |
notmyname | sneezewort: no, I don't think so. but it sounds like a nice feature :-) | 16:25 |
sneezewort | OK thanks. | 16:27 |
*** kevinc___ has quit IRC | 16:27 | |
*** kevinc___ has joined #openstack-swift | 16:32 | |
*** zaitcev has joined #openstack-swift | 16:52 | |
*** ChanServ sets mode: +v zaitcev | 16:52 | |
notmyname | python-swiftclient 2.1.0 tag pushed to gerrit for release | 16:54 |
*** Longgeek_ has joined #openstack-swift | 16:58 | |
portante | nice! | 17:09 |
notmyname | https://pypi.python.org/pypi/python-swiftclient/ | 17:09 |
Alex_Gaynor | wahoo! | 17:10 |
creiht | woot | 17:10 |
*** shri has joined #openstack-swift | 17:10 | |
notmyname | for the retweets: https://twitter.com/notmyname/status/469888194125643776 | 17:11 |
*** Longgeek_ has quit IRC | 17:13 | |
*** bboris has joined #openstack-swift | 17:14 | |
bboris | hello | 17:14 |
*** shri has quit IRC | 17:14 | |
dfg | acoles: what should I do with the dlo after_fn pipeline reordering thing? i want it after auth- but we can't really reference all the auths can we? should I just you tempauth, keystoneauth or something? | 17:42 |
dfg | s/just you/just use/ | 17:44 |
*** kenhui1 has quit IRC | 17:57 | |
*** tdasilva has quit IRC | 18:03 | |
*** jamie_h has quit IRC | 18:10 | |
*** jamie_h has joined #openstack-swift | 18:13 | |
*** r-daneel has left #openstack-swift | 18:35 | |
*** Trixboxer has quit IRC | 18:36 | |
*** tdasilva has joined #openstack-swift | 18:37 | |
*** kevinc___ has quit IRC | 18:38 | |
*** NM has joined #openstack-swift | 18:39 | |
*** jogo is now known as flashgordon | 18:52 | |
*** john3213 has joined #openstack-swift | 18:54 | |
*** john3213 has left #openstack-swift | 18:59 | |
*** mkollaro has quit IRC | 19:01 | |
notmyname | creiht: you may get your wish of swift-specs vs object-specs ;-) | 19:16 |
creiht | haha | 19:20 |
creiht | yeah I saw the email | 19:20 |
notmyname | creiht: I told them I was ok with it. | 19:25 |
notmyname | as I said earlier, IMO: consistency >> {project}-specs > {program}-specs | 19:26 |
notmyname | so, you know. whatever. ;-) | 19:26 |
*** shri has joined #openstack-swift | 19:27 | |
creiht | lol | 19:29 |
*** jamie_h has quit IRC | 19:30 | |
zaitcev | See, this ranges[] thing is exactly why I avoid approving reviews | 19:42 |
*** kevinc_ has joined #openstack-swift | 19:43 | |
zaitcev | Now I wonder if I still could trade Sam for https://review.openstack.org/93164, because I'm very proud of that patchlet | 19:43 |
zaitcev | It's absurdly insignificant, but I feel like I fixed an actual operational issue for a change. | 19:43 |
wkelly | zaitcev: as a sysadmin, I appreciate that one! | 19:56 |
*** tdasilva has left #openstack-swift | 20:02 | |
-openstackstatus- NOTICE: Gerrit will be offline for about 20 minutes in order to rename some projects starting at 21:00 UTC. | 20:34 | |
*** annegentle_ has quit IRC | 20:34 | |
*** kenhui has joined #openstack-swift | 20:47 | |
*** kevinc_ has quit IRC | 20:59 | |
*** kenhui has quit IRC | 21:01 | |
bboris | why does swift fail to create anything? | 21:05 |
bboris | swift upload container file, returns: HTTP/1.1 404 Not Found | 21:06 |
bboris | i can only stat the account | 21:06 |
bboris | and list it, but returns nothing because i haven't uploaded anything yet | 21:07 |
creiht | bboris: do you have account_autocreate = true in your swift-proxy.conf? | 21:08 |
*** mattoliverau has quit IRC | 21:08 | |
bboris | yes | 21:08 |
creiht | ok, then next step is to look at the logs to see what is failing | 21:09 |
creiht | bboris: are you using an saio install? | 21:09 |
bboris | not exactly | 21:10 |
bboris | i have a bunch of lxcs | 21:11 |
bboris | 1 auth, 1 proxy and 10 storage virtual machines | 21:11 |
*** mattoliverau has joined #openstack-swift | 21:11 | |
creiht | ok | 21:11 |
bboris | also, this is logged when trying to create: Could not autocreate account '/AUTH_f892dea27eda447cb5ef10f8b71f6024' (txn: txe565c0650dfd475fbe916-00537fb934) | 21:12 |
creiht | ok that's why your request is failing | 21:12 |
creiht | next step is search the logs on all of the storage nodes for txe565c0650dfd475fbe916-00537fb934 | 21:12 |
bboris | what is txn? | 21:12 |
bboris | transaction number? | 21:12 |
creiht | yeah | 21:12 |
bboris | ok, let me check | 21:13 |
creiht | just a unique identifier for each unique request that comes into the system | 21:13 |
creiht | every log line posts it, so helps track down issues | 21:13 |
bboris | i should really get a centralized log for this... sigh | 21:13 |
creiht | hehe | 21:13 |
creiht | dsh is also your friend in cases like this :) | 21:14 |
*** bsdkurt has quit IRC | 21:14 | |
bboris | doh, permission denied on the drives | 21:15 |
bboris | chown -R swift:swift /srv/node | 21:16 |
*** annegentle has joined #openstack-swift | 21:18 | |
*** kevinc_ has joined #openstack-swift | 21:20 | |
bboris | creiht: dsh looks like a copy of the script i made for swift testing :) | 21:22 |
creiht | hehe | 21:22 |
bboris | creiht: so it works now, thanks. i have another problem though | 21:27 |
bboris | is it normal to take ~450 ms to get a response from swift? | 21:28 |
creiht | shouldn't be | 21:28 |
*** annegentle has quit IRC | 21:28 | |
bboris | list/stat/whatever takes around that much | 21:28 |
bboris | where could the bottleneck be? | 21:28 |
creiht | I would do the same thing we did before to find the request in the proxy logs, then search for the transaction in the storage lofs | 21:29 |
creiht | logs | 21:29 |
creiht | usually for something like that there is a misconfiguration, or other failure that causes timeouts to occur | 21:29 |
creiht | swift will try to work around failures as much as possible, but this also can add latency to requests | 21:30 |
-openstackstatus- NOTICE: Gerrit is offline in order to rename some projects. ETA: 22:00. | 21:36 | |
*** ChanServ changes topic to "Gerrit is offline in order to rename some projects. ETA: 22:00." | 21:36 | |
*** NM has quit IRC | 21:39 | |
bboris | object-expirer says that it fails to connect to memcached | 21:44 |
bboris | isn't memcached used only on the proxy? | 21:45 |
creiht | mostly | 21:45 |
creiht | though I don't think the object-expirer would add latency to your requests | 21:45 |
creiht | it should be a background process | 21:45 |
bboris | i see something else | 21:47 |
bboris | as i have 10 storage nodes | 21:47 |
bboris | it first tries to get it from storage10 | 21:47 |
bboris | it gets 404 | 21:47 |
bboris | then it tries from storage08, where it gets 204 | 21:48 |
creiht | make sure replication is working, and isn't causing errors | 21:49 |
bboris | but, when i tried to stat the account again, it tried storage08 directly and got 204 | 21:49 |
creiht | well isn't failing due to errors | 21:49 |
bboris | and time was 450 ms too | 21:49 |
creiht | hrm | 21:49 |
creiht | what are you using for auth? | 21:50 |
bboris | keystone | 21:51 |
creiht | ahh | 21:51 |
creiht | what type of tokens are you using? | 21:52 |
bboris | uuid | 21:52 |
creiht | k | 21:52 |
creiht | the proxy servers aren't showing any memcache connection issues? | 21:52 |
bboris | was using pki, but it took the same time and it looked ugly while testing | 21:52 |
creiht | hehe | 21:53 |
bboris | let me see | 21:53 |
creiht | if it can't cache the token, then it will have to ask keystone to validate on every requests | 21:53 |
bboris | no errors about memcached | 21:53 |
bboris | not mentioned in the syslog at all | 21:54 |
creiht | k | 21:54 |
creiht | bboris: sorry that I have to go | 21:55 |
creiht | at this point you will have to try to isolate what is causing the extra latency | 21:55 |
creiht | you could try temporarily removing auth from the pipeline just to validate if that is causing extra latency | 21:55 |
creiht | you could also watch the keystone logs to see how often validations are coming in | 21:56 |
zaitcev | object-expirer usually runs on a proxy | 21:56 |
creiht | sorry I can't help any further this evening | 21:56 |
zaitcev | deceptive name | 21:56 |
bboris | creiht: thanks for the help :) i'll play around a bit, have a good night | 21:57 |
bboris | zaitcev: it's on the storage nodes in my case | 21:57 |
bboris | the token really is different on every swift stat -v | 22:02 |
*** openstackgerrit has quit IRC | 22:14 | |
*** openstackgerrit has joined #openstack-swift | 22:14 | |
*** openstackstatus has quit IRC | 22:18 | |
*** openstack has joined #openstack-swift | 22:19 | |
*** openstackstatus has joined #openstack-swift | 22:20 | |
*** ChanServ sets mode: +v openstackstatus | 22:20 | |
*** kevinc_ has quit IRC | 22:26 | |
openstackgerrit | Monty Taylor proposed a change to openstack/swift-specs: Updated gitreview file for repo rename https://review.openstack.org/95291 | 22:28 |
*** ChanServ changes topic to ""Swift: It's not just another object storage" -- cschwede" | 22:29 | |
openstackgerrit | Monty Taylor proposed a change to openstack/swift-specs: Updated gitreview file for repo rename https://review.openstack.org/95296 | 22:34 |
notmyname | mordred: what's the difference there? | 22:35 |
mordred | notmyname: trailing .git from a review in ironic. it actually doesn't matter - and I messed up the commit amend | 22:37 |
mordred | so I just abandoned | 22:37 |
notmyname | mordred: ok. I approved one of them | 22:37 |
notmyname | mordred: but I don't know if jenkins got it | 22:37 |
mordred | notmyname: honestly, both are functional | 22:37 |
notmyname | mordred: and now it's on me to set up the specs repo from the skeleton repo? | 22:39 |
mordred | notmyname: I believe so, yes | 22:40 |
notmyname | mordred: cool. /me adds it to the weekend's TODO list | 22:41 |
mordred | notmyname: you want me to make you a base commit? | 22:41 |
notmyname | mordred: nah, I'll get it | 22:41 |
mordred | kk | 22:41 |
*** sneezewort has quit IRC | 23:01 | |
*** NM has joined #openstack-swift | 23:02 | |
openstackgerrit | A change was merged to openstack/python-swiftclient: Fix wrong assertions in unit tests https://review.openstack.org/94920 | 23:42 |
*** NM has quit IRC | 23:48 | |
*** ozialien has joined #openstack-swift | 23:56 | |
*** NM has joined #openstack-swift | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!