*** mwstorer has quit IRC | 00:09 | |
*** annegent_ has joined #openstack-swift | 00:15 | |
*** kota_ has joined #openstack-swift | 00:16 | |
*** kevinc_ has quit IRC | 00:20 | |
*** annegent_ has quit IRC | 00:20 | |
*** dmorita has joined #openstack-swift | 00:32 | |
*** matsuhashi has joined #openstack-swift | 00:35 | |
*** pconstantine_ has quit IRC | 00:35 | |
openstackgerrit | Steven Lang proposed a change to openstack/swift: Modify the object services to report their full service name. https://review.openstack.org/102401 | 00:47 |
---|---|---|
*** shri has quit IRC | 00:49 | |
openstackgerrit | Steven Lang proposed a change to openstack/swift: Modify the object services to report their full service name. https://review.openstack.org/102401 | 01:08 |
*** annegent_ has joined #openstack-swift | 01:16 | |
openstackgerrit | Steven Lang proposed a change to openstack/swift: Modify the object services to report their full service name. https://review.openstack.org/102401 | 01:20 |
*** annegent_ has quit IRC | 01:21 | |
*** nosnos has joined #openstack-swift | 01:51 | |
*** nosnos has quit IRC | 01:56 | |
*** nosnos has joined #openstack-swift | 01:57 | |
openstackgerrit | Kota Tsuyuzaki proposed a change to openstack/swift: Efficient Replication for Distributed Regions https://review.openstack.org/99824 | 01:59 |
mlanner | peluse_: notmyname: 5 are up and running. there are some "interesting" problems that we have discovered and are trying to work through, but it's not stopping us from using the systems right now. | 02:02 |
*** kota_ has quit IRC | 02:10 | |
*** cm2 has quit IRC | 02:14 | |
*** nsquare has quit IRC | 02:30 | |
*** openstackgerrit has quit IRC | 02:31 | |
*** baojg has joined #openstack-swift | 02:33 | |
*** kota_ has joined #openstack-swift | 02:35 | |
*** mitz_ has joined #openstack-swift | 02:36 | |
*** kota_ has quit IRC | 02:39 | |
*** kota_ has joined #openstack-swift | 02:39 | |
*** annegent_ has joined #openstack-swift | 02:42 | |
*** annegent_ has quit IRC | 02:46 | |
*** fifieldt_ is now known as fifieldt | 02:47 | |
*** baojg has quit IRC | 02:56 | |
*** haomaiwa_ has joined #openstack-swift | 02:56 | |
*** baojg has joined #openstack-swift | 02:56 | |
mlanner | peluse_: who knows most about those avoton boxes? the BIOS kinda acts a bit wacky for some things. there are settings that just seem to be missing. do you know who i can contact to check for the latest BIOS version? | 02:59 |
*** jyoti_ranjan has joined #openstack-swift | 03:28 | |
*** matsuhashi has quit IRC | 03:42 | |
*** zaitcev has quit IRC | 03:43 | |
*** matsuhashi has joined #openstack-swift | 03:43 | |
*** matsuhashi has quit IRC | 03:47 | |
*** zhiyan_ is now known as zhiyan | 03:49 | |
*** nosnos has quit IRC | 03:51 | |
*** Anticimex has quit IRC | 03:57 | |
*** Kbee has joined #openstack-swift | 03:58 | |
*** baojg has quit IRC | 04:04 | |
*** annegent_ has joined #openstack-swift | 04:16 | |
*** annegent_ has quit IRC | 04:21 | |
*** baojg has joined #openstack-swift | 04:22 | |
*** matsuhashi has joined #openstack-swift | 04:31 | |
*** nosnos has joined #openstack-swift | 04:37 | |
*** ppai has joined #openstack-swift | 04:40 | |
*** kopparam has joined #openstack-swift | 04:46 | |
*** judd7 has quit IRC | 04:49 | |
*** judd7_ has quit IRC | 04:49 | |
*** judd7 has joined #openstack-swift | 04:50 | |
*** judd7_ has joined #openstack-swift | 04:51 | |
*** mmcardle has joined #openstack-swift | 04:51 | |
*** bkopilov has joined #openstack-swift | 04:56 | |
*** ajc_ has joined #openstack-swift | 04:59 | |
*** mmcardle has quit IRC | 05:01 | |
*** gyee has quit IRC | 05:02 | |
*** baojg has quit IRC | 05:02 | |
*** baojg has joined #openstack-swift | 05:02 | |
*** mmcardle has joined #openstack-swift | 05:03 | |
*** baojg has quit IRC | 05:04 | |
*** baojg has joined #openstack-swift | 05:04 | |
*** kota_ has quit IRC | 05:08 | |
*** mmcardle has quit IRC | 05:13 | |
Kbee | Hello, is there a way to choose handoff nodes, or is it upto swift-ring-builder to automagically choose handoff node depending on nodes and devices and replica count? | 05:14 |
*** annegent_ has joined #openstack-swift | 05:16 | |
*** psharma has joined #openstack-swift | 05:16 | |
*** annegent_ has quit IRC | 05:21 | |
*** ppai has quit IRC | 05:24 | |
*** ppai has joined #openstack-swift | 05:24 | |
*** nsquare has joined #openstack-swift | 05:26 | |
Kbee | notmyname, is there a way to choose handoff nodes, or is it upto swift-ring-builder to automagically choose handoff node depending on nodes and devices and replica count? | 05:27 |
mattoliverau | Hey Kbee, that is done by the ring, though you do have some say, when you add a device to the ring you can specify a weight, when you define regions you can also define a weight. | 05:30 |
mattoliverau | Kbee: the hand off nodes are determined by the hash and part power, this devided in to partitions and partitions are placed on different devices. | 05:32 |
mattoliverau | Kbee: you can have a little more control by using storage policies as you can create a new object ring that only uses a particular set of devices. | 05:33 |
Kbee | mattoliverau, Thanks. so if there are 3 storage nodes and 3 replicas, single zone, there wont be any handoff nodes right.. since the uniquely as possible algo uses three nodes to place data | 05:35 |
mattoliverau | Kbee: yes, if there only 2 storage nodes and 3 replicas all in one zone, then the hand off nodes would be all of them :) | 05:36 |
Kbee | mattoliverau, Awww.. :) .. i need to dig into code i believe to get this :) | 05:37 |
mattoliverau | Kbee: there is a list-endpoints middleware you can add to your proxy server which will tell you which nodes an object is stored on. | 05:38 |
Kbee | mattoliverau, if there are 5 servers and 3 replicas and 1 zone does ring leave the 2 object servers untouched and distribute partitions only on 3 servers.. and use the rest 2 only when something breaks on other 3 ? | 05:41 |
mattoliverau | Kbee: nope.. and kinda :P | 05:42 |
mattoliverau | Kbee: swift will use all 5 nodes for storage | 05:42 |
mattoliverau | Kbee: with 3 replica's each file written will be written to 3 of the nodes | 05:42 |
mattoliverau | Kbee: So here is a very high overview of the ring.. I'll find you the docs on it in a sec, so you can proove me wrong :P | 05:43 |
*** kota_ has joined #openstack-swift | 05:43 | |
mattoliverau | Kbee: swift does and md5sum of the requrested filename 'account/container/object' | 05:44 |
mattoliverau | Kbee: when you define a part power, this determines how much of the md5sum to use as a mask to now where to look in the ring. | 05:45 |
Kbee | mattoliverau, correct.. thats evident | 05:45 |
mattoliverau | Kbee: this points to partition number. so there are 2^part_power partitions. | 05:46 |
mattoliverau | Kbee: when the ring is build these partitions are assigned to 3 nodes. | 05:47 |
mattoliverau | Kbee: or should I say replacount number of nodes. | 05:47 |
Kbee | mattoliverau, OK.. .. replica-count nodes.. | 05:47 |
mattoliverau | Kbee: because it is based off the hash the objects should be neatly, or hopefully balanced across all 5 nodes (in your example above). | 05:48 |
mattoliverau | Kbee: but each object is on a <replica count> number of servers, but different objects could be on any of the 5 | 05:49 |
mattoliverau | Kbee: does that make sense or have I talked nonsesnse :P I'll find the documentation hold on :) | 05:50 |
Kbee | mattoliverau, hmmm.. then hows hand-off calculated.. so its more of hand-off node for each object deployed rather than hand-off node.. :) rit ? Yes pls.. could not find something on net digging on this | 05:53 |
*** ktsuyuzaki has joined #openstack-swift | 05:54 | |
mattoliverau | Kbee: I haven't watched this, but quickly skimmed it so this might help: https://swiftstack.com/blog/2012/11/21/how-the-ring-works-in-openstack-swift/ | 05:55 |
*** ktsuyuzaki is now known as kota__ | 05:55 | |
mattoliverau | there is the swift documentation: http://docs.openstack.org/developer/swift/ring.html | 05:55 |
*** kota_ has quit IRC | 05:56 | |
mattoliverau | Kbee: this might be somewhat useful as well: https://swiftstack.com/blog/2013/02/25/data-placement-in-swift/ | 05:57 |
Kbee | mattoliverau, i have gone through all :).. in the last one-data placement swift - the diagram shows that if there are 4 serves , data is always placed on 3 and the rest is not used at all and this may be used for handoff.. this was the question.. | 05:59 |
*** chandan_kumar has quit IRC | 06:00 | |
*** kota_ has joined #openstack-swift | 06:02 | |
*** kota__ has quit IRC | 06:04 | |
*** ktsuyuzaki has joined #openstack-swift | 06:09 | |
mattoliverau | Kbee: oh sorry, I must have miss understood. If there is a failure then the it will move the partition (or partitions) on the broken device and move data, it will choose using the same algorithm it initially uses (to keep it distributed). | 06:11 |
*** kota_ has quit IRC | 06:11 | |
mattoliverau | Kbee: this might be of more use then: http://mirror.linux.org.au/linux.conf.au/2013/mp4/Playing_with_OpenStack_Swift.mp4 | 06:11 |
mattoliverau | Kbee: here notmyname goes over swift automotic revovery. | 06:12 |
mattoliverau | Kbee: There was a blueprint around being able to specify hand off nodes. But not sure where that is at, or if it's even going forward. | 06:13 |
*** ktsuyuzaki has quit IRC | 06:13 | |
*** kota_ has joined #openstack-swift | 06:15 | |
Kbee | mattoliverau, i did some digging now using swift-get-nodes and by it, handoff nodes are pre decided .. and if there are number of drives > number of replicas, rest are used as hand offs.. here's o/p -> http://paste.openstack.org/show/84853/ | 06:15 |
*** annegent_ has joined #openstack-swift | 06:16 | |
Kbee | mattoliverau, i.e it always stores on 3 nodes, and rest are not used :) | 06:17 |
Kbee | mattoliverau, or stores on replica-count nodes and rest are handoff | 06:17 |
Kbee | mattoliverau, i had checked that bluprint.. thats abandoned - https://review.openstack.org/#/c/5609/ | 06:19 |
*** annegent_ has quit IRC | 06:21 | |
*** pconstantine_ has joined #openstack-swift | 06:22 | |
Kbee | mattoliverau, now i get.. for each partition, you have handoff nodes assigned on disks spanning the entire nodes .. and this is predecided during ring creation and cant be specified manually :) | 06:24 |
mattoliverau | Kbee: cool, nice work, now we have both learnt something! I should thank you :) | 06:25 |
Kbee | mattoliverau, Thank you.. should have got hold of that command bfor asking here :) | 06:26 |
*** nsquare has quit IRC | 06:28 | |
mattoliverau | Kbee: lol, no it benefitted me as much as you, so I'm glad you didn't :) | 06:28 |
Kbee | mattoliverau, no definitely i did.. Thanks.. | 06:29 |
*** nsquare has joined #openstack-swift | 06:30 | |
Kbee | mattoliverau, no definitely it did benefit.. Thanks.. | 06:30 |
*** nsquare has quit IRC | 06:31 | |
*** nsquare has joined #openstack-swift | 06:37 | |
*** psharma_ has joined #openstack-swift | 06:42 | |
*** psharma__ has joined #openstack-swift | 06:45 | |
*** psharma has quit IRC | 06:45 | |
*** psharma_ has quit IRC | 06:49 | |
*** psharma_ has joined #openstack-swift | 06:52 | |
*** psharma__ has quit IRC | 06:55 | |
*** ppai has quit IRC | 06:57 | |
*** ktsuyuzaki has joined #openstack-swift | 06:58 | |
*** kota_ has quit IRC | 07:00 | |
*** kota_ has joined #openstack-swift | 07:03 | |
*** judd7_ has quit IRC | 07:03 | |
*** judd7 has quit IRC | 07:03 | |
*** judd7 has joined #openstack-swift | 07:05 | |
*** judd7_ has joined #openstack-swift | 07:05 | |
*** ktsuyuzaki has quit IRC | 07:05 | |
*** judd7 has quit IRC | 07:05 | |
*** judd7_ has quit IRC | 07:05 | |
*** kopparam has quit IRC | 07:07 | |
*** kopparam has joined #openstack-swift | 07:08 | |
*** shausy has joined #openstack-swift | 07:10 | |
*** ktsuyuzaki has joined #openstack-swift | 07:12 | |
*** kopparam has quit IRC | 07:12 | |
*** ppai has joined #openstack-swift | 07:12 | |
*** judd7 has joined #openstack-swift | 07:12 | |
*** judd7_ has joined #openstack-swift | 07:12 | |
*** kota_ has quit IRC | 07:13 | |
*** kota_ has joined #openstack-swift | 07:16 | |
*** nsquare has quit IRC | 07:16 | |
*** annegent_ has joined #openstack-swift | 07:16 | |
*** ktsuyuzaki has quit IRC | 07:18 | |
*** ktsuyuzaki has joined #openstack-swift | 07:19 | |
*** ktsuyuzaki has quit IRC | 07:19 | |
*** kota_ has quit IRC | 07:20 | |
*** mmcardle has joined #openstack-swift | 07:22 | |
*** joeljwright has joined #openstack-swift | 07:22 | |
*** annegent_ has quit IRC | 07:23 | |
*** ppai has quit IRC | 07:30 | |
*** dANOKELOFF has joined #openstack-swift | 07:42 | |
*** ppai has joined #openstack-swift | 07:47 | |
*** kopparam has joined #openstack-swift | 07:47 | |
*** baojg has quit IRC | 07:48 | |
*** baojg has joined #openstack-swift | 07:49 | |
*** baojg has quit IRC | 07:49 | |
*** baojg has joined #openstack-swift | 07:49 | |
*** kopparam has quit IRC | 07:52 | |
*** judd7 has quit IRC | 07:52 | |
*** judd7_ has quit IRC | 07:52 | |
*** judd7 has joined #openstack-swift | 07:54 | |
*** judd7_ has joined #openstack-swift | 07:54 | |
*** matsuhashi has quit IRC | 07:57 | |
*** matsuhashi has joined #openstack-swift | 07:58 | |
*** baojg has quit IRC | 08:04 | |
*** kopparam has joined #openstack-swift | 08:05 | |
*** jyoti_ranjan has quit IRC | 08:05 | |
*** matsuhashi has quit IRC | 08:05 | |
*** kopparam has quit IRC | 08:08 | |
*** kopparam has joined #openstack-swift | 08:09 | |
*** matsuhashi has joined #openstack-swift | 08:10 | |
*** baojg has joined #openstack-swift | 08:14 | |
*** annegent_ has joined #openstack-swift | 08:16 | |
*** matsuhashi has quit IRC | 08:17 | |
*** matsuhashi has joined #openstack-swift | 08:18 | |
*** pconstantine_ has quit IRC | 08:20 | |
*** annegent_ has quit IRC | 08:21 | |
*** matsuhashi has quit IRC | 08:31 | |
*** Ju_ has quit IRC | 08:34 | |
dANOKELOFF | Hi, anyone can help me with this error please ? https://gist.github.com/anonymous/eb6880e973b2baf12066 | 08:40 |
*** mkollaro has joined #openstack-swift | 08:45 | |
*** nosnos has quit IRC | 08:45 | |
*** openstackgerrit has joined #openstack-swift | 08:52 | |
*** dmorita has quit IRC | 09:02 | |
*** annegent_ has joined #openstack-swift | 09:16 | |
*** annegent_ has quit IRC | 09:21 | |
*** haomaiwa_ has quit IRC | 09:22 | |
*** jyoti_ranjan has joined #openstack-swift | 09:25 | |
*** nosnos has joined #openstack-swift | 09:36 | |
*** matsuhashi has joined #openstack-swift | 09:36 | |
Kbee | dANOKELOFF, I see two things wrong.. the URl and the creds.. | 09:41 |
Kbee | dANOKELOFF, probably you should use - swift -A http://94.23.34.79:8080/v1.0/system -U root -K testpass stat .. system is account here.. | 09:42 |
dANOKELOFF | Kbee: Hum, ok | 09:43 |
dANOKELOFF | Kbee: i will try | 09:44 |
dANOKELOFF | Kbee: With this command i have the same error. | 09:44 |
Kbee | i might have typed wrong.. try with this -swift -A http://94.23.34.79:8080/v1/AUTH_system -U root -K testpass stat | 09:45 |
Kbee | 401 means creds incorrect | 09:45 |
dANOKELOFF | Same problem :( | 09:47 |
dANOKELOFF | and same error | 09:47 |
dANOKELOFF | oh wait | 09:48 |
Kbee | In your proxy-server.conf you have an extra |m| @ end of user_system_root -> user_system_root = testpass .adminm | 09:48 |
Kbee | remove that and try | 09:48 |
Kbee | adminm is altogether a new role | 09:49 |
*** judd7__ has joined #openstack-swift | 09:50 | |
*** judd7___ has joined #openstack-swift | 09:50 | |
*** dANOKELO_ has joined #openstack-swift | 09:52 | |
*** judd7_ has quit IRC | 09:53 | |
*** judd7 has quit IRC | 09:53 | |
*** dANOKELOFF has quit IRC | 09:53 | |
*** matsuhashi has quit IRC | 09:54 | |
dANOKELO_ | Kbee: Ok i try , but again 401 Unauthorized | 09:55 |
*** matsuhashi has joined #openstack-swift | 09:55 | |
dANOKELO_ | Auth GET failed @ip 401 Unauthorized | 09:55 |
Kbee | dANOKELO_, did you remove extra |m| in proxy-server.conf ? | 09:56 |
dANOKELO_ | yes | 09:56 |
Kbee | restart proxy ?? | 09:56 |
dANOKELO_ | yes | 09:56 |
Kbee | waht command did you try ? | 09:57 |
*** matsuhas_ has joined #openstack-swift | 09:57 | |
*** matsuhashi has quit IRC | 09:57 | |
dANOKELO_ | http://94.23.34.79:8080/v1/AUTH_system -U root -K | 09:58 |
dANOKELO_ | testpass stat | 09:58 |
dANOKELO_ | swift -A http://94.23.34.79:8080/v1/AUTH_system -U root -K | 09:58 |
dANOKELO_ | testpass stat | 09:58 |
dANOKELO_ | this command : swift -A http://94.23.34.79:8080/v1/AUTH_system -U root -K testpass stat | 09:59 |
dANOKELO_ | but if i try this command : | 10:01 |
dANOKELO_ | curl -v -H 'X-Storage-User: system:root' -H 'X-Storage-Pass: | 10:01 |
dANOKELO_ | testpass' http://94.23.34.79:8080/auth/v1.0 | 10:01 |
dANOKELO_ | i have a message who give me my token, but if i write the token the response is 401 Unauthorized. | 10:01 |
dANOKELO_ | I go to gist you this example too. | 10:01 |
dANOKELO_ | THIS COMMAND : | 10:03 |
dANOKELO_ | curl -v -H 'X-Storage-User: system:root' -H 'X-Storage-Pass: testpass' http://94.23.34.79:8080/auth/v1.0 | 10:03 |
dANOKELO_ | RETURN : | 10:03 |
dANOKELO_ | * Hostname was NOT found in DNS cache | 10:04 |
dANOKELO_ | * Trying 94.23.34.79... | 10:04 |
dANOKELO_ | * Connected to 94.23.34.79 (94.23.34.79) port 8080 (#0) | 10:04 |
dANOKELO_ | > GET /auth/v1.0 HTTP/1.1 | 10:04 |
dANOKELO_ | > User-Agent: curl/7.35.0 | 10:04 |
dANOKELO_ | > Host: 94.23.34.79:8080 | 10:04 |
dANOKELO_ | > Accept: */* | 10:04 |
dANOKELO_ | > X-Storage-User: system:root | 10:04 |
dANOKELO_ | > X-Storage-Pass: testpass | 10:04 |
dANOKELO_ | > | 10:04 |
dANOKELO_ | < HTTP/1.1 200 OK | 10:04 |
dANOKELO_ | < X-Storage-Url: http://94.23.34.79:8080/v1/AUTH_system | 10:04 |
dANOKELO_ | < X-Auth-Token: AUTH_tkbef158f2830747a7a482f803decacfbc | 10:04 |
dANOKELO_ | < Content-Type: text/html; charset=UTF-8 | 10:04 |
dANOKELO_ | < X-Storage-Token: AUTH_tkbef158f2830747a7a482f803decacfbc | 10:04 |
dANOKELO_ | < Content-Length: 0 | 10:04 |
dANOKELO_ | < X-Trans-Id: tx6a640152b58b43feb0c4b-0053aa9dc1 | 10:04 |
dANOKELO_ | < Date: Wed, 25 Jun 2014 10:00:33 GMT | 10:04 |
dANOKELO_ | < | 10:04 |
dANOKELO_ | * Connection #0 to host 94.23.34.79 left intact | 10:04 |
dANOKELO_ | THIS COMMAND : | 10:04 |
dANOKELO_ | curl -v -H ‘X-Auth-Token: AUTH_tkbef158f2830747a7a482f803decacfbc’ http://94.23.34.79:8080/v1/AUTH_system | 10:04 |
dANOKELO_ | RETURN : | 10:04 |
dANOKELO_ | * Hostname was NOT found in DNS cache | 10:04 |
dANOKELO_ | * Trying 94.23.34.79... | 10:04 |
dANOKELO_ | * Connected to 94.23.34.79 (94.23.34.79) port 8080 (#0) | 10:04 |
dANOKELO_ | > GET /v1/AUTH_system HTTP/1.1 | 10:04 |
dANOKELO_ | > User-Agent: curl/7.35.0 | 10:04 |
dANOKELO_ | > Host: 94.23.34.79:8080 | 10:04 |
dANOKELO_ | > Accept: */* | 10:04 |
dANOKELO_ | > X-Auth-Token: AUTH_tk0966b8c1c29340fba36e8b90dcfb3a94 | 10:05 |
dANOKELO_ | > | 10:05 |
dANOKELO_ | < HTTP/1.1 401 Unauthorized | 10:05 |
dANOKELO_ | < Content-Length: 131 | 10:05 |
dANOKELO_ | < Content-Type: text/html; charset=UTF-8 | 10:05 |
dANOKELO_ | < Www-Authenticate: Swift realm="AUTH_system" | 10:05 |
dANOKELO_ | < X-Trans-Id: txf7d41f871b724c59ab313-0053aa9e71 | 10:05 |
dANOKELO_ | < Date: Wed, 25 Jun 2014 10:03:29 GMT | 10:05 |
dANOKELO_ | < | 10:05 |
dANOKELO_ | * Connection #0 to host 94.23.34.79 left intact | 10:05 |
dANOKELO_ | <html><h1>Unauthorized</h1><p>This server could not verify that you are authorized to access the document you requested.</p></html> | 10:05 |
dANOKELO_ | my god sorry ! | 10:05 |
hugokuo | dANOKELO_: please paste in somewhere else next time. e.g. pastebin Thanks | 10:06 |
dANOKELO_ | THis gist https://gist.github.com/anonymous/a07ae42317eb7350cf8a | 10:06 |
dANOKELO_ | hugokuo: yeah i paste in my gist, but i wrong paste , i dont paste the url sorry | 10:07 |
*** mkerrin has quit IRC | 10:12 | |
*** jyoti_ranjan has quit IRC | 10:13 | |
*** annegent_ has joined #openstack-swift | 10:16 | |
*** jasond has quit IRC | 10:16 | |
*** IRTermite has quit IRC | 10:20 | |
*** annegent_ has quit IRC | 10:21 | |
*** joeljwright has quit IRC | 10:22 | |
*** jyoti_ranjan has joined #openstack-swift | 10:24 | |
*** matsuhas_ has quit IRC | 10:28 | |
*** matsuhashi has joined #openstack-swift | 10:28 | |
mattoliverau | dANOKELO_: you haven't specified the method in the 2nd command, ie -X GET | 10:29 |
dANOKELO_ | mattoliverau: sorry ? the command who i get the token ? | 10:30 |
mattoliverau | No the one afterwards, where you used the token | 10:36 |
mattoliverau | The 2nd one | 10:36 |
mattoliverau | The first command was successful :) | 10:37 |
dANOKELO_ | yeah, i try but again error 401 | 10:37 |
*** matsuhashi has quit IRC | 10:37 | |
*** matsuhashi has joined #openstack-swift | 10:37 | |
mattoliverau | Sorry chatting from my phone so a bit slow :) | 10:37 |
dANOKELO_ | no problem , thank's for your help : when i run the 2nd one : the error message is " This server could not verify that you are authorized to access the document you requested" | 10:38 |
*** IRTermite has joined #openstack-swift | 10:42 | |
dANOKELO_ | i put the gist of my swift error here, if anyone can help and solve my problem :) , thank's : https://gist.github.com/fclement21/13aadbf13ee45ad5854c | 10:52 |
*** Kbee has quit IRC | 10:52 | |
mattoliverau | Yeah, it's like the token is incorrect or it can't find the account | 10:53 |
*** tdasilva has joined #openstack-swift | 10:54 | |
dANOKELO_ | yeah, but i dont understand why, because the server give me the token. | 10:55 |
*** ppai has quit IRC | 11:02 | |
acoles | dANOKELO_: i'm making a guess here, based on trying to reproduce your error...have you setup memcached default interface to match what you have in you proxy-server.conf, as described in the multi node install doc, step 3 & 4? | 11:04 |
*** tdasilva_ has joined #openstack-swift | 11:05 | |
*** tdasilva has quit IRC | 11:06 | |
acoles | dANOKELO_: 'Configure the Proxy node' section http://docs.openstack.org/developer/swift/howto_installmultinode.html | 11:07 |
dANOKELO_ | acoles: I update my gist with my memcached.conf and my proxy-server.conf : https://gist.github.com/fclement21/13aadbf13ee45ad5854c, i go eat , i continu when i back | 11:07 |
*** foexle has joined #openstack-swift | 11:08 | |
*** baojg has quit IRC | 11:10 | |
*** baojg has joined #openstack-swift | 11:11 | |
*** baojg has quit IRC | 11:11 | |
*** baojg has joined #openstack-swift | 11:12 | |
mattoliverau | So it looks like your specifying the memcache server in the cache section of the proxy conf. | 11:13 |
mattoliverau | *your not | 11:13 |
mattoliverau | Well according to acoles link | 11:14 |
*** baojg has quit IRC | 11:16 | |
*** annegent_ has joined #openstack-swift | 11:16 | |
*** ppai has joined #openstack-swift | 11:17 | |
*** dANOKELO_ has quit IRC | 11:18 | |
acoles | dANOKELO_: the proxy server conf in that last gist is different to the one you posted a while back https://gist.github.com/anonymous/eb6880e973b2baf12066 | 11:19 |
*** nshaikh has joined #openstack-swift | 11:20 | |
acoles | dANOKELO_: and as mattoliverau spotted, you don't have the memcache_servers line in the most recent one | 11:20 |
*** annegent_ has quit IRC | 11:21 | |
mattoliverau | Anyway I'm going to call it a night, it's almost bed time and I need to spend some time with the wife, before she decides to devorse or worse kill me :p night all | 11:26 |
acoles | mattoliverau: yeah, i thought it was late for you :) | 11:27 |
*** kopparam has quit IRC | 11:30 | |
*** kopparam has joined #openstack-swift | 11:30 | |
mattoliverau | Perils of working from home and having phone connected to irc :p | 11:30 |
*** kopparam has quit IRC | 11:35 | |
*** mmcardle has quit IRC | 11:36 | |
*** Anticimex has joined #openstack-swift | 11:36 | |
*** jyoti_ranjan is now known as jyoti-ranjan | 11:48 | |
*** cm2 has joined #openstack-swift | 11:49 | |
*** dmsimard_away is now known as dmsimard | 11:49 | |
*** jyoti-ranjan has left #openstack-swift | 11:51 | |
*** jyoti-ranjan has joined #openstack-swift | 11:51 | |
*** tdasilva_ has quit IRC | 11:57 | |
*** tdasilva has joined #openstack-swift | 12:08 | |
*** mmcardle has joined #openstack-swift | 12:13 | |
*** annegent_ has joined #openstack-swift | 12:16 | |
*** kopparam has joined #openstack-swift | 12:19 | |
*** annegent_ has quit IRC | 12:21 | |
*** ajc_ has quit IRC | 12:23 | |
*** shausy has quit IRC | 12:24 | |
*** shausy has joined #openstack-swift | 12:25 | |
*** shausy has quit IRC | 12:25 | |
*** shausy has joined #openstack-swift | 12:34 | |
openstackgerrit | Mark Seger proposed a change to openstack/python-swiftclient: Add context sensitive help https://review.openstack.org/102510 | 12:36 |
*** kopparam has quit IRC | 12:38 | |
*** ppai has quit IRC | 12:40 | |
*** dANOKELOFF has joined #openstack-swift | 12:42 | |
*** annegent_ has joined #openstack-swift | 12:45 | |
dANOKELOFF | mattoliverau and acoles I update my gist : https://gist.github.com/fclement21/13aadbf13ee45ad5854c | 12:53 |
*** annegent_ has quit IRC | 12:54 | |
acoles | dANOKELOFF: and you restarted memcached and swift proxy servers? | 12:56 |
dANOKELOFF | acoles: I restarted but now I have 503 error | 12:57 |
dANOKELOFF | with the 2nd command | 12:57 |
*** joeljwright has joined #openstack-swift | 12:58 | |
*** matsuhashi has quit IRC | 12:59 | |
*** matsuhashi has joined #openstack-swift | 12:59 | |
acoles | dANOKELOFF: oh man :( can you gist tail of /var/log/swift/proxy.error | 13:00 |
dANOKELOFF | acoles: sure. | 13:00 |
dANOKELOFF | I havent got the proxy.error file | 13:01 |
*** lpabon has joined #openstack-swift | 13:03 | |
*** matsuhashi has quit IRC | 13:04 | |
acoles | anything relevant in var/log/syslog? | 13:06 |
dANOKELOFF | acoles: yes, i have so much lines | 13:06 |
acoles | any near tail with 'proxy-server' in line | 13:08 |
acoles | ? | 13:08 |
*** joeljwright1 has joined #openstack-swift | 13:09 | |
dANOKELOFF | yes ; this : Jun 25 15:04:41 ns368471 proxy-server: 94.23.34.79 94.23.34.79 25/Jun/2014/13/04/41 GET /v1/AUTH_system HTTP/1.0 503 - curl/7.35.0 AUTH_tk447816efc3fa49f78f37ca2f8ce6cd26 - 118 - tx6033472498864a5994183-0053aac8e9 - 0.0016 - - 1403701481.163990021 1403701481.165617943 | 13:10 |
*** matsuhashi has joined #openstack-swift | 13:10 | |
dANOKELOFF | acoles: ok , i update the gist 2sec please | 13:11 |
*** joeljwright has quit IRC | 13:11 | |
dANOKELOFF | https://gist.github.com/fclement21/13aadbf13ee45ad5854c | 13:11 |
*** zz_wasmum is now known as wasmum | 13:19 | |
*** mkerrin has joined #openstack-swift | 13:20 | |
*** tdasilva has quit IRC | 13:24 | |
*** annegent_ has joined #openstack-swift | 13:26 | |
dANOKELOFF | It's ok ! | 13:27 |
dANOKELOFF | I havent error | 13:27 |
dANOKELOFF | acoles: Thank's for your help ! | 13:27 |
acoles | dANOKELOFF: oh? so what did you fix? | 13:27 |
dANOKELOFF | I modify my container , my object and my account, and i had mount_check = false | 13:28 |
dANOKELOFF | I follow this issue : https://answers.launchpad.net/swift/+question/161796 | 13:28 |
*** miqui has joined #openstack-swift | 13:29 | |
acoles | dANOKELOFF: cool, i was just heading down the mount_check path after seeing that 507 in your logs | 13:30 |
dANOKELOFF | acoles: thanks a lot for your help ! | 13:30 |
*** mmcardle has quit IRC | 13:31 | |
*** baojg has joined #openstack-swift | 13:31 | |
acoles | dANOKELOFF: so, FWIW, the memcached config is important because tempauth caches tokens it has issued, which *may* explain why your tokens were failing, IF tempauth was failing to cache them. | 13:31 |
acoles | dANOKELOFF: glad you're fixed though :) | 13:32 |
*** mmcardle has joined #openstack-swift | 13:32 | |
dANOKELOFF | sure , thanks :) | 13:32 |
*** matsuhashi has quit IRC | 13:33 | |
acoles | dANOKELOFF: also, http://docs.openstack.org/developer/swift/development_saio.html#optional-setting-up-rsyslog-for-individual-logging may be useful | 13:33 |
*** matsuhashi has joined #openstack-swift | 13:33 | |
dANOKELOFF | ok | 13:34 |
*** matsuhashi has quit IRC | 13:38 | |
*** AbyssOne is now known as JelleB | 13:39 | |
dmsimard | Using keystone auth with Swift - If I create a new user, a new tenant with that user in it, it works well with that user. If I create a second user and add it to the same tenant, that second user gets 403 on API calls. The logs don't seem to tell me why ? | 13:41 |
dmsimard | Both users have the _member_ role | 13:43 |
*** psharma_ has quit IRC | 13:43 | |
*** nosnos has quit IRC | 13:43 | |
chmouel | dmsimard: this should work, you have nothing in the logs? | 13:43 |
dmsimard | chmouel: I see the 403 in the swift logs, it looks like it might be keystone and not swift related.. | 13:44 |
*** nshaikh has quit IRC | 13:44 | |
*** matsuhashi has joined #openstack-swift | 13:44 | |
*** matsuhashi has quit IRC | 13:44 | |
chmouel | dmsimard: it should give you detialled logs by default if you are running with DEBUG | 13:44 |
chmouel | i.e: tenant mismatch or such | 13:44 |
chmouel | or if it's keystone | 13:44 |
dmsimard | Yeah I'll turn up the verbosity see what happens | 13:45 |
*** matsuhashi has joined #openstack-swift | 13:45 | |
*** matsuhashi has quit IRC | 13:49 | |
*** lpabon has quit IRC | 13:50 | |
*** nshaikh has joined #openstack-swift | 13:52 | |
*** kopparam has joined #openstack-swift | 13:53 | |
dmsimard | Nothing special with debug verbosity - I get an additional line with the user/tenant/role info and then the same 403 error - I'll check keystone :/ | 13:55 |
*** kopparam has quit IRC | 13:57 | |
*** kopparam has joined #openstack-swift | 13:57 | |
openstackgerrit | Mark Seger proposed a change to openstack/python-swiftclient: Add context sensitive help https://review.openstack.org/102510 | 13:59 |
*** CaioBrentano has joined #openstack-swift | 13:59 | |
dmsimard | Nothing special in keystone either. This is weird. | 14:02 |
chmouel | humm weird yeah | 14:05 |
*** jyoti-ranjan has quit IRC | 14:06 | |
openstackgerrit | Christian Schwede proposed a change to openstack/swift: Fix swift-recon --auditor bug https://review.openstack.org/100192 | 14:08 |
openstackgerrit | Christian Schwede proposed a change to openstack/swift: Add test for swift-recon --auditor https://review.openstack.org/100058 | 14:08 |
*** mmcardle has quit IRC | 14:09 | |
dmsimard | chmouel: Any idea who would return the 403 for this particular error ? "ClientException: Account GET failed: https://api.tld/v1/AUTH_e8217e83ef32427bb4e4d217f1390ab4?format=json 403 Forbidden [first 60 chars of response] <html><h1>Forbidden</h1><p>Access was denied to this resourc" | 14:10 |
dmsimard | I don't think it's necessarily keystone since the authentication is successful and I get a token (and I can do other stuff like nova calls) | 14:10 |
dmsimard | It's not the load balancers since otherwise the problem would extend to any/all users | 14:11 |
joeljwright1 | dmsimard: does the user have the appropriate role? | 14:11 |
dmsimard | That really leaves the swift proxy itself ? | 14:11 |
chmouel | dmsimard: yeah the only thing i see is because the role is not set to that user | 14:11 |
joeljwright1 | I've seen these accessing swift with new users when the user didn't have the appropriate role to access swift | 14:11 |
dmsimard | joeljwright1: There's two users in a tenant, both with only the _member_ role. One works, the other get 403's | 14:11 |
chmouel | the swift_operator | 14:11 |
dmsimard | If I *have* to set swift_operator, I'll do it | 14:12 |
dmsimard | but that doesn't explain why the first user works | 14:12 |
dmsimard | without that role | 14:12 |
chmouel | yeah i am not sure | 14:12 |
chmouel | it should work if __member_ is in swift_operator | 14:13 |
chmouel | which i think is the default but i am not sure these days | 14:13 |
dmsimard | swift_operator grants admin privileges for the tenant the user is in, correct ? | 14:14 |
dmsimard | no more, no less ? | 14:14 |
dmsimard | As in, if it's configured as such in the swift proxy keystone middleware parameters | 14:14 |
*** mwstorer has joined #openstack-swift | 14:14 | |
acoles | clayg: gholt: notmyname: i updated fast-post wiki with a section discussing container sync https://wiki.openstack.org/wiki/Swift/FastPost | 14:14 |
acoles | it ain't pretty, no surprise | 14:15 |
*** mmcardle has joined #openstack-swift | 14:16 | |
*** mjseger has quit IRC | 14:16 | |
dmsimard | chmouel: So I should add _member_ to the list of operator_roles - then ? | 14:17 |
chmouel | dmsimard: if the first one works, i don't think you should | 14:18 |
chmouel | it's maybe a configuration issue in keystone with the second | 14:18 |
chmouel | try to auth with both users with curl | 14:18 |
chmouel | and see the output of both if there is things is missing | 14:18 |
*** grapsus_ has quit IRC | 14:19 | |
*** sileht has quit IRC | 14:20 | |
*** grapsus_ has joined #openstack-swift | 14:21 | |
*** annegent_ has quit IRC | 14:21 | |
*** annegent_ has joined #openstack-swift | 14:21 | |
*** sileht has joined #openstack-swift | 14:23 | |
*** kenhui has joined #openstack-swift | 14:24 | |
*** jasond has joined #openstack-swift | 14:27 | |
*** pberis has joined #openstack-swift | 14:35 | |
openstackgerrit | Mark Seger proposed a change to openstack/python-swiftclient: Add context sensitive help https://review.openstack.org/102510 | 14:36 |
*** zhiyan is now known as zhiyan_ | 14:43 | |
*** kopparam_ has joined #openstack-swift | 14:45 | |
*** eglynn has joined #openstack-swift | 14:47 | |
*** mmcardle has quit IRC | 14:47 | |
*** kopparam has quit IRC | 14:48 | |
dmsimard | Looking at the differences, aside from timestamps or tenant/user/token credentials, there isn't anything different.. One does a call to "/v1/AUTH_e8217e83ef32427bb4e4d217f1390ab4?format=json" and gets a 200, the other a 403. This is driving me nuts. | 14:49 |
dmsimard | Adding the 403 user to swift_operator or adding _member_ to operator_roles solves the issue | 14:49 |
eglynn | dumb question about swift eventual versus strong consistency? | 14:50 |
eglynn | say datapoints {p1, p2, ..., p_i} are stored in a swift object | 14:50 |
eglynn | (presumably replicated in an eventually consistent way) | 14:50 |
eglynn | say I want to read this blob and update with a further datapoint {p_(i+1)} | 14:51 |
dmsimard | I do have a stacktrace for the 403, though. Looked at the code but it's just reacting to the 403: http://paste.openstack.org/show/84885/ | 14:51 |
*** CaioBrentano has quit IRC | 14:51 | |
eglynn | but evential consistency tells me that I may end up folding my new datapoint into the an older version of the object {p1, p2, ..., p_(i-1)} instead of {p1, p2, ..., p_i} | 14:51 |
eglynn | so the $64k question ... | 14:51 |
*** mmcardle has joined #openstack-swift | 14:51 | |
eglynn | is read-then-update an acknowledged *anti*-pattern for swift? | 14:52 |
wasmum | anyone have some keystone swift3 time? | 14:53 |
jasond | i'm using bin/swift-temp-url to generate a temp URL, but when I try to access it, I get "401 Unauthorized: Temp URL invalid". can someone help me troubleshoot what's wrong? | 14:54 |
*** kevinc_ has joined #openstack-swift | 14:57 | |
openstackgerrit | Donagh McCabe proposed a change to openstack/swift: Add swift-checker utility for use by monitoring tools https://review.openstack.org/99961 | 14:59 |
*** swat30 has quit IRC | 15:03 | |
*** jokke_ has quit IRC | 15:03 | |
*** zaitcev has joined #openstack-swift | 15:04 | |
*** ChanServ sets mode: +v zaitcev | 15:04 | |
*** kopparam_ has quit IRC | 15:08 | |
*** judd7__ has quit IRC | 15:08 | |
*** kopparam has joined #openstack-swift | 15:09 | |
*** swat30 has joined #openstack-swift | 15:10 | |
dmsimard | oh chmouel | 15:11 |
dmsimard | It's right there, on your blog | 15:11 |
*** jokke_ has joined #openstack-swift | 15:11 | |
dmsimard | http://blog.chmouel.com/2011/11/24/swift-and-keystone-middleware-part1/ "So let’s say we have a user called demo2 which is part of the demo account and have only the role Member to it and not SwiftOperator by default as we say before he will not be able to do much." | 15:11 |
dmsimard | :D | 15:12 |
clayg | acoles: don't we have a spec repo for this sort of stuff now? | 15:12 |
*** kopparam has quit IRC | 15:13 | |
*** lpabon has joined #openstack-swift | 15:16 | |
*** wasmum is now known as zz_wasmum | 15:19 | |
*** kevinc_ has quit IRC | 15:20 | |
notmyname | good morning world | 15:24 |
*** kevinc_ has joined #openstack-swift | 15:24 | |
*** zz_wasmum is now known as wasmum | 15:25 | |
dmsimard | notmyname: o/ | 15:28 |
*** gyee has joined #openstack-swift | 15:31 | |
*** byeager has joined #openstack-swift | 15:34 | |
*** annegent_ has quit IRC | 15:40 | |
notmyname | clayg: almost on the -specs repo | 15:40 |
notmyname | creiht: acoles: portante: how's getting 2.0 into the lab and testing it going? | 15:41 |
creiht | notmyname: it is in progress, but I'm also on vacation for the rest of the week :) | 15:42 |
notmyname | creiht: no vacation, just testing! | 15:42 |
notmyname | ;-) | 15:42 |
notmyname | creiht: I hear it's raining a lot in TX (Karen was in DFW this weekend). did it make it down to SA? | 15:42 |
creiht | yeah | 15:42 |
creiht | it is also raining a lot at the beach, but that is ok with me :) | 15:43 |
notmyname | doh | 15:43 |
*** annegent_ has joined #openstack-swift | 15:43 | |
*** annegent_ has quit IRC | 15:43 | |
notmyname | our "rain" never gets to the ground https://twitter.com/CarMarConroy/status/481820593163993089 (this morning in the middle part of SF) | 15:44 |
notmyname | oh. middle-west part. (west portal, not western addition which is in the north central part--of course) | 15:45 |
notmyname | creiht: enjoy your vacation (why are you on IRC?). one last work question, please, before you go: based on what you know when you left, does it look like the testing of 2.0 will be done at rax by next wednesday? | 15:46 |
creiht | lol | 15:47 |
creiht | not sure | 15:47 |
creiht | notmyname: and because it is raining outside :) | 15:48 |
notmyname | heh | 15:48 |
creiht | notmyname: but it is in process | 15:49 |
notmyname | good | 15:50 |
creiht | if we don't get distracted by other thing, it might be a possibility | 15:50 |
notmyname | great | 15:50 |
creiht | but you know how things go :) | 15:50 |
notmyname | right | 15:50 |
notmyname | in this case, though, because it is a big release, there are some non-dev people getting involved. so I'm trying to do some date coordination | 15:50 |
creiht | hah | 15:51 |
notmyname | ie the foundation and I hope some of the companies here, including RAX, will do some marketing press releases about it | 15:51 |
*** shausy has quit IRC | 15:53 | |
*** wasmum is now known as zz_wasmum | 15:53 | |
*** shausy has joined #openstack-swift | 15:54 | |
cschwede | notmyname: i might write a blogpost about SP and publish it on our blog | 15:54 |
*** zz_wasmum is now known as wasmum | 15:55 | |
notmyname | cschwede: great. I hope you do :-) | 15:55 |
notmyname | I'll be doing the same | 15:55 |
cschwede | notmyname: great :) | 15:55 |
creiht | notmyname: I was thinking we could get glange to do a comic about it ;) | 15:55 |
notmyname | perfect :-) | 15:55 |
*** wasmum is now known as zz_wasmum | 15:56 | |
glange | swift isn't funny | 15:56 |
creiht | glange: neither are your comics :) | 15:56 |
cschwede | notmyname: i’m thinking about doing something like a „how do i use SP“ post, more from a technical/user/ops site | 15:56 |
glange | boo! | 15:56 |
glange | my comics are hillarious | 15:56 |
glange | they hit those 2 or 3 people that understand them really hard :) | 15:57 |
creiht | yes you have a very targeted audience :) | 15:57 |
notmyname | cschwede: yes, that would be good. let's try to coordinate (ie talk over email as we write it) so we don't have too much overlap | 15:58 |
cschwede | notmyname: good idea, i was thinking the same | 15:59 |
*** joeljwright1 has quit IRC | 15:59 | |
*** dANOKELOFF has quit IRC | 15:59 | |
*** CaioBrentano has joined #openstack-swift | 16:01 | |
openstackgerrit | Eamonn O'Toole proposed a change to openstack/swift: Parallel object auditor https://review.openstack.org/59778 | 16:06 |
*** joeljwright has joined #openstack-swift | 16:07 | |
*** nshaikh has quit IRC | 16:08 | |
*** GeorgesLeYeti has joined #openstack-swift | 16:27 | |
* notmyname is out for post-op visit. I get my bandage off today!!!!! | 16:27 | |
GeorgesLeYeti | Hello there | 16:27 |
*** joeljwright1 has joined #openstack-swift | 16:31 | |
*** joeljwright has quit IRC | 16:34 | |
acoles | notmyname: in progress | 16:36 |
acoles | clayg: we do, i'll move it there | 16:36 |
*** orzel has joined #openstack-swift | 16:36 | |
*** shausy has quit IRC | 16:37 | |
orzel | Hello. there's no admin interface in horizon for swift, right ? As a user i can see my containers, but the admin can't see anything, or can it ? | 16:37 |
*** byeager has quit IRC | 16:38 | |
clayg | +1 glange's comics are funny (most of the time) | 16:39 |
goodes | clayg: is sent a PR with the two changes for vsaio | 16:40 |
*** joeljwright has joined #openstack-swift | 16:40 | |
clayg | vsaio i like it | 16:40 |
clayg | goodes: do i have to run it/look at it - or can i just merge it? | 16:41 |
goodes | clayg: 8 lines of change - visual review then merge | 16:42 |
*** joeljwright1 has quit IRC | 16:44 | |
orzel | what's 'PR' for ? I guess r is 'review' .. ? | 16:49 |
*** joeljwright1 has joined #openstack-swift | 16:50 | |
goodes | PR is a github Pull Request | 16:50 |
*** joeljwright has quit IRC | 16:52 | |
*** joeljwright has joined #openstack-swift | 16:56 | |
*** joeljwright1 has quit IRC | 16:58 | |
*** joeljwright2 has joined #openstack-swift | 16:58 | |
*** joeljwright has quit IRC | 17:02 | |
*** joeljwright2 has quit IRC | 17:02 | |
clayg | orzel: probably almost no one in here knows anything about horizon - do they have like an #openstack-horizon or something maybe? | 17:05 |
*** eglynn has quit IRC | 17:07 | |
*** zz_wasmum is now known as wasmum | 17:12 | |
*** GeorgesLeYeti has quit IRC | 17:15 | |
*** mkollaro has quit IRC | 17:19 | |
*** jamiehannaford has joined #openstack-swift | 17:20 | |
openstackgerrit | A change was merged to openstack/swift: Don't count 412 or 416 as errors in stats https://review.openstack.org/98530 | 17:21 |
orzel | clayg: this chan exists, yes. You're kinda saying that the "swift" community doesn't really care about the web gui, right ? | 17:23 |
*** mkollaro has joined #openstack-swift | 17:25 | |
*** baojg has quit IRC | 17:26 | |
creiht | orzel: The swift community cares very much about the user interfaces to swift, of which many are available, and horizon is just one | 17:26 |
creiht | we can't be experts in all of them | 17:26 |
creiht | :) | 17:26 |
creiht | that's why you will likely get a much better answer from the horizon folks | 17:27 |
orzel | my question is quite high level (anything there?). i would not qualify it as 'expert' ! | 17:30 |
orzel | but ok, i'll see with them | 17:30 |
creiht | hah | 17:30 |
creiht | last I saw that wasn't there, but I don't know if they have been working on that top of stuff lately | 17:30 |
creiht | s/top/type | 17:31 |
orzel | let's see | 17:32 |
*** shri has joined #openstack-swift | 17:32 | |
orzel | completely unrelated, but i'm trying to switch from fs to swift as glance backend | 17:32 |
*** nsquare has joined #openstack-swift | 17:34 | |
*** jasond` has joined #openstack-swift | 17:35 | |
*** mmcardle has quit IRC | 17:35 | |
orzel | creiht: speaking of user interface. from cli, 'glance stat' is very useful, but is it possible to get the same info for every user as an admin ? | 17:40 |
orzel | i can't find anything in various docs | 17:40 |
orzel | swift stat, sorry :) | 17:40 |
creiht | orzel: not really, since there isn't anything built into swift that keeps track of all accounts | 17:41 |
*** jamiehannaford has quit IRC | 17:41 | |
creiht | that's usually left up to the auth system | 17:41 |
clayg | creiht: os.walk() on the account nodes ;) | 17:41 |
*** jamiehannaford has joined #openstack-swift | 17:41 | |
creiht | there are tools that can collect the info for billing purposes | 17:42 |
creiht | clayg: lol | 17:42 |
*** eglynn has joined #openstack-swift | 17:46 | |
jasond` | does anybody know why i might be getting "401 Unauthorized: Temp URL invalid" when i generate a tempurl with bin/swift-temp-url? are there special permissions needed to use tempurls? | 17:47 |
*** kopparam has joined #openstack-swift | 17:47 | |
orzel | creiht: so, basically, i need ceilometer | 17:47 |
torgomatic | jasond`: probably you're calling it wrong? If you see "Temp URL invalid" in the response, you know that the tempurl middleware is installed | 17:48 |
torgomatic | have you set up a key and all that? | 17:48 |
creiht | orzel: that's one option I guess | 17:49 |
jasond` | torgomatic: i'm calling it with: curl 'http://localhost:8080/v1/AUTH_demo/a/b?temp_url_sig=7396ed6d6b6e5a5cb8b020c4494cf2a6a9f1e325&temp_url_expires=1403713581' | 17:49 |
*** wasmum is now known as zz_wasmum | 17:49 | |
torgomatic | jasond`: your expires is in the past | 17:50 |
jasond` | there is a key. i'm not sure it's being accepted as valid | 17:50 |
jasond` | torgomatic: that was from a little bit ago | 17:50 |
torgomatic | jasond`: if X-Account-Meta-Temp-Url-Key is set on the account, it's valid | 17:51 |
torgomatic | it's just an opaque string to tempurl; there's no restrictions other than length > 0 | 17:51 |
jasond` | torgomatic: just regenerated one: curl 'http://localhost:8080/v1/AUTH_demo/a/b?temp_url_sig=51b16c4f35f1a781f4d0b9039f23145072e69455&temp_url_expires=1403719664' | 17:51 |
*** jyoti-ranjan has joined #openstack-swift | 17:52 | |
jasond` | torgomatic: good to know | 17:52 |
torgomatic | jasond`: can you share how you're calling bin/swift-temp-url? maybe something's wonky there | 17:53 |
notmyname | /back | 17:53 |
jasond` | torgomatic: /opt/stack/swift/bin/swift-temp-url GET 1000 /v1/AUTH_demo/a/b 72930a7927a4fa7f8cab54e59f4aa1b3 | 17:53 |
*** kopparam has quit IRC | 17:54 | |
torgomatic | jasond`: well, I can generate that same URL when I get the expires timing right... can you run 'swift stat' (or otherwise HEAD the account) and link to a paste of the result please? | 17:55 |
openstackgerrit | Alistair Coles proposed a change to openstack/swift-specs: Updating containers on object fast-POST https://review.openstack.org/102592 | 17:56 |
torgomatic | swift-specs? who in the what now? | 17:57 |
acoles | clayg: ^^ | 17:57 |
acoles | torgomatic: clayg shoved me there :) | 17:58 |
clayg | what now? | 17:59 |
notmyname | did mordred get the boilerplate proposed there? | 17:59 |
acoles | notmyname: yes, its there | 18:00 |
jasond` | torgomatic: here's the output http://paste.openstack.org/show/84905/ | 18:00 |
notmyname | ah cool | 18:00 |
glange | clayg: thanks :) | 18:01 |
acoles | notmyname: wasn't sure if i was supposed to create specs/juno - projects vary | 18:01 |
notmyname | acoles: I'm not sure if any of us know yet ;-) | 18:01 |
notmyname | ostly it's up to us to decide what to do | 18:01 |
torgomatic | jasond`: your account doesn't match; the paste says AUGH_6e8blahblahblah, but your temp url has AUTH_demo in it | 18:02 |
torgomatic | use the one from the paste | 18:02 |
* creiht sneaks back into vacation mode | 18:02 | |
clayg | are my timezones off or is there a meeting nowish? | 18:02 |
notmyname | clayg: in an hour | 18:02 |
*** jokke__ has joined #openstack-swift | 18:02 | |
jasond` | torgomatic: that may have done it. i don't see the error message. thank you! | 18:03 |
torgomatic | jasond`: np | 18:03 |
acoles | notmyname: yeah, so i was lazy and stuck it in specs to avoid a 'no toc entry' warning...so i can go home :) | 18:03 |
notmyname | acoles: :-) | 18:04 |
*** jokke__ has quit IRC | 18:05 | |
mordred | notmyname: yah - a working structure is there- please edit/change to suit what you want to do | 18:05 |
notmyname | mordred: thanks. | 18:05 |
mordred | notmyname: also, I do not believe I can do anything sane to mark the other patches as landed - at least not without way more testing than I think we have time for - so I recommend just marking them as abandoned as per the original plan | 18:06 |
notmyname | mordred: ok. I did that yesterday afternoon | 18:07 |
mordred | notmyname: I'll spend some time poking at options for the next time we do this - and maybe at some point we'll actually have a non-painful process | 18:07 |
mordred | notmyname: great | 18:07 |
notmyname | mordred: great. we're using a feature branch again for the (real) EC work. while I think we can avoid the force push this time (probably), it's still good to know how to do it sanely | 18:07 |
clayg | does anyone else have a strong preference in tests of resp = req.get_response(app) over resp = controller.METHOD(req)? | 18:09 |
*** jokke_ has quit IRC | 18:09 | |
clayg | I always think the second one feels like cheating, but most of the time it just doesn't matter if you call PUT with a GET req or if you're controllers .container_name property doesn't match what should have got parsed out of the req's PATH_INFO | 18:09 |
notmyname | clayg: doesn't the first still work with responses-as-exceptions where the second doesn't? | 18:10 |
notmyname | torgomatic: ^ | 18:10 |
clayg | notmyname: ANOTHER GOOD POINT! | 18:10 |
notmyname | speaking of swift team meeting, do we need to meet this week? nothing's on the agenda https://wiki.openstack.org/wiki/Meetings/Swift | 18:11 |
*** jokke_ has joined #openstack-swift | 18:11 | |
clayg | so If I submit a bug fix, s'ok to "clean up" some tests while I'm writing new ones? Cause otherwise I sorta have to pop a whole new testcase with a different setup (as opposed to just fixing the existing test case's setup - it's like 10 existing tests in test/unit/proxy/controllers/test_obj) | 18:12 |
torgomatic | clayg: what notmyname said; there's stuff in __call__ you want | 18:13 |
clayg | sweet that's at least two folks that would find the clean up favorable - i'll throw it up and see if it sticks | 18:13 |
clayg | at least two *other* - i already greatly prefer the first form, just wasn't sure if I could really tease out why it was objectively better | 18:14 |
notmyname | ya, I'd actually lean towards calling controller.METHOD wrong (instead of less preferable) | 18:15 |
notmyname | portante: peluse_: clayg: torgomatic: acoles: cschwede: others? any compelling need to have a meeting today? anything to bring up? | 18:15 |
torgomatic | notmyname: all I've got is stuff that'll be in Gerrit shortly | 18:17 |
*** jasond` has left #openstack-swift | 18:22 | |
openstackgerrit | gholt proposed a change to openstack/swift: SimpleClient http proxying https://review.openstack.org/102598 | 18:26 |
cschwede | notmyname: the only thing from my side would be the mid-sprint next week in Paris - anyone interested? https://wiki.openstack.org/wiki/Sprints/ParisJuno2014#Swift | 18:27 |
cschwede | notmyname: but no need to have a meeting for that ;) | 18:29 |
notmyname | cschwede: ok, thanks | 18:29 |
*** zz_wasmum is now known as wasmum | 18:29 | |
*** pberis has quit IRC | 18:29 | |
torgomatic | notmyname: maybe just have the "open discussion" section of the meeting? that should take all of 5 minutes if nobody's got anything to say | 18:30 |
torgomatic | or not; up to you | 18:31 |
notmyname | cschwede: https://twitter.com/notmyname/status/481867194125385730 | 18:31 |
cschwede | notmyname: great :D | 18:32 |
*** kenhui has quit IRC | 18:33 | |
*** gvernik has joined #openstack-swift | 18:37 | |
*** tsg has joined #openstack-swift | 18:45 | |
notmyname | torgomatic: ya, that's a good idea | 18:45 |
notmyname | meeting today will be "open discussion" and may or may not take exactly 5 minutes | 18:46 |
*** wasmum is now known as zz_wasmum | 18:49 | |
*** kopparam has joined #openstack-swift | 18:51 | |
*** kopparam has quit IRC | 18:56 | |
anticw | trivia question for today: if you have 3 replicas you have how many hand-off locations? | 18:58 |
anticw | what if you have 2 ... or 1 ? | 18:58 |
anticw | swift-get-nodes ... | 18:58 |
torgomatic | swift-get-nodes -a | 18:58 |
torgomatic | :) | 18:58 |
torgomatic | in an N-disk system, you'll have somewhere in the vicinity of N-3 handoffs (most of the other disks in the cluster) | 18:59 |
*** zz_wasmum is now known as wasmum | 18:59 | |
torgomatic | swift-get-nodes only prints the first 3 because printing 1000+ handoffs is not particularly helpful | 18:59 |
notmyname | "helpful" | 18:59 |
*** cutforth has joined #openstack-swift | 19:00 | |
anticw | try with replicas=1 | 19:00 |
notmyname | video of PTL webinar I did yesterday has been uploaded https://www.youtube.com/watch?v=skNooBXIKqc | 19:00 |
notmyname | ok, swift team meeting of "open discussion" starts now in #openstack-meeting | 19:01 |
openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Zero-copy object-server GET responses with splice() https://review.openstack.org/102609 | 19:03 |
*** openstackgerrit has quit IRC | 19:04 | |
*** openstackgerrit has joined #openstack-swift | 19:04 | |
*** jamiehannaford has quit IRC | 19:06 | |
*** jamiehannaford has joined #openstack-swift | 19:09 | |
*** kevinc_ has quit IRC | 19:10 | |
*** jyoti-ranjan has quit IRC | 19:11 | |
*** wasmum is now known as zz_wasmum | 19:12 | |
*** angelastreeter has joined #openstack-swift | 19:16 | |
*** gvernik has quit IRC | 19:20 | |
*** mlipchuk has joined #openstack-swift | 19:26 | |
*** zz_wasmum is now known as wasmum | 19:28 | |
*** lpabon_ has joined #openstack-swift | 19:28 | |
*** lpabon_ has quit IRC | 19:31 | |
*** wasmum is now known as zz_wasmum | 19:41 | |
mattoliverau | Cool and on that note I'm going back to bed! See you all in the few hours :) | 19:42 |
*** jokke_ has quit IRC | 19:45 | |
*** tdasilva has joined #openstack-swift | 19:50 | |
*** jokke_ has joined #openstack-swift | 19:52 | |
*** zz_wasmum is now known as wasmum | 19:53 | |
*** kevinc_ has joined #openstack-swift | 19:55 | |
*** jamiehannaford has quit IRC | 20:00 | |
*** openstackgerrit has quit IRC | 20:05 | |
*** openstackgerrit has joined #openstack-swift | 20:05 | |
*** jokke_ has quit IRC | 20:10 | |
*** joeljwright has joined #openstack-swift | 20:13 | |
*** joeljwright has quit IRC | 20:13 | |
*** cutforth has quit IRC | 20:14 | |
openstackgerrit | A change was merged to openstack/swift: Fix swift-recon --auditor bug https://review.openstack.org/100192 | 20:15 |
*** orzel has left #openstack-swift | 20:21 | |
openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Zero-copy object-server GET responses with splice() https://review.openstack.org/102609 | 20:22 |
*** wasmum is now known as zz_wasmum | 20:23 | |
*** pconstantine_ has joined #openstack-swift | 20:25 | |
*** lpabon has quit IRC | 20:25 | |
torgomatic | ^^ just a changed commit message; I completely forgot to mention benchmark results | 20:27 |
portante | 37% reduction in CPU, cool | 20:29 |
portante | torgomatic: did it improve bandwidth utilization for large objects? | 20:30 |
torgomatic | yeah, turned out it was actually worth doing :) | 20:30 |
portante | :) | 20:30 |
portante | go figure | 20:30 |
torgomatic | portante: I didn't get into testing that; in my tests, stuff was going over the 10G LAN as fast as the disk could spew it out | 20:30 |
*** shri1 has joined #openstack-swift | 20:30 | |
*** shri1 has quit IRC | 20:30 | |
portante | nice | 20:30 |
torgomatic | both with splice and with read/write | 20:30 |
openstackgerrit | Josh Gachnang proposed a change to openstack/python-swiftclient: Adding Swift Temporary URL support https://review.openstack.org/102632 | 20:31 |
*** zz_wasmum is now known as wasmum | 20:31 | |
*** shri has quit IRC | 20:31 | |
torgomatic | I tried installing the patch cluster-wide to do some real benchmarks, and that's when I found out that RHEL/CentOS 6's kernels don't support AF_ALG sockets :| | 20:32 |
portante | ugh | 20:32 |
portante | might be worth a backport patch! | 20:32 |
torgomatic | I think so, but I'm biased ;) | 20:33 |
torgomatic | I also have no idea what the scope of that would be, so... | 20:33 |
torgomatic | the good news is it made me catch EAFNOSUPPORT and turn that into a useful warning in the logs, so there's your silver lining :) | 20:35 |
portante | so that means we should just take the patch no matter what! | 20:35 |
torgomatic | clearly ;) | 20:35 |
*** CaioBrentano has quit IRC | 20:41 | |
*** jokke_ has joined #openstack-swift | 20:41 | |
*** kenhui has joined #openstack-swift | 20:44 | |
*** angelastreeter has quit IRC | 20:47 | |
goodes | is feature/ec just profiles or does it also include object ec code? | 20:49 |
torgomatic | annegentle: ping | 20:57 |
notmyname | goodes: feature/ec used to have the storage policy work on it (it was poorly named) | 20:59 |
notmyname | goodes: but it's been reset and now it is being used for the ec storage policy work | 21:00 |
*** tdasilva has quit IRC | 21:00 | |
*** kenhui has quit IRC | 21:00 | |
*** kenhui has joined #openstack-swift | 21:01 | |
goodes | notmyname: i'm interested to learn how meta data will be stored with ec'd objects - where is the best place to look? | 21:02 |
*** wasmum is now known as zz_wasmum | 21:02 | |
openstackgerrit | A change was merged to openstack/swift: Fix some spelling in comments https://review.openstack.org/102297 | 21:03 |
clayg | goodes: try asking peluse_ - i'm not sure where the ec design docs are published - i suppose we'll be moving them into the specs repo | 21:13 |
*** mmcardle has joined #openstack-swift | 21:14 | |
*** foexle has quit IRC | 21:24 | |
goodes | clayg: thanks I'll look for him tomorrow, time to call it a night | 21:27 |
clayg | g'night | 21:31 |
*** mmcardle has quit IRC | 21:39 | |
*** miqui has quit IRC | 21:40 | |
*** orzel has joined #openstack-swift | 21:48 | |
orzel | i keep on having no object reported by 'swift stat', despite them working perfectly (~200 objects in one container, i can add/see/remove/whatever). Any idea why ? | 21:49 |
*** jamiehannaford has joined #openstack-swift | 21:54 | |
clayg | oh gawd the rabbit hole keeps going :'( | 22:04 |
*** judd7___ has quit IRC | 22:08 | |
mattoliverau | Morning everyone.. again :P | 22:11 |
*** dmsimard is now known as dmsimard_away | 22:15 | |
*** kenhui has quit IRC | 22:16 | |
notmyname | portante: may be too late for you, but I'm starting to look at the swift-specs repo right now | 22:21 |
notmyname | *sigh* clayg: what's the solution for "dist must be a Distribution instance"? | 22:26 |
notmyname | mordred: ^^ isn't there a recent patch to pbr to fix that | 22:27 |
*** acole_ has joined #openstack-swift | 22:32 | |
acole_ | hey'all | 22:33 |
notmyname | acole_: hello | 22:33 |
acole_ | notmyname: hey! | 22:33 |
acole_ | so googling "openstack swift chargeback" didn't work out for me :) | 22:33 |
acole_ | how do y'all deal with events for bandwidth/requests/storage over time? | 22:34 |
notmyname | acole_ == acoles? if not, this will get _really_ confusing | 22:34 |
acole_ | nope | 22:34 |
acole_ | adrian cole | 22:34 |
notmyname | hmm | 22:34 |
notmyname | ok | 22:34 |
acole_ | nova is more SEO friendly in this regard :) | 22:34 |
notmyname | acole_: what are you looking for in the way of chargebacks? | 22:34 |
*** openstackgerrit has quit IRC | 22:35 | |
*** openstackgerrit has joined #openstack-swift | 22:35 | |
acole_ | so basically, I'm looking at how various projects address this for some research I need to make | 22:35 |
acole_ | it isn't a swift-specific thing, just I figured it might exist here and is a close match to what I need to do | 22:36 |
notmyname | acole_: so strategies as opposed to "I have a prod cluster and need to bill my customers" | 22:36 |
acole_ | right | 22:36 |
acole_ | this is internal so more accounting/optimization vs billing | 22:36 |
notmyname | right | 22:36 |
notmyname | acole_: ok. basically there are 2 different ways people have done this for swift | 22:37 |
notmyname | one is the ceilometer approach: have middleware to intercept requests and track bandwidth and then poll the cluster about account stats. this requires a list external to swift of what accounts are in the system | 22:38 |
notmyname | the other way is like this: parse the logs after the fact for bandwidth usage and crawl the drives in the cluster for the storage usage (account stats) | 22:38 |
acole_ | gotit | 22:39 |
acole_ | is there any project that would address this inside swift or are ^^ pretty much fine for now for most folks? | 22:39 |
notmyname | acole_: what do you mean by "inside swift"? | 22:40 |
acole_ | like this https://wiki.openstack.org/wiki/SystemUsageData | 22:40 |
notmyname | acole_: note that this information is end-user info. not operator info like "how full are my drives" | 22:40 |
acole_ | as opposed to parsing logs, firing events basically | 22:40 |
acole_ | ^^ right | 22:40 |
acole_ | I can imagine that the granularity of change makes something like SystemUsageDAta trickier in swift vs nova | 22:41 |
notmyname | a bit. there's also often a few orders of magnitude more entities in an swift cluster than a nova cluster :-) | 22:41 |
acole_ | yeap | 22:42 |
notmyname | acole_: I'd say that swift does provide a lot of this info via logs and the account stats (eg some sort of mashup of the 2 strategies above) | 22:42 |
notmyname | and swift already has some event emitting info for operator things (so there is somewhat of a framework for emitting info to a listner) | 22:43 |
acole_ | ic cool | 22:43 |
notmyname | this is actually one of the reasons that I think a good durable queue service (maybe marconi someday?) would be awesome for swift | 22:43 |
notmyname | it seems like swift's statsd info is similar to that nova notification system | 22:45 |
notmyname | except that the statsd info isn't end-user utilization info. it's more like "how many GETs respond with 404s" | 22:45 |
*** kopparam has joined #openstack-swift | 22:45 | |
*** goodes has quit IRC | 22:46 | |
*** kenhui has joined #openstack-swift | 22:47 | |
acole_ | notmyname: thanks for the brain dump! | 22:47 |
*** serverascode has quit IRC | 22:47 | |
notmyname | acole_: does it answer your question? | 22:47 |
acole_ | yep sure did | 22:47 |
notmyname | acole_: what will you do with it? | 22:47 |
acole_ | well, tbh it is like some other practices I've seen | 22:48 |
acole_ | so sort of affirms that at least in swift (another leveraged cloud system), this sort of approach much be working :) | 22:49 |
*** goodes has joined #openstack-swift | 22:49 | |
*** orzel has left #openstack-swift | 22:49 | |
acole_ | so I've been basically trying to catch up with how various cloud systems address things, and the topic du'jour is utilization as I'm tasked with helping work on that. | 22:49 |
notmyname | leveraged cloud system? | 22:49 |
*** kopparam has quit IRC | 22:50 | |
acole_ | so for example, I don't want to NIH a chargeback design, if there was one embedded in swift. | 22:50 |
acole_ | so basically this is just me and how I research stuff :) irc, code search, wiki, etc | 22:51 |
notmyname | acole_: FWIW, I wrote a project a while back that does this (haven't looked at it in a while so it probably doesn't work anymore) called slogging, and SwiftStack uses a similar method (parse logs and crawl drives) | 22:51 |
*** serverascode has joined #openstack-swift | 22:51 | |
notmyname | acole_: with zero current support or promises of actually working (although it used to): https://github.com/notmyname/slogging | 22:52 |
acole_ | bbiab need to switch rooms | 22:52 |
*** acole_ has quit IRC | 22:52 | |
*** shri has joined #openstack-swift | 22:53 | |
*** kenhui has quit IRC | 22:55 | |
*** tdasilva has joined #openstack-swift | 22:57 | |
*** acole has joined #openstack-swift | 22:57 | |
acole | notmyname: thanks, I'll have a look. the short of this project is that we need to make something not too dissimilar to ICE https://github.com/Netflix/ice | 22:58 |
acole | and I'm looking around to see how folks are plumbing their cloud tenants/regions into usage reporting | 22:59 |
acole | seems that part must be moreso special sauce than open source projects at least so far as I've found | 22:59 |
notmyname | well sorta. I mean, if each cloud tool has their own concept of those things the way to track it will be "custom" compared to another cloud tool | 23:00 |
acole | fair point | 23:01 |
notmyname | acole: for swift, if you think about the entities as a tree (account->container->object), then it makes sense to track just that. and map to an actual user or tenant external to the swift usage reporting system | 23:02 |
*** jamiehannaford has quit IRC | 23:02 | |
*** kevinc_ has quit IRC | 23:05 | |
*** kevinc_ has joined #openstack-swift | 23:06 | |
*** jkelly has joined #openstack-swift | 23:12 | |
*** lpabon has joined #openstack-swift | 23:17 | |
*** jkelly has quit IRC | 23:17 | |
*** lpabon has quit IRC | 23:18 | |
*** lpabon has joined #openstack-swift | 23:19 | |
*** jamiehannaford has joined #openstack-swift | 23:23 | |
*** acole has quit IRC | 23:26 | |
*** tdasilva has quit IRC | 23:35 | |
*** pconstantine_ has quit IRC | 23:53 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!