*** vinsh has joined #openstack-swift | 00:12 | |
*** vinsh has quit IRC | 00:15 | |
*** esker has joined #openstack-swift | 00:16 | |
*** zhill has quit IRC | 00:16 | |
*** annegentle has joined #openstack-swift | 00:17 | |
*** chlong_ has joined #openstack-swift | 00:20 | |
*** annegentle has quit IRC | 00:23 | |
*** david-lyle has quit IRC | 00:28 | |
*** km__ has joined #openstack-swift | 00:29 | |
*** km has quit IRC | 00:32 | |
mattoliverau | ho: morning | 00:32 |
---|---|---|
*** annegentle has joined #openstack-swift | 00:33 | |
*** kei_yama has quit IRC | 00:33 | |
*** esker has quit IRC | 00:34 | |
ho | mattoliverau: morning! | 00:34 |
*** kei_yama has joined #openstack-swift | 00:35 | |
*** esker has joined #openstack-swift | 01:01 | |
*** km has joined #openstack-swift | 01:02 | |
*** km__ has quit IRC | 01:04 | |
*** esker has quit IRC | 01:18 | |
*** tobe43 has joined #openstack-swift | 01:38 | |
*** esker has joined #openstack-swift | 01:44 | |
*** vjujjuri has quit IRC | 01:53 | |
*** esker has quit IRC | 02:03 | |
*** annegentle has quit IRC | 02:07 | |
*** wbhuber has joined #openstack-swift | 02:13 | |
*** asettle is now known as asettle-afk | 02:25 | |
*** esker has joined #openstack-swift | 02:29 | |
*** annegentle has joined #openstack-swift | 02:40 | |
*** annegentle has quit IRC | 02:41 | |
*** esker has quit IRC | 02:47 | |
*** gyee has quit IRC | 02:47 | |
*** tobe43 has quit IRC | 02:58 | |
*** chlong has quit IRC | 03:05 | |
*** annegentle has joined #openstack-swift | 03:10 | |
*** esker has joined #openstack-swift | 03:13 | |
*** wbhuber has quit IRC | 03:15 | |
*** annegentle has quit IRC | 03:20 | |
*** esker has quit IRC | 03:24 | |
*** esker has joined #openstack-swift | 03:24 | |
*** links has joined #openstack-swift | 03:30 | |
*** esker has quit IRC | 03:32 | |
*** vinsh has joined #openstack-swift | 03:47 | |
*** david-lyle has joined #openstack-swift | 03:48 | |
*** asettle-afk has quit IRC | 03:48 | |
*** vjujjuri has joined #openstack-swift | 03:49 | |
*** vinsh has quit IRC | 03:51 | |
*** chlong_ has quit IRC | 03:52 | |
*** km_ has joined #openstack-swift | 04:02 | |
*** ho_ has joined #openstack-swift | 04:03 | |
*** ho has quit IRC | 04:04 | |
*** km has quit IRC | 04:05 | |
*** occupant has quit IRC | 04:09 | |
*** occupant has joined #openstack-swift | 04:11 | |
*** vjujjuri_ has joined #openstack-swift | 04:19 | |
*** vjujjuri has quit IRC | 04:20 | |
*** vjujjuri_ is now known as vjujjuri | 04:20 | |
*** occupant has quit IRC | 04:33 | |
*** minwoob has quit IRC | 04:40 | |
*** zaitcev has quit IRC | 04:57 | |
*** km has joined #openstack-swift | 05:01 | |
*** ho has joined #openstack-swift | 05:01 | |
*** ho has quit IRC | 05:01 | |
*** ho_ has quit IRC | 05:02 | |
*** km_ has quit IRC | 05:03 | |
*** ho has joined #openstack-swift | 05:03 | |
*** bill_az has joined #openstack-swift | 05:13 | |
*** gsilvis_ has joined #openstack-swift | 05:14 | |
*** ir2ivps8 has quit IRC | 05:15 | |
*** patchbot` has joined #openstack-swift | 05:15 | |
*** patchbot has quit IRC | 05:15 | |
*** patchbot` is now known as patchbot | 05:17 | |
*** dosaboy_ has joined #openstack-swift | 05:18 | |
*** guitarza1 has joined #openstack-swift | 05:19 | |
*** chlong has joined #openstack-swift | 05:23 | |
*** bkopilov is now known as bkopilov_wfh | 05:24 | |
*** ndk_ has joined #openstack-swift | 05:26 | |
*** ndk has quit IRC | 05:26 | |
*** thurloat has quit IRC | 05:26 | |
*** gsilvis has quit IRC | 05:26 | |
*** guitarzan has quit IRC | 05:26 | |
*** dosaboy has quit IRC | 05:27 | |
*** SkyRocknRoll has joined #openstack-swift | 05:31 | |
*** SkyRocknRoll has joined #openstack-swift | 05:31 | |
*** thurloat has joined #openstack-swift | 05:33 | |
*** chlong has quit IRC | 05:34 | |
*** ir2ivps8 has joined #openstack-swift | 05:34 | |
*** ppai has joined #openstack-swift | 05:38 | |
*** chlong has joined #openstack-swift | 05:47 | |
*** zhill has joined #openstack-swift | 05:51 | |
*** ppai has quit IRC | 05:53 | |
*** ppai has joined #openstack-swift | 05:56 | |
*** silor has joined #openstack-swift | 06:00 | |
*** ppai has quit IRC | 06:05 | |
*** proteusguy has joined #openstack-swift | 06:12 | |
*** ppai has joined #openstack-swift | 06:12 | |
*** chlong has quit IRC | 06:24 | |
*** chlong has joined #openstack-swift | 06:27 | |
*** bill_az has quit IRC | 06:34 | |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Remove confusable query string on post as copy https://review.openstack.org/178927 | 06:49 |
*** fifieldt has joined #openstack-swift | 06:56 | |
*** fifieldt has quit IRC | 06:56 | |
*** vjujjuri has quit IRC | 06:56 | |
*** kota_ has joined #openstack-swift | 07:00 | |
*** jordanP has joined #openstack-swift | 07:08 | |
openstackgerrit | Matthew Oliver proposed openstack/swift: Add concurrent reads option to proxy https://review.openstack.org/117710 | 07:08 |
*** zhill has quit IRC | 07:22 | |
*** geaaru has joined #openstack-swift | 07:25 | |
*** jistr has joined #openstack-swift | 07:49 | |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Fix the missing SLO state on fast-post https://review.openstack.org/182564 | 08:00 |
*** acoles_away is now known as acoles | 08:03 | |
kota_ | acoles, I just posted a fix for bug 1453807! | 08:05 |
openstack | bug 1453807 in OpenStack Object Storage (swift) "Post (not as copy) to SLO manifest destroys its state as a manifest" [Undecided,New] https://launchpad.net/bugs/1453807 | 08:05 |
acoles | kota_: hi, cool, thx | 08:11 |
openstackgerrit | Alistair Coles proposed openstack/swift: Filter Etag key from ssync replication-headers https://review.openstack.org/173973 | 08:40 |
tab___ | Is TempURL generated per container or per account for public folder? | 08:45 |
tab___ | sorry , for private folder | 08:46 |
*** ho has quit IRC | 08:49 | |
ahale | the tempurl secret is per account, but the generated hmac are normally for specific objects | 08:59 |
ahale | i think thers a patch for per-container secrets, either added recently or coming | 09:00 |
*** kei_yama has quit IRC | 09:25 | |
*** km has quit IRC | 09:28 | |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Fix the missing SLO state on fast-post https://review.openstack.org/182564 | 09:32 |
*** 5EXAA60VI has quit IRC | 09:40 | |
*** kota_ has quit IRC | 09:45 | |
openstackgerrit | Alistair Coles proposed openstack/swift: Cleanup and extend end to end ssync tests https://review.openstack.org/179379 | 10:05 |
acoles | kota_: thanks for your reviews | 10:05 |
*** jamielennox is now known as jamielennox|away | 10:08 | |
*** mattoliverau has quit IRC | 10:25 | |
*** early has quit IRC | 10:26 | |
*** mattoliverau has joined #openstack-swift | 10:26 | |
*** classicsnail has quit IRC | 10:27 | |
*** acoles has quit IRC | 10:27 | |
*** early has joined #openstack-swift | 10:28 | |
*** jd__ has quit IRC | 10:28 | |
*** jd__ has joined #openstack-swift | 10:32 | |
*** EmilienM has quit IRC | 10:33 | |
*** ekarlso has quit IRC | 10:33 | |
*** EmilienM has joined #openstack-swift | 10:35 | |
*** classicsnail has joined #openstack-swift | 10:36 | |
*** acoles has joined #openstack-swift | 10:38 | |
*** ChanServ sets mode: +v acoles | 10:38 | |
tab___ | creating temp url over some picture: swift-temp-url GET 300 /v1/AUTH_d2d817e93ad644439ec29fc7bce52eba/privat/narezek.jpg swiftpass | 10:40 |
tab___ | i get url with which i go to browser and it enables me to download a file | 10:40 |
*** ekarlso has joined #openstack-swift | 10:41 | |
tab___ | wich other method to use for making picture not immediately downloadable , but shown within browser | 10:41 |
tab___ | i tired other methods ( PUT POST) but each time i get than "401 Unauthorized: Temp URL invalid" | 10:42 |
ahale | you can add a &inline to the GET to make it change the content-disposition thats inserted | 10:43 |
*** ekarlso has quit IRC | 10:45 | |
*** ekarlso has joined #openstack-swift | 10:45 | |
tab___ | ahale: &inline to the end of generated URL? | 10:46 |
ahale | yah, theres a bit of blog about it at https://swiftstack.com/blog/2015/01/29/swift-feature-highlight-tempurls/ | 10:46 |
ahale | in the advanced usage part | 10:46 |
tab___ | ahale: aha great. thank you! | 10:47 |
ahale | no probs | 10:47 |
tab___ | ahale: do you have also some great online knowledge resource link for testing object-expiration? | 10:48 |
ahale | hm not really.. I dont think theres much about that :( do you mean from inside or outside the cluster? | 10:49 |
*** thurloat is now known as thurloat_isgone | 10:51 | |
tab___ | inside | 10:51 |
ahale | mainly just checking out the .expiring_objects account and its structure | 10:52 |
ahale | i use swiftly for that since its direct client makes it really easy to do `swiftly --direct=/v1/.expiring_objects get -l 10`, to see the oldest unexpired hours, then check the pending work inside | 10:53 |
tab___ | ahale: one more question for you maybe. I am setting rings (ring builder files). Let's say i am creating multi node ring, so different IP for object store an disks are used. is it better to use hostnames or IPs withing add to the ring command? | 10:53 |
tab___ | aha ok i will check swiftly. thx | 10:54 |
ahale | and theres checking swift-get-nodes ssh output to see if the obj is really 404'ing or just object server is faking it | 10:54 |
tab___ | aha. great to know | 10:54 |
ahale | we always use IPs, im not even sure hostnames works? | 10:54 |
tab___ | aha ok. and what happens | 10:54 |
tab___ | let's say. i have multi nodes that are using ring file with ips | 10:55 |
tab___ | and than for examples, ips are changed | 10:55 |
tab___ | how does that influence on data etc | 10:55 |
ahale | (and the unexpired object will still show in a container listing for the user as well until its cleaned up by the expirer process) | 10:55 |
tab___ | do i just update ring files and replicate them to all machines | 10:55 |
tab___ | what happens with data rebalancing, i do not want that etc... | 10:55 |
ahale | that would be bad, you wouldn't want to re-ip a box | 10:56 |
tab___ | yes, but what if :) | 10:56 |
tab___ | that's why i was asking if it would be better to use hostnames on longer period... | 10:56 |
ahale | i guess, if you did, replication should eventually sort it out, but it would be really horrible user experience while that happened | 10:57 |
tab___ | maybe not life case, but anyways... | 10:57 |
tab___ | ok | 10:57 |
ahale | hostnames might work, i remember there was some talk about ipv6 as well , i didnt really pay attention so I wouldnt trust me too much on that part | 10:57 |
tab___ | ok. i will check it. ipv6 i guess woudl come into play with kinetic drives :) | 10:58 |
openstackgerrit | Merged openstack/swift: Allow rsync to use compression https://review.openstack.org/148454 | 10:58 |
*** Trozz has quit IRC | 10:58 | |
*** Trozz has joined #openstack-swift | 11:05 | |
tab___ | ahale: which tool would you recommend for check on disk health, possible some web GUI? | 11:06 |
ahale | we use a homegrown tool for that mostly | 11:07 |
ahale | and some hacked up copies of swift-recon -u that feed into graphite for dash / stats | 11:08 |
tab___ | ok thx | 11:11 |
ahale | im not sure what other people use for monitoring and health | 11:12 |
tab___ | ahale: regarding swiftly. is that project on github? | 11:16 |
tab___ | i am trying to find the right tool | 11:16 |
ahale | yeah should be, gholt/swiftly i think | 11:17 |
*** tobe4333 has joined #openstack-swift | 11:35 | |
openstackgerrit | Merged openstack/swift: Remove 1 line of dead code from EC reconstructor https://review.openstack.org/182479 | 11:40 |
*** delattec has quit IRC | 11:50 | |
*** cdelatte has quit IRC | 11:50 | |
*** fthiagogv has joined #openstack-swift | 11:54 | |
*** tobe4333 has quit IRC | 11:57 | |
*** lpabon_ has joined #openstack-swift | 12:01 | |
*** dmorita has quit IRC | 12:01 | |
*** lpabon_ has quit IRC | 12:01 | |
*** ppai has quit IRC | 12:02 | |
tab___ | ahole: ok thx, i'll check | 12:06 |
*** cdelatte has joined #openstack-swift | 12:07 | |
*** delattec has joined #openstack-swift | 12:09 | |
*** cdelatte has quit IRC | 12:12 | |
*** aix has joined #openstack-swift | 12:13 | |
openstackgerrit | Stuart McLaren proposed openstack/python-swiftclient: Add minimal working service token support. https://review.openstack.org/182640 | 12:14 |
*** lpabon has quit IRC | 12:14 | |
*** proteusguy has quit IRC | 12:15 | |
*** ppai has joined #openstack-swift | 12:16 | |
*** lpabon has joined #openstack-swift | 12:19 | |
*** annegentle has joined #openstack-swift | 12:34 | |
*** annegentle has quit IRC | 12:45 | |
*** annegentle has joined #openstack-swift | 12:46 | |
*** ppai has quit IRC | 12:50 | |
*** dencaval has joined #openstack-swift | 12:55 | |
*** fthiagogv has quit IRC | 12:58 | |
*** bill_az has joined #openstack-swift | 13:00 | |
*** bkopilov_wfh has quit IRC | 13:04 | |
*** annegentle has quit IRC | 13:06 | |
*** bkopilov_wfh has joined #openstack-swift | 13:07 | |
*** annegentle has joined #openstack-swift | 13:07 | |
*** wbhuber has joined #openstack-swift | 13:20 | |
*** wbhuber has quit IRC | 13:25 | |
*** guitarza1 is now known as guitarzan | 13:26 | |
*** fthiagogv has joined #openstack-swift | 13:31 | |
*** wbhuber has joined #openstack-swift | 13:33 | |
*** SkyRocknRoll has quit IRC | 13:33 | |
*** vjujjuri has joined #openstack-swift | 13:34 | |
*** vjujjuri_ has joined #openstack-swift | 13:37 | |
*** vjujjuri has quit IRC | 13:39 | |
*** vjujjuri_ is now known as vjujjuri | 13:39 | |
openstackgerrit | Kamil Rykowski proposed openstack/swift: Replaced setting run_pause with standard interval https://review.openstack.org/171170 | 13:40 |
*** vjujjuri has quit IRC | 13:48 | |
*** links has quit IRC | 13:48 | |
*** NM has joined #openstack-swift | 13:59 | |
*** haomaiwang has joined #openstack-swift | 14:15 | |
*** jrichli has joined #openstack-swift | 14:21 | |
*** breitz has quit IRC | 14:23 | |
*** breitz has joined #openstack-swift | 14:24 | |
*** haomaiwang has quit IRC | 14:25 | |
*** bkopilov has joined #openstack-swift | 14:26 | |
*** bkopilov_wfh has quit IRC | 14:27 | |
*** vinsh has joined #openstack-swift | 14:30 | |
*** chlong has quit IRC | 14:30 | |
*** fanyaohong has joined #openstack-swift | 14:37 | |
*** fthiagogv has quit IRC | 14:48 | |
*** minwoob has joined #openstack-swift | 14:52 | |
*** NM has quit IRC | 14:53 | |
*** bkopilov has quit IRC | 14:57 | |
*** fthiagogv has joined #openstack-swift | 15:01 | |
*** marcusvrn_ has joined #openstack-swift | 15:02 | |
*** bkopilov has joined #openstack-swift | 15:11 | |
*** vjujjuri has joined #openstack-swift | 15:18 | |
*** jistr is now known as jistr|mtg | 15:19 | |
*** nadeem has joined #openstack-swift | 15:26 | |
*** nadeem has quit IRC | 15:28 | |
*** nadeem has joined #openstack-swift | 15:29 | |
*** jistr|mtg is now known as jistr | 15:29 | |
*** proteusguy has joined #openstack-swift | 15:35 | |
*** mahatic has joined #openstack-swift | 15:38 | |
*** geaaru has quit IRC | 15:39 | |
*** gyee has joined #openstack-swift | 15:44 | |
*** bkopilov has quit IRC | 15:44 | |
*** bkopilov has joined #openstack-swift | 15:45 | |
openstackgerrit | pradeep kumar singh proposed openstack/swift: Closes-Bug:1169189 https://review.openstack.org/182734 | 15:50 |
*** shakamunyi has quit IRC | 15:51 | |
*** barra204 has quit IRC | 15:51 | |
*** esker has joined #openstack-swift | 15:53 | |
*** wbhuber_ has joined #openstack-swift | 16:00 | |
*** wbhuber has quit IRC | 16:04 | |
*** silor has quit IRC | 16:12 | |
*** erlon has joined #openstack-swift | 16:12 | |
*** NM has joined #openstack-swift | 16:18 | |
notmyname | good morning | 16:23 |
*** jistr has quit IRC | 16:25 | |
tdasilva | morning | 16:25 |
acoles | notmyname: good morning. are we meeting today? | 16:27 |
*** jordanP has quit IRC | 16:29 | |
notmyname | yes we are meeting today | 16:31 |
notmyname | we need to choose the last working session topic (or remind me what it is) and I want to make sure I'm available for any summit questions | 16:32 |
*** wbhuber__ has joined #openstack-swift | 16:36 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 16:39 |
*** wbhuber_ has quit IRC | 16:40 | |
*** thurloat_isgone is now known as thurloat | 16:48 | |
*** fanyaohong has quit IRC | 16:49 | |
*** acoles is now known as acoles_away | 16:54 | |
*** thurloat is now known as thurloat_isgone | 17:07 | |
*** nadeem has quit IRC | 17:09 | |
*** harlowja has quit IRC | 17:20 | |
*** harlowja has joined #openstack-swift | 17:20 | |
*** nadeem has joined #openstack-swift | 17:23 | |
notmyname | acoles_away: jrichli: how much have you looked at barbican in the context of the encryption work? | 17:35 |
notmyname | one thing I've learned recently is that barbican doesn't support inline secret key generation | 17:39 |
notmyname | you put in an "order" for generating a secret and it's created async and you can get it later | 17:39 |
*** marcusvrn_ is now known as marcusvrn | 17:41 | |
*** anirup has joined #openstack-swift | 17:43 | |
*** fthiagogv has quit IRC | 17:47 | |
*** wbhuber__ has quit IRC | 17:49 | |
*** wbhuber has joined #openstack-swift | 17:49 | |
*** NM has quit IRC | 17:49 | |
vjujjuri | Hi All I am able to progress from python issue. but running into auth issue. can someone help me? | 17:54 |
vjujjuri | sh-4.2# sudo curl -v -H 'X-Storage-User: test:tester' -H 'X-Storage-Pass: testing' http://127.0.0.1:8080/auth/v1.0 | 17:56 |
vjujjuri | * About to connect() to 127.0.0.1 port 8080 (#0) | 17:57 |
vjujjuri | * Trying 127.0.0.1... | 17:57 |
vjujjuri | * Connected to 127.0.0.1 (127.0.0.1) port 8080 (#0) | 17:57 |
*** occupant has joined #openstack-swift | 17:57 | |
vjujjuri | > GET /auth/v1.0 HTTP/1.1 | 17:57 |
vjujjuri | > User-Agent: curl/7.29.0 | 17:57 |
vjujjuri | > Host: 127.0.0.1:8080 | 17:57 |
vjujjuri | > Accept: */* | 17:57 |
vjujjuri | > X-Storage-User: test:tester | 17:57 |
vjujjuri | > X-Storage-Pass: testing | 17:57 |
vjujjuri | > | 17:57 |
vjujjuri | < HTTP/1.1 200 OK | 17:57 |
vjujjuri | < X-Storage-Url: http://127.0.0.1:8080/v1/AUTH_test | 17:57 |
vjujjuri | < X-Auth-Token: AUTH_tkb0c7573a84004b1e9bb9e3018b5ed46b | 17:57 |
vjujjuri | < Content-Type: text/html; charset=UTF-8 | 17:57 |
vjujjuri | < X-Storage-Token: AUTH_tkb0c7573a84004b1e9bb9e3018b5ed46b | 17:57 |
vjujjuri | < Content-Length: 0 | 17:57 |
vjujjuri | < X-Trans-Id: tx64f7af4495db438c8285c-0055538fbd | 17:57 |
vjujjuri | < Date: Wed, 13 May 2015 17:54:05 GMT | 17:57 |
vjujjuri | < | 17:57 |
vjujjuri | * Connection #0 to host 127.0.0.1 left intact | 17:57 |
vjujjuri | sh-4.2# curl -v -H 'X-Auth-Token: AUTH_tkb0c7573a84004b1e9bb9e3018b5ed46b' http://127.0.0.1:8080/v1/AUTH_test | 17:57 |
vjujjuri | * About to connect() to 127.0.0.1 port 8080 (#0) | 17:57 |
vjujjuri | * Trying 127.0.0.1... | 17:57 |
vjujjuri | * Connected to 127.0.0.1 (127.0.0.1) port 8080 (#0) | 17:57 |
vjujjuri | > GET /v1/AUTH_test HTTP/1.1 | 17:57 |
vjujjuri | > User-Agent: curl/7.29.0 | 17:57 |
vjujjuri | > Host: 127.0.0.1:8080 | 17:57 |
vjujjuri | > Accept: */* | 17:57 |
vjujjuri | > X-Auth-Token: AUTH_tkb0c7573a84004b1e9bb9e3018b5ed46b | 17:57 |
vjujjuri | > | 17:57 |
vjujjuri | < HTTP/1.1 401 Unauthorized | 17:57 |
vjujjuri | < Content-Length: 131 | 17:57 |
*** haomaiwa_ has joined #openstack-swift | 17:57 | |
vjujjuri | < Content-Type: text/html; charset=UTF-8 | 17:57 |
vjujjuri | < Www-Authenticate: Swift realm="AUTH_test" | 17:57 |
vjujjuri | < X-Trans-Id: txa52cf687f2cc4e6d950f6-0055539056 | 17:57 |
vjujjuri | < Date: Wed, 13 May 2015 17:56:38 GMT | 17:57 |
vjujjuri | < | 17:57 |
vjujjuri | * Connection #0 to host 127.0.0.1 left intact | 17:57 |
vjujjuri | <html><h1>Unauthorized</h1><p>This server could not verify that you are authorized to access the document you requested.</p></html>sh-4.2# | 17:57 |
notmyname | vjujjuri: please use paste.openstack.org | 17:58 |
vjujjuri | notmyname: Sure thanks for the reminder. | 17:58 |
vjujjuri | anyone here know how to disable keystone | 17:59 |
*** marcusvrn has quit IRC | 17:59 | |
vjujjuri | and to operate swift no auth is needed | 17:59 |
vjujjuri | ? | 18:00 |
clayg | MooingLemur: isn't part of the ring in pickle? is there a cpan module for that? | 18:02 |
clayg | vjujjuri: it's easy, just take auth out of the pipeline | 18:03 |
clayg | vjujjuri: problem is most clients except some sort of auth endpoint to get from which to get the storage url - but you can curl and put with no auth token just fine | 18:03 |
vjujjuri | i see | 18:04 |
vjujjuri | just curl put to the util? | 18:04 |
*** annegentle has quit IRC | 18:04 | |
clayg | yeah that works fine | 18:04 |
jrichli | notmyname: we are still in the early stages of exploration with barbican. I know that we have been focusing on the interaction where we supply a key. | 18:07 |
vjujjuri | clayg: | 18:08 |
vjujjuri | sh-4.2# curl -X PUT /tmp/ha http://127.0.0.1:8080/v1/ha | 18:08 |
vjujjuri | curl: (3) <url> malformed | 18:08 |
vjujjuri | <html><h1>Unauthorized</h1><p>This server could not verify that you are authorized to access the document you requested.</p></html>sh-4.2 | 18:08 |
clayg | vjujjuri: yeah but you have to take the auth middleware out of the pipeline:main section in the proxy config and restart the proxy | 18:15 |
vjujjuri | clayg: you mean this section? | 18:16 |
vjujjuri | [filter:tempauth] | 18:17 |
vjujjuri | use = egg:swift#tempauth | 18:17 |
vjujjuri | user_admin_admin = admin .admin .reseller_admin | 18:17 |
vjujjuri | user_test_tester = testing .admin | 18:17 |
vjujjuri | user_test2_tester2 = testing2 .admin | 18:17 |
vjujjuri | user_test_tester3 = testing3 | 18:17 |
clayg | no, [pipeline:main] section | 18:17 |
vjujjuri | clayg: sorry new to swift. :) | 18:17 |
vjujjuri | Right in that secion | 18:17 |
clayg | yeah np, we love to help - but bro - you have got to stop pasing multiline code into this channel | 18:17 |
vjujjuri | let me upload my config file to pastebin | 18:18 |
clayg | vjujjuri: why don't you paste up the entire proxy-config somewhere - I can tell you the line number or give you a dif | 18:18 |
clayg | ;) | 18:18 |
vjujjuri | http://pastebin.com/P9M4gKTb | 18:19 |
vjujjuri | clayg: ^ | 18:19 |
clayg | so line 13 - tempauth is in the middle of the long list of names - between crossdomain and staticweb | 18:21 |
clayg | just delete the word tempauth - and you will have a noauth cluster | 18:22 |
clayg | vjujjuri: but didn't you say you were trying to make keystone work? | 18:22 |
*** gvernik has joined #openstack-swift | 18:23 | |
vjujjuri | clayg: yes ; if we can make that work it is great. | 18:23 |
vjujjuri | basically I am trying to get some perf numbers | 18:23 |
vjujjuri | since getting keystone running is taking time, wondering if we can do this way - by disabling keystone | 18:24 |
clayg | oic | 18:24 |
clayg | ... so did pulling tempauth out of th pipeline work? what benchmark tool are you using - will it support noauth - or would tempauth be better? | 18:25 |
vjujjuri | clayg I pulled it out - Stil giving curl: (3) <url> malformed | 18:26 |
vjujjuri | am I doing the url right? how do I get the list of accounts and container rings? | 18:26 |
*** silor has joined #openstack-swift | 18:27 | |
vjujjuri | This is what I tried: | 18:27 |
vjujjuri | vjujjuri@twinstan-wsl6:~$ curl -X PUT /tmp/ha http://127.0.0.1:8080/v1/abc | 18:27 |
clayg | vjujjuri: oh, sorrt i missed the first part and only saw Unauthorized | 18:27 |
clayg | the curl syntax to upload a file is -T | 18:27 |
clayg | but yeah - you need to create a container first | 18:27 |
clayg | you can list the account with a GET - just curl http://127.0.0.1:8080/v1/abc | 18:27 |
clayg | ^ normally it'd be /v1/AUTH_<account> - but with no-auth and autocreate account you can just hit any auth url | 18:28 |
vjujjuri | surely I am doing somethig wrong | 18:29 |
vjujjuri | http://pastebin.com/jYsztAUP | 18:30 |
vjujjuri | clayg: ^ | 18:30 |
clayg | heh, the last one "curl http://127.0.0.1:8080/v1/abc" was the only one that would have worked - but without a -v you wouldn't have realized it returned an empty body | 18:31 |
clayg | vjujjuri: the suggestion to "try 'curl --help' or 'curl --manual' for more information" is probably good avice | 18:32 |
*** NM has joined #openstack-swift | 18:35 | |
*** aix has quit IRC | 18:47 | |
*** legionarius has joined #openstack-swift | 18:48 | |
*** ho has joined #openstack-swift | 18:49 | |
ho | good morning! | 18:53 |
*** aerwin has joined #openstack-swift | 18:53 | |
*** cutforth has joined #openstack-swift | 18:54 | |
*** acoles_away is now known as acoles | 18:57 | |
InAnimaTe | sigh... | 18:57 |
InAnimaTe | anyone ever dealt with the majority of their disks being at 100% | 18:58 |
mattoliverau | morning | 18:59 |
*** dionkalo has joined #openstack-swift | 18:59 | |
clayg | InAnimaTe: :'( sorry bro | 18:59 |
notmyname | meeting time | 18:59 |
*** annegentle has joined #openstack-swift | 19:00 | |
*** kota_ has joined #openstack-swift | 19:02 | |
glange | InAnimaTe: how did that happen? | 19:11 |
*** legionarius has quit IRC | 19:14 | |
*** zaitcev has joined #openstack-swift | 19:15 | |
*** ChanServ sets mode: +v zaitcev | 19:15 | |
*** thurloat_isgone is now known as thurloat | 19:17 | |
*** B4rker has joined #openstack-swift | 19:18 | |
InAnimaTe | glange: mistreatment by other people | 19:22 |
InAnimaTe | so i have this idea | 19:22 |
ahale | are you out of container/account or just object ? | 19:25 |
*** dionkalo has left #openstack-swift | 19:25 | |
InAnimaTe | all of them | 19:26 |
InAnimaTe | the logs are full of database errors | 19:26 |
InAnimaTe | rsync disk is full errors, etc.. | 19:26 |
*** dk2 has joined #openstack-swift | 19:26 | |
InAnimaTe | basically, im thinking if i can remove some containers across the drives, it might free up enough space for things to work again | 19:27 |
InAnimaTe | (we have 3x replication) | 19:27 |
ahale | ouch ! | 19:27 |
*** vjujjuri has quit IRC | 19:28 | |
InAnimaTe | heres the fun part, mgmt has told me i cant change the replication factor | 19:28 |
InAnimaTe | so yeah...having loads of fun with this | 19:28 |
torgomatic | http://nadreck.me/trunk/wp-content/uploads/2015/02/fine.png | 19:28 |
torgomatic | can you get more disks? | 19:28 |
InAnimaTe | so ive already incorporated in another partition (that is a teeny bit smaller) to each box in each zone | 19:30 |
*** tdasilva has quit IRC | 19:30 | |
InAnimaTe | its very very slowly being incorporated in | 19:32 |
InAnimaTe | yeah the way it stores objects raw on each disk is a little weird | 19:33 |
InAnimaTe | not sure what the "100000" or "9993" directories are exactly for | 19:33 |
*** lpabon has quit IRC | 19:34 | |
glange | those are partition numbers | 19:34 |
glange | the ring assigns partitions to devices | 19:35 |
glange | that determines where objects go | 19:35 |
glange | which partition they hash to | 19:35 |
*** mahatic has quit IRC | 19:38 | |
*** mahatic has joined #openstack-swift | 19:38 | |
*** blmartin has joined #openstack-swift | 19:43 | |
clayg | InAnimaTe: https://answers.launchpad.net/swift/+question/150077 has some info - there's a bug too | 19:43 |
notmyname | acoles: seems the answer is "not really". | 19:44 |
notmyname | http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/gerrit.pp#n142 is what's configured | 19:44 |
notmyname | so it might be possible | 19:44 |
notmyname | also, "isn't that what blueprints are for" is one answer I got | 19:45 |
acoles | notmyname: using blueprints as a 'hub' is one way but...yet another place to go manage info :/ | 19:46 |
notmyname | one of the main reasons I don't like it | 19:47 |
acoles | and blueprints don't issue notifications afaik. lets not go there. | 19:48 |
notmyname | oh I know :-) | 19:48 |
*** B4rker has quit IRC | 19:49 | |
acoles | i wonder if the dashboard url can select on pattern match in a commit message? | 19:49 |
notmyname | not that I've seen | 19:50 |
notmyname | but the dashboard can be built from anything that works in the search field | 19:50 |
notmyname | (which is a whole 'nother ball of fun) | 19:50 |
*** dk2 has quit IRC | 19:50 | |
acoles | hmm. even manually including a changeid link to the spec review isn't great because the gate doc build on the review tends to expire, so you still don't get to the html | 19:51 |
clayg | InAnimaTe: this was it! https://bugs.launchpad.net/swift/+bug/1359160 | 19:51 |
openstack | Launchpad bug 1359160 in OpenStack Object Storage (swift) "Problem with disk overflowing" [Undecided,Expired] | 19:51 |
*** erlon has quit IRC | 19:51 | |
*** gvernik has quit IRC | 19:52 | |
*** tdasilva has joined #openstack-swift | 19:53 | |
*** dencaval has quit IRC | 19:54 | |
*** acoles is now known as acoles_away | 19:58 | |
*** tdasilva has quit IRC | 20:00 | |
*** delattec has quit IRC | 20:08 | |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Remove confusable query string on post as copy https://review.openstack.org/178927 | 20:10 |
*** esker has quit IRC | 20:16 | |
*** tdasilva has joined #openstack-swift | 20:17 | |
*** tdasilva is now known as tdasilva_ | 20:17 | |
InAnimaTe | hmm interesting | 20:18 |
InAnimaTe | glange: ok i see | 20:18 |
*** tdasilva has joined #openstack-swift | 20:19 | |
clayg | InAnimaTe: are your containers and objects on the the same devices? | 20:19 |
InAnimaTe | yes | 20:20 |
clayg | InAnimaTe: haven't you been through something like this before? | 20:20 |
InAnimaTe | nope | 20:20 |
InAnimaTe | well | 20:20 |
InAnimaTe | kind of | 20:20 |
InAnimaTe | we never actually hit 100% | 20:20 |
openstackgerrit | Thiago da Silva proposed openstack/swift: move replication code to ReplicatedObjectController https://review.openstack.org/182826 | 20:20 |
clayg | oh | 20:20 |
InAnimaTe | we were at like 96% etc.. | 20:20 |
clayg | so you're like paving new ground here | 20:21 |
clayg | you're going to be able to write the book on unscrewing full swift clusters | 20:21 |
glange | what would be the title of that book? :) | 20:21 |
glange | "Not So Swift"? :) | 20:21 |
clayg | glange: ummm "unscrewing full swift clusters for fun and terror"? | 20:22 |
glange | dude, that is terrible :) | 20:22 |
clayg | lol | 20:22 |
clayg | glange: you sure you're not coming to vancouver? | 20:22 |
glange | yeah, we have it covered | 20:22 |
glange | "My Big Fat Swift Cluster" | 20:22 |
InAnimaTe | rofl | 20:23 |
InAnimaTe | so much inspiration in this chan | 20:23 |
glange | haha, sorry, we feel bad for you | 20:23 |
clayg | InAnimaTe: so step 1 is normally find some disks - you got that part covered? | 20:23 |
glange | the only way to fix things is more capacity or deleting stuff | 20:23 |
glange | you cat put more in the bag than it will hold | 20:23 |
glange | can't | 20:23 |
*** kota_ has quit IRC | 20:24 | |
clayg | glange: deleting stuff is a write operation | 20:24 |
glange | not if he does it from the command line :) | 20:24 |
clayg | so.... the only way to fix things is more capacity is good enough | 20:24 |
InAnimaTe | yeah as i was about to say, deletes are failing hard | 20:24 |
clayg | glange: i have no idea the joke you're trying to spin - if you're just blowing aways stuff on the file system swift is going to fight you every step of the way | 20:25 |
glange | it will replicate back for sure | 20:25 |
clayg | InAnimaTe: Step 1 - DISKS! go find them - the fire will wait | 20:25 |
glange | so, yeah, I guess I see what you mean | 20:25 |
clayg | or at least it can't get any bigger | 20:25 |
glange | you could turn off replication, carefully delete some different partitions from each node, then you should be able to do deletes through swift? | 20:26 |
*** thurloat is now known as thurloat_isgone | 20:26 | |
InAnimaTe | ^so yeah, thats the basically the idea i had | 20:27 |
InAnimaTe | manually go in and remove objects i know are replicated in other zones | 20:27 |
InAnimaTe | clayg: can't spend money :( | 20:28 |
clayg | glange: so like reduce the replication factor on some partitions by hand long enough to get some tombstones to free up space - then when you turn the replicators on bring the parts back to full durability will have enough room.... I've never tried that | 20:28 |
clayg | maybe as long as you're really careful not to delete more than two replicas of a part - it could work - untested | 20:29 |
glange | yeah, there is some chance of data loss | 20:30 |
clayg | er... more than one - don't delete two - if the cluster is full you may not have 3 of everything - you may not have 2 of everything :\ | 20:30 |
glange | yeah | 20:30 |
glange | clayg: you don't have a script for this? :) | 20:32 |
clayg | idk, if you could swap in a spare device (keep the full one around for later) at the same time you reduce the replica count in the ring - I think it work out to the same thing - with less change of stuff getting lost | 20:33 |
*** annegentle has quit IRC | 20:39 | |
*** annegentle has joined #openstack-swift | 20:39 | |
*** vjujjuri_ has joined #openstack-swift | 20:40 | |
ahale | you;ll need to be careful not to delete asncs if you're deleting stuff or wiping drives | 20:40 |
*** vinsh_ has joined #openstack-swift | 20:43 | |
*** vjujjuri_ is now known as vjujjuri | 20:44 | |
*** vinsh has quit IRC | 20:46 | |
dfg_ | all of this sounds crazy | 20:48 |
*** B4rker has joined #openstack-swift | 20:48 | |
clayg | ahale: a's and c's - nice | 20:50 |
ahale | ah yeah asyncs even | 20:51 |
clayg | ahale: oh - i thought it was some cute abbreviation for accounts and containers - yeah asyncs - also a good point! | 20:51 |
ahale | i like that my terrible typing can be mistaken for coolness | 20:53 |
clayg | InAnimaTe: you should just add more disks - maybe you could start a kickstarter or something "overstressed underfunded ops - needs hard disks" | 20:53 |
clayg | ahale: IME ahale is basically a synonym for cool - everyone's going to be calling them asncs now | 20:53 |
*** silor has quit IRC | 20:54 | |
*** vinsh has joined #openstack-swift | 20:59 | |
*** vinsh_ has quit IRC | 21:03 | |
*** B4rker has quit IRC | 21:06 | |
*** Dieterbe_ has joined #openstack-swift | 21:07 | |
MooingLemur | eh syncs | 21:07 |
*** anderstj has quit IRC | 21:09 | |
*** ekarlso has quit IRC | 21:09 | |
*** ndk_ has quit IRC | 21:09 | |
*** wolsen has quit IRC | 21:09 | |
*** tanee has quit IRC | 21:09 | |
*** dmsimard has quit IRC | 21:09 | |
*** ctennis has quit IRC | 21:09 | |
*** Dieterbe has quit IRC | 21:09 | |
*** ctennis has joined #openstack-swift | 21:10 | |
*** wolsen has joined #openstack-swift | 21:10 | |
*** ekarlso has joined #openstack-swift | 21:10 | |
*** B4rker has joined #openstack-swift | 21:10 | |
*** tanee has joined #openstack-swift | 21:11 | |
*** dmsimard has joined #openstack-swift | 21:11 | |
*** ndk has joined #openstack-swift | 21:11 | |
*** anderstj has joined #openstack-swift | 21:11 | |
*** ctennis has quit IRC | 21:12 | |
*** ctennis has joined #openstack-swift | 21:12 | |
*** haomaiwa_ has quit IRC | 21:21 | |
clayg | is "invalid" reall the best status for dupe in launchpad? | 21:22 |
notmyname | clayg: unfortunately :-( | 21:22 |
*** B4rker has quit IRC | 21:23 | |
*** aerwin has quit IRC | 21:32 | |
*** annegentle has quit IRC | 21:32 | |
*** vjujjuri has quit IRC | 21:34 | |
clayg | hey mattoliverau and peluse - looking at rsync compression - i see a for node in get_more_nodes loop that I think is exahusting every db | 21:34 |
openstackgerrit | Samuel Merritt proposed openstack/swift-specs: Symlinks in Swift https://review.openstack.org/173609 | 21:39 |
*** vjujjuri has joined #openstack-swift | 21:39 | |
clayg | I think instead of all the plumbing on "different_region" kwarg just to get the optional compression flag down there - we should just get a _local_region(s) attribute on the DBReplicator instance right next to where we build up the _local_device_ids set | 21:39 |
*** thurloat_isgone is now known as thurloat | 21:52 | |
*** jrichli has quit IRC | 21:52 | |
*** proteusguy has quit IRC | 22:05 | |
*** vjujjuri has quit IRC | 22:05 | |
*** NM1 has joined #openstack-swift | 22:08 | |
*** vinsh has quit IRC | 22:08 | |
*** nadeem has quit IRC | 22:08 | |
*** NM has quit IRC | 22:08 | |
*** NM1 has quit IRC | 22:11 | |
mattoliverau | Morning again | 22:13 |
*** omame has quit IRC | 22:18 | |
*** jamielennox|away is now known as jamielennox | 22:19 | |
*** wbhuber has quit IRC | 22:22 | |
ho | mattoliverau: morning! | 22:23 |
*** asettle has joined #openstack-swift | 22:32 | |
*** blmartin has quit IRC | 22:33 | |
*** ekarlso has quit IRC | 22:34 | |
*** ekarlso has joined #openstack-swift | 22:34 | |
openstackgerrit | Hisashi Osanai proposed openstack/swift: Enable Object Replicator's failure count in recon https://review.openstack.org/138342 | 22:34 |
*** ChanServ sets mode: +v mattoliverau | 22:40 | |
*** omame has joined #openstack-swift | 22:40 | |
-openstackstatus- NOTICE: Gerrit and Zuul are going offline for reboots to fix a security vulnerability. | 22:41 | |
*** ChanServ changes topic to "Gerrit and Zuul are going offline for reboots to fix a security vulnerability." | 22:41 | |
notmyname | https://www.surveymonkey.com/s/77H6SSL <-- a small survey about openstack that will be used in a talk next week (not by me) | 22:42 |
clayg | notmyname: i can think back that far - how many months is "all of them" | 22:43 |
clayg | notmyname: nm - it lets me type in "all of them" | 22:45 |
*** openstackgerrit has quit IRC | 22:47 | |
*** openstackgerrit has joined #openstack-swift | 22:49 | |
clayg | I'm not going to submit this - "throw away" != "re-architect" | 22:53 |
clayg | bad tech orgs will often fail trying to 'throw away' a successful system - bad tech orgs will often fail trying 'to keep the wheels on' a successful system that's outgrown it's design - obviously continuous re-architecture of the parts of the system that need it the only path to success; but I'm not going to help some one argue some portion of OpenStack needs to be throw out and redone from scratch? | 22:56 |
*** ChanServ changes topic to "Review Dashboard: http://goo.gl/8IUcKl | Summary Dashboard: http://goo.gl/qHus5v | Summit scheduling: https://etherpad.openstack.org/p/liberty-swift-summit-topics | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/" | 22:59 | |
-openstackstatus- NOTICE: Gerrit and Zuul are back online. | 22:59 | |
*** km has joined #openstack-swift | 22:59 | |
notmyname | clayg: I first did "all of them" then it did an int validation | 23:03 |
*** cutforth has quit IRC | 23:03 | |
*** sc has quit IRC | 23:20 | |
zackmdavis | clayg, can you protest by submitting "Other" for all the throw-out/rearchitecture question? | 23:20 |
clayg | no | 23:21 |
*** sc has joined #openstack-swift | 23:22 | |
*** ho has quit IRC | 23:28 | |
*** kei_yama has joined #openstack-swift | 23:28 | |
*** zhill has joined #openstack-swift | 23:33 | |
*** mahatic has quit IRC | 23:42 | |
*** ho has joined #openstack-swift | 23:44 | |
openstackgerrit | John Dickinson proposed openstack/python-swiftclient: be more explicit in the --version CLI option https://review.openstack.org/182892 | 23:46 |
*** vjujjuri has joined #openstack-swift | 23:49 | |
notmyname | http://ibmresearchnews.blogspot.com/2015/05/deep-dive-insights-into-swift.html <-- teaser/preview of a swift talk IBM is giving next week | 23:49 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!