*** tumf has quit IRC | 00:22 | |
*** yuanz has quit IRC | 00:22 | |
*** yuanz has joined #openstack-swift | 00:24 | |
*** shakamunyi has joined #openstack-swift | 00:24 | |
*** zul has joined #openstack-swift | 00:42 | |
*** HenryG_afk is now known as HenryG | 00:57 | |
*** shakamunyi_ has joined #openstack-swift | 01:02 | |
*** developer has joined #openstack-swift | 01:08 | |
*** tumf has joined #openstack-swift | 01:18 | |
*** miqui has joined #openstack-swift | 01:32 | |
*** zul has quit IRC | 01:51 | |
*** tumf has quit IRC | 01:52 | |
*** tumf has joined #openstack-swift | 02:48 | |
*** tumf has quit IRC | 03:21 | |
openstackgerrit | Gil Vernik proposed a change to openstack/swift: On demand data migration for Swift https://review.openstack.org/64430 | 04:07 |
---|---|---|
*** tumf has joined #openstack-swift | 04:18 | |
openstackgerrit | A change was merged to openstack/swift: container merge_items speedup https://review.openstack.org/116992 | 04:29 |
openstackgerrit | A change was merged to openstack/swift: Allow empty reseller prefixes in domain_remap https://review.openstack.org/89955 | 04:29 |
developer | I am trying to issue a HEAD request to my proxy server | 04:43 |
developer | and am using tempauth | 04:43 |
developer | however, I keep getting an HTTP 503: Internal Server Error / Service Unavailable | 04:43 |
developer | and the logs have something along the lines of "...swift: ERROR with Account server <ip_address_omitted>:6002/sdb1 re: Trying to HEAD /v1/.expiring_objects: Connection refused" | 04:44 |
developer | Does anyone know what is going wrong here? | 04:44 |
developer | (In the actual logs, the actual IP address shows up instead of <ip_address_omitted>) | 04:46 |
developer | just to clarify | 04:46 |
*** shakamunyi_ has quit IRC | 04:47 | |
*** shakamunyi has quit IRC | 04:47 | |
developer | any list of possible explanations would be appreciated. Thank you! | 04:50 |
*** tumf has quit IRC | 04:51 | |
*** haomaiwang has joined #openstack-swift | 05:39 | |
*** shakamunyi has joined #openstack-swift | 05:43 | |
*** shakamunyi has quit IRC | 05:48 | |
*** tumf has joined #openstack-swift | 05:48 | |
*** haomaiwang has quit IRC | 06:03 | |
*** haomaiwang has joined #openstack-swift | 06:04 | |
*** developer has quit IRC | 06:08 | |
*** tkay has joined #openstack-swift | 06:19 | |
*** haomai___ has joined #openstack-swift | 06:19 | |
*** tumf has quit IRC | 06:21 | |
*** haomaiwang has quit IRC | 06:21 | |
*** shakamunyi has joined #openstack-swift | 06:44 | |
*** shakamunyi has quit IRC | 06:48 | |
*** tkay has quit IRC | 07:07 | |
*** tumf has joined #openstack-swift | 07:18 | |
*** shakamunyi has joined #openstack-swift | 07:41 | |
*** shakamunyi has quit IRC | 07:46 | |
*** tumf has quit IRC | 07:51 | |
*** early has quit IRC | 08:12 | |
*** early has joined #openstack-swift | 08:16 | |
*** tab__ has joined #openstack-swift | 08:22 | |
*** shakamunyi has joined #openstack-swift | 08:42 | |
*** tkay has joined #openstack-swift | 08:44 | |
*** shakamunyi has quit IRC | 08:46 | |
*** tumf has joined #openstack-swift | 08:48 | |
*** bkopilov has joined #openstack-swift | 08:54 | |
*** tumf has quit IRC | 09:21 | |
*** tkay has quit IRC | 09:29 | |
*** bvandenh has quit IRC | 09:29 | |
*** bvandenh has joined #openstack-swift | 09:32 | |
*** shakamunyi has joined #openstack-swift | 09:42 | |
*** shakamunyi has quit IRC | 09:47 | |
*** mkollaro has joined #openstack-swift | 09:49 | |
*** tumf has joined #openstack-swift | 10:18 | |
*** tumf has quit IRC | 10:43 | |
*** shakamunyi has joined #openstack-swift | 10:43 | |
*** tumf has joined #openstack-swift | 10:43 | |
*** bvandenh has quit IRC | 10:44 | |
*** shakamunyi has quit IRC | 10:48 | |
*** tab__ has quit IRC | 11:11 | |
*** shakamunyi has joined #openstack-swift | 11:44 | |
*** shakamunyi has quit IRC | 11:49 | |
*** mkollaro has quit IRC | 12:10 | |
*** mkollaro has joined #openstack-swift | 12:12 | |
*** morganfainberg has quit IRC | 12:41 | |
*** morganfainberg has joined #openstack-swift | 12:43 | |
*** shakamunyi has joined #openstack-swift | 12:45 | |
*** morganfainberg has quit IRC | 12:46 | |
*** morganfainberg has joined #openstack-swift | 12:46 | |
*** shakamunyi has quit IRC | 12:49 | |
*** akp has joined #openstack-swift | 12:54 | |
*** akp_ has quit IRC | 12:57 | |
*** lpabon has quit IRC | 12:59 | |
*** lpabon has joined #openstack-swift | 13:14 | |
*** tumf has quit IRC | 13:45 | |
*** tumf has joined #openstack-swift | 13:45 | |
*** tumf has quit IRC | 13:50 | |
*** Midnightmyth has joined #openstack-swift | 14:22 | |
*** bkopilov has quit IRC | 15:45 | |
*** tumf has joined #openstack-swift | 15:45 | |
*** mahatic has joined #openstack-swift | 15:53 | |
*** tumf has quit IRC | 16:03 | |
*** tumf has joined #openstack-swift | 16:03 | |
*** tumf has quit IRC | 16:05 | |
*** mahatic has quit IRC | 16:22 | |
*** mahatic has joined #openstack-swift | 16:48 | |
peluse | developer: if you can post the full log with the error in it that would help - 503 is just a generic 'something went wrong' error so not much to go on | 16:54 |
*** mahatic has quit IRC | 16:57 | |
*** mahatic has joined #openstack-swift | 17:16 | |
*** joeljwright has joined #openstack-swift | 17:30 | |
*** mahatic has quit IRC | 17:45 | |
*** mkollaro has quit IRC | 18:55 | |
*** fifieldt_ has quit IRC | 20:11 | |
*** fifieldt_ has joined #openstack-swift | 20:24 | |
*** joeljwright has quit IRC | 20:38 | |
*** shakamunyi has joined #openstack-swift | 20:51 | |
*** shakamunyi has quit IRC | 20:56 | |
*** developer has joined #openstack-swift | 21:34 | |
developer | I am trying to issue a HEAD request to my proxy server | 21:39 |
developer | and am using tempauth | 21:39 |
developer | however, I keep getting an HTTP 503: Internal Server Error / Service Unavailable | 21:39 |
developer | and the logs have something along the lines of "...swift: ERROR with Account server <ip_address_omitted>:6002/sdb1 re: Trying to HEAD /v1/.expiring_objects: Connection refused" | 21:40 |
developer | Does anyone know what is going wrong here? | 21:40 |
ctennis | is your account server running at that IP address and listening on port 6002? | 21:41 |
developer | (In the actual logs, the actual IP address shows up instead of <ip_address_omitted>, and both a public IP address and a private IP address were tried when debugging) | 21:41 |
developer | In the account-server.conf file | 21:44 |
developer | I have it set up to have bind_ip = 127.0.0.1 and bind_port = 6002 | 21:44 |
developer | <ip_address_omitted> in the lines above is the IP address of the account server | 21:50 |
developer | which is technically the IP address of the whole setup, since I am manually configuring the proxy, account, container, and object service to all be in one node. | 21:50 |
developer | so the bind_ip = 127.0.0.1 may or may not be okay. | 21:51 |
*** shakamunyi has joined #openstack-swift | 21:52 | |
developer | hmm after changing bind_ip to be the actual public IP of the account server, I am getting "HTTP/1.1 400 Bad Request" whenever issuing a HEAD request to the proxy. | 21:56 |
developer | to the Swift* proxy | 21:56 |
*** shakamunyi has quit IRC | 21:57 | |
developer | speaking of which, what port # should the proxy service be listening on? | 21:59 |
peluse | developer: what instructions did you follow to install your Swift, the SAIO? | 21:59 |
peluse | developer: here: http://docs.openstack.org/developer/swift/development_saio.html | 22:00 |
developer | thanks | 22:00 |
developer | I'm actually aware of that one | 22:00 |
developer | but I used http://docs.openstack.org/developer/swift/howto_installmultinode.html instead, | 22:00 |
developer | since I'm planning on extending my cluster to have more than one node. | 22:01 |
developer | this one-node cluster setup is temporary. | 22:01 |
peluse | OK, give me a minute... looking at the directions you followeed | 22:02 |
peluse | can you post your .conf files and the log with error 503 in it somewhere (a gist or something)? | 22:06 |
*** Midnightmyth has quit IRC | 22:08 | |
peluse | and while you're doing that I don't totally understand your reply to ctennis... seeing the full set of .conf files should help clear up confusion though | 22:09 |
developer | proxy-server.conf: | 22:13 |
developer | [DEFAULT] bind_port = 8080 workers = 8 user = swift [pipeline:main] pipeline = healthcheck proxy-logging cache tempauth proxy-logging proxy-server [app:proxy-server] use = egg:swift#proxy allow_account_management = true account_autocreate = true [filter:proxy-logging] use = egg:swift#proxy_logging [filter:tempauth] use = egg:swift#tempauth user_system_root = testpass .admin http://<public_ip_address>:8080/v1/AUTH_sys | 22:13 |
developer | I wish I could format that better for this IRC channel | 22:14 |
peluse | you can post with a git gist, its easy and readable | 22:14 |
developer | and the error is now actually HTTP/1.1 400 Bad Request | 22:14 |
peluse | https://gist.github.com/ | 22:15 |
peluse | paste in all your conf files and post as a public gist then paste in the URL here | 22:15 |
developer | ok | 22:16 |
developer | first, proxy-server.conf: https://gist.github.com/anonymous/93bd04b3ebfaddb34ca8 | 22:17 |
peluse | I assume there's a real IP address in the actual .conf file? | 22:18 |
developer | yes, that's correct | 22:18 |
developer | whenever you see that tag, it's the IP address of the single-node cluster setup. | 22:19 |
developer | next, account-server.conf: https://gist.github.com/anonymous/6be114efd1c7a13093d9 | 22:19 |
peluse | OK, you can post all the .conf files in the one gist if you like, will be easier to read them all at once | 22:19 |
peluse | Ahh, that's OK then | 22:19 |
peluse | can you also paste in the exact cmd you are using when you get the error? | 22:25 |
developer | sure | 22:25 |
developer | curl -k -v -H 'X-Auth-Token: AUTH_tk18e9rue578294ne58f0e7alc395e0273' http://<public_ip_address>:8080/v1/AUTH_system | 22:29 |
developer | that is to send a HEAD request | 22:29 |
developer | and to obtain the auth token in the first place, I did: curl -k -v -H 'X-Storage-User: system:root' -H 'X-Storage-Pass: testpass' http://<public_ip_address>:8080/auth/v1.0 | 22:30 |
peluse | so you're following the steps in the setup guide you posted a min ago? In the section "Create Swift admin account and test"? | 22:30 |
developer | yes, that's exactly it | 22:32 |
peluse | OK, so step 1 there worked w/o an issue then and gave you the token you're using right? | 22:32 |
developer | yes, it worked just fine | 22:33 |
developer | correct | 22:33 |
peluse | OK, give me a few min. having unrelated technical issues on my end :) | 22:33 |
developer | ok, thank you! | 22:33 |
peluse | so wanted to test something on my end real quick but my VM is busted. Can you comment out the bind_ip in your account conf file and reboot the whole machine and try again? | 22:39 |
peluse | developer: I have to take off for a few hours but give that a shot and let me know via IRC how it goes. I'll check back in when I get back | 22:45 |
developer | sure, and thanks for the suggestion! | 22:46 |
developer | I have to take off for a couple of hours as well, but before I do, I will post snippets of the logs to gist.github | 22:46 |
developer | or at least what I think may be the relevant parts. | 22:46 |
peluse | OK, cool. We'll get ya going one way or another. If that change doesn't help I'll run through those directions on my end on a fresh VM and either be able to debug it and get you an answer or have a nice conf you can compare to in order to see what's wrong | 22:49 |
*** shakamunyi has joined #openstack-swift | 22:53 | |
*** Midnightmyth has joined #openstack-swift | 22:55 | |
developer | All right, thanks. Here are the logs for swift.log, proxy.log, and account.log, by the way. I curtailed them, but for the most part they repeat what I have posted here: https://gist.github.com/anonymous/1fda4f140b1cc5787a1c | 22:57 |
*** shakamunyi has quit IRC | 22:58 | |
developer | I'll also update you with anything I am able to do before you return to this | 22:58 |
developer | I will probably be automatically logged out (timed out) of this channel by the time I am able to come back, but I will check the logs for anything you have posted. | 23:00 |
developer | (will check the IRC logs) | 23:00 |
developer | update: I commented out the bind_ip in the account conf file as you've suggested, and then did a "swift-init all restart", then tried testing the curl requests again, but the HEAD request still returns an "HTTP/1.1 400 Bad Request" | 23:11 |
developer | Had I had more time, I probably would have done a reboot of the whole machine before the "swift-init all restart", but I'm not sure if that would make a difference. | 23:12 |
*** sungju has joined #openstack-swift | 23:15 | |
developer | also, the swift.log, proxy.log, account.log from a brief glance seem to have reported mostly the same/similar outputs, except proxy.log doesn't seem to have recorded anything new for the most recent try. | 23:16 |
developer | the log text could be taking a while to appear, though. | 23:19 |
developer | as a possible explanation. | 23:19 |
*** Midnightmyth has quit IRC | 23:21 | |
*** matt___ is now known as mattoliverau | 23:24 | |
mattoliverau | Morning all! | 23:29 |
*** perfectredneck has joined #openstack-swift | 23:31 | |
*** perfectredneck has quit IRC | 23:31 | |
*** baawurfing has joined #openstack-swift | 23:34 | |
*** baawurfing has quit IRC | 23:34 | |
*** silverpuff has joined #openstack-swift | 23:36 | |
mattoliverau | So it's finally the end of winter, and now my body decides to succomb to peer pressure and catch a cold/flu :( if I ramble more then usual in reviews then I blame drugs :p | 23:43 |
*** silverpuff has quit IRC | 23:45 | |
*** dandelionblighte has joined #openstack-swift | 23:49 | |
*** dandelionblighte has quit IRC | 23:52 | |
*** shakamunyi has joined #openstack-swift | 23:53 | |
*** silverpuff has joined #openstack-swift | 23:56 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!