Sunday, 2014-08-31

*** tumf has quit IRC00:22
*** yuanz has quit IRC00:22
*** yuanz has joined #openstack-swift00:24
*** shakamunyi has joined #openstack-swift00:24
*** zul has joined #openstack-swift00:42
*** HenryG_afk is now known as HenryG00:57
*** shakamunyi_ has joined #openstack-swift01:02
*** developer has joined #openstack-swift01:08
*** tumf has joined #openstack-swift01:18
*** miqui has joined #openstack-swift01:32
*** zul has quit IRC01:51
*** tumf has quit IRC01:52
*** tumf has joined #openstack-swift02:48
*** tumf has quit IRC03:21
openstackgerritGil Vernik proposed a change to openstack/swift: On demand data migration for Swift  https://review.openstack.org/6443004:07
*** tumf has joined #openstack-swift04:18
openstackgerritA change was merged to openstack/swift: container merge_items speedup  https://review.openstack.org/11699204:29
openstackgerritA change was merged to openstack/swift: Allow empty reseller prefixes in domain_remap  https://review.openstack.org/8995504:29
developerI am trying to issue a HEAD request to my proxy server04:43
developerand am using tempauth04:43
developerhowever, I keep getting an HTTP 503: Internal Server Error / Service Unavailable04:43
developerand the logs have something along the lines of "...swift: ERROR with Account server <ip_address_omitted>:6002/sdb1 re: Trying to HEAD /v1/.expiring_objects: Connection refused"04:44
developerDoes anyone know what is going wrong here?04:44
developer(In the actual logs, the actual IP address shows up instead of <ip_address_omitted>)04:46
developerjust to clarify04:46
*** shakamunyi_ has quit IRC04:47
*** shakamunyi has quit IRC04:47
developerany list of possible explanations would be appreciated. Thank you!04:50
*** tumf has quit IRC04:51
*** haomaiwang has joined #openstack-swift05:39
*** shakamunyi has joined #openstack-swift05:43
*** shakamunyi has quit IRC05:48
*** tumf has joined #openstack-swift05:48
*** haomaiwang has quit IRC06:03
*** haomaiwang has joined #openstack-swift06:04
*** developer has quit IRC06:08
*** tkay has joined #openstack-swift06:19
*** haomai___ has joined #openstack-swift06:19
*** tumf has quit IRC06:21
*** haomaiwang has quit IRC06:21
*** shakamunyi has joined #openstack-swift06:44
*** shakamunyi has quit IRC06:48
*** tkay has quit IRC07:07
*** tumf has joined #openstack-swift07:18
*** shakamunyi has joined #openstack-swift07:41
*** shakamunyi has quit IRC07:46
*** tumf has quit IRC07:51
*** early has quit IRC08:12
*** early has joined #openstack-swift08:16
*** tab__ has joined #openstack-swift08:22
*** shakamunyi has joined #openstack-swift08:42
*** tkay has joined #openstack-swift08:44
*** shakamunyi has quit IRC08:46
*** tumf has joined #openstack-swift08:48
*** bkopilov has joined #openstack-swift08:54
*** tumf has quit IRC09:21
*** tkay has quit IRC09:29
*** bvandenh has quit IRC09:29
*** bvandenh has joined #openstack-swift09:32
*** shakamunyi has joined #openstack-swift09:42
*** shakamunyi has quit IRC09:47
*** mkollaro has joined #openstack-swift09:49
*** tumf has joined #openstack-swift10:18
*** tumf has quit IRC10:43
*** shakamunyi has joined #openstack-swift10:43
*** tumf has joined #openstack-swift10:43
*** bvandenh has quit IRC10:44
*** shakamunyi has quit IRC10:48
*** tab__ has quit IRC11:11
*** shakamunyi has joined #openstack-swift11:44
*** shakamunyi has quit IRC11:49
*** mkollaro has quit IRC12:10
*** mkollaro has joined #openstack-swift12:12
*** morganfainberg has quit IRC12:41
*** morganfainberg has joined #openstack-swift12:43
*** shakamunyi has joined #openstack-swift12:45
*** morganfainberg has quit IRC12:46
*** morganfainberg has joined #openstack-swift12:46
*** shakamunyi has quit IRC12:49
*** akp has joined #openstack-swift12:54
*** akp_ has quit IRC12:57
*** lpabon has quit IRC12:59
*** lpabon has joined #openstack-swift13:14
*** tumf has quit IRC13:45
*** tumf has joined #openstack-swift13:45
*** tumf has quit IRC13:50
*** Midnightmyth has joined #openstack-swift14:22
*** bkopilov has quit IRC15:45
*** tumf has joined #openstack-swift15:45
*** mahatic has joined #openstack-swift15:53
*** tumf has quit IRC16:03
*** tumf has joined #openstack-swift16:03
*** tumf has quit IRC16:05
*** mahatic has quit IRC16:22
*** mahatic has joined #openstack-swift16:48
pelusedeveloper: if you can post the full log with the error in it that would help - 503 is just a generic 'something went wrong' error so not much to go on16:54
*** mahatic has quit IRC16:57
*** mahatic has joined #openstack-swift17:16
*** joeljwright has joined #openstack-swift17:30
*** mahatic has quit IRC17:45
*** mkollaro has quit IRC18:55
*** fifieldt_ has quit IRC20:11
*** fifieldt_ has joined #openstack-swift20:24
*** joeljwright has quit IRC20:38
*** shakamunyi has joined #openstack-swift20:51
*** shakamunyi has quit IRC20:56
*** developer has joined #openstack-swift21:34
developerI am trying to issue a HEAD request to my proxy server21:39
developerand am using tempauth21:39
developerhowever, I keep getting an HTTP 503: Internal Server Error / Service Unavailable21:39
developerand the logs have something along the lines of "...swift: ERROR with Account server <ip_address_omitted>:6002/sdb1 re: Trying to HEAD /v1/.expiring_objects: Connection refused"21:40
developerDoes anyone know what is going wrong here?21:40
ctennisis your account server running at that IP address and listening on port 6002?21:41
developer(In the actual logs, the actual IP address shows up instead of <ip_address_omitted>, and both a public IP address and a private IP address were tried when debugging)21:41
developerIn the account-server.conf file21:44
developerI have it set up to have bind_ip = 127.0.0.1 and bind_port = 600221:44
developer<ip_address_omitted> in the lines above is the IP address of the account server21:50
developerwhich is technically the IP address of the whole setup, since I am manually configuring the proxy, account, container, and object service to all be in one node.21:50
developerso the bind_ip = 127.0.0.1 may or may not be okay.21:51
*** shakamunyi has joined #openstack-swift21:52
developerhmm after changing bind_ip to be the actual public IP of the account server, I am getting "HTTP/1.1 400 Bad Request" whenever issuing a HEAD request to the proxy.21:56
developerto the Swift* proxy21:56
*** shakamunyi has quit IRC21:57
developerspeaking of which, what port # should the proxy service be listening on?21:59
pelusedeveloper:  what instructions did you follow to install your Swift, the SAIO?21:59
pelusedeveloper:  here:  http://docs.openstack.org/developer/swift/development_saio.html22:00
developerthanks22:00
developerI'm actually aware of that one22:00
developerbut I used http://docs.openstack.org/developer/swift/howto_installmultinode.html instead,22:00
developersince I'm planning on extending my cluster to have more than one node.22:01
developerthis one-node cluster setup is temporary.22:01
peluseOK, give me a minute... looking at the directions you followeed22:02
pelusecan you post your .conf files and the log with error 503 in it somewhere (a gist or something)?22:06
*** Midnightmyth has quit IRC22:08
peluseand while you're doing that I don't totally understand your reply to ctennis... seeing the full set of .conf files should help clear up confusion though22:09
developerproxy-server.conf:22:13
developer[DEFAULT] bind_port = 8080 workers = 8 user = swift  [pipeline:main] pipeline = healthcheck proxy-logging cache tempauth proxy-logging proxy-server  [app:proxy-server] use = egg:swift#proxy allow_account_management = true account_autocreate = true  [filter:proxy-logging] use = egg:swift#proxy_logging  [filter:tempauth] use = egg:swift#tempauth user_system_root = testpass .admin http://<public_ip_address>:8080/v1/AUTH_sys22:13
developerI wish I could format that better for this IRC channel22:14
peluseyou can post with a git gist, its easy and readable22:14
developerand the error is now actually HTTP/1.1 400 Bad Request22:14
pelusehttps://gist.github.com/22:15
pelusepaste in all your conf files and post as a public gist then paste in the URL here22:15
developerok22:16
developerfirst, proxy-server.conf: https://gist.github.com/anonymous/93bd04b3ebfaddb34ca822:17
peluseI assume there's a real IP address in the actual .conf file?22:18
developeryes, that's correct22:18
developerwhenever you see that tag, it's the IP address of the single-node cluster setup.22:19
developernext, account-server.conf: https://gist.github.com/anonymous/6be114efd1c7a13093d922:19
peluseOK, you can post all the .conf files in the one gist if you like, will be easier to read them all at once22:19
peluseAhh, that's OK then22:19
pelusecan you also paste in the exact cmd you are using when you get the error?22:25
developersure22:25
developercurl -k -v -H 'X-Auth-Token: AUTH_tk18e9rue578294ne58f0e7alc395e0273' http://<public_ip_address>:8080/v1/AUTH_system22:29
developerthat is to send a HEAD request22:29
developerand to obtain the auth token in the first place, I did: curl -k -v -H 'X-Storage-User: system:root' -H 'X-Storage-Pass: testpass' http://<public_ip_address>:8080/auth/v1.022:30
peluseso you're following the steps in the setup guide you posted a min ago?  In the section "Create Swift admin account and test"?22:30
developeryes, that's exactly it22:32
peluseOK, so step 1 there worked w/o an issue then and gave you the token you're using right?22:32
developeryes, it worked just fine22:33
developercorrect22:33
peluseOK, give me a few min.  having unrelated technical issues on my end :)22:33
developerok, thank you!22:33
peluseso wanted to test something on my end real quick but my VM is busted.  Can you comment out the bind_ip in your account conf file and reboot the whole machine and try again?22:39
pelusedeveloper:  I have to take off for a few hours but give that a shot and let me know via IRC how it goes.  I'll check back in when I get back22:45
developersure, and thanks for the suggestion!22:46
developerI have to take off for a couple of hours as well, but before I do, I will post snippets of the logs to gist.github22:46
developeror at least what I think may be the relevant parts.22:46
peluseOK, cool.  We'll get ya going one way or another.  If that change doesn't help I'll run through those directions on my end on a fresh VM and either be able to debug it and get you an answer or have a nice conf you can compare to in order to see what's wrong22:49
*** shakamunyi has joined #openstack-swift22:53
*** Midnightmyth has joined #openstack-swift22:55
developerAll right, thanks. Here are the logs for swift.log, proxy.log, and account.log, by the way. I curtailed them, but for the most part they repeat what I have posted here: https://gist.github.com/anonymous/1fda4f140b1cc5787a1c22:57
*** shakamunyi has quit IRC22:58
developerI'll also update you with anything I am able to do before you return to this22:58
developerI will probably be automatically logged out (timed out) of this channel by the time I am able to come back, but I will check the logs for anything you have posted.23:00
developer(will check the IRC logs)23:00
developerupdate: I commented out the bind_ip in the account conf file as you've suggested, and then did a "swift-init all restart", then tried testing the curl requests again, but the HEAD request still returns an "HTTP/1.1 400 Bad Request"23:11
developerHad I had more time, I probably would have done a reboot of the whole machine before the "swift-init all restart", but I'm not sure if that would make a difference.23:12
*** sungju has joined #openstack-swift23:15
developeralso, the swift.log, proxy.log, account.log from a brief glance seem to have reported mostly the same/similar outputs, except proxy.log doesn't seem to have recorded anything new for the most recent try.23:16
developerthe log text could be taking a while to appear, though.23:19
developeras a possible explanation.23:19
*** Midnightmyth has quit IRC23:21
*** matt___ is now known as mattoliverau23:24
mattoliverauMorning all!23:29
*** perfectredneck has joined #openstack-swift23:31
*** perfectredneck has quit IRC23:31
*** baawurfing has joined #openstack-swift23:34
*** baawurfing has quit IRC23:34
*** silverpuff has joined #openstack-swift23:36
mattoliverauSo it's finally the end of winter, and now my body decides to succomb to peer pressure and catch a cold/flu :( if I ramble more then usual in reviews then I blame drugs :p23:43
*** silverpuff has quit IRC23:45
*** dandelionblighte has joined #openstack-swift23:49
*** dandelionblighte has quit IRC23:52
*** shakamunyi has joined #openstack-swift23:53
*** silverpuff has joined #openstack-swift23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!