Ask Your Question
1

update failed: 503 service unavailable

asked 2011-03-22 07:59:04 -0500

zyh-at-bupt gravatar image

when I create openstack object storage admin account, this problem happens. after I input: swift-auth-add-user -K devauth -a system root testpass the terminal output: update failed: 503 service unavailable

the /var/log/syslog is as follow: Mar 22 15:40:17 swift-desktop auth-server validate_token('AUTH_tk9ca08031dd164712a25c36e05131aee0', _, _) = (86399.977941989899, '.super_admin', '.single_use', '.reseller_admin') [0.00] Mar 22 15:40:17 swift-desktop auth-server 127.0.0.1 - - [22/Mar/2011:07:40:17 +0000] "GET /token/AUTH_tk9ca08031dd164712a25c36e05131aee0 HTTP/1.0" 204 - "-" "-" - - - - - - - - - "-" "127.0.0.1" "-" 0.0038 Mar 22 15:40:17 swift-desktop proxy-server ERROR with Account server 192.168.1.125:6004/sda8 re: Trying to PUT to /v1/AUTH_20f431da534d444899e34f5d551d8498: Connection refused (txn: txc7ff39aa-bfc3-425e-b596-d0c75304e6e6) Mar 22 15:40:17 swift-desktop proxy-server ERROR with Account server 192.168.1.125:6003/sda7 re: Trying to PUT to /v1/AUTH_20f431da534d444899e34f5d551d8498: Connection refused (txn: txc7ff39aa-bfc3-425e-b596-d0c75304e6e6) Mar 22 15:40:17 swift-desktop proxy-server Account PUT returning 503 for [400, 201, 503] (txn: txc7ff39aa-bfc3-425e-b596-d0c75304e6e6) Mar 22 15:40:17 swift-desktop auth-server ERROR attempting to create account https://swift-desktop:8080/v1/AUTH_20f431da534d444899e34f5d551d8498 (https://swift-desktop:8080/v1/AUTH_20...) : 503 Internal Server Error Mar 22 15:40:17 swift-desktop auth-server FAILED create_user('system', 'root', _, True, False) [0.05] Mar 22 15:40:17 swift-desktop auth-server 127.0.0.1 - - [22/Mar/2011:07:40:17 +0000] "PUT /account/system/root HTTP/1.0" 503 - "-" "-" - - - - - - - - - "-" "127.0.0.1" "-" 0.0511 Mar 22 15:40:17 swift-desktop proxy-server - 127.0.1.1 22/Mar/2011/07/40/17 PUT /v1/AUTH_20f431da534d444899e34f5d551d8498 HTTP/1.0 503 - - .super_admin%3A.single_use%2CAUTH_tk9ca08031dd164712a25c36e05131aee0 - - - txc7ff39aa-bfc3-425e-b596-d0c75304e6e6 - 0.0281

edit retag flag offensive close merge delete

18 answers

Sort by ยป oldest newest most voted
0

answered 2011-03-25 09:32:01 -0500

zyh-at-bupt gravatar image

and the syslog on the storage node is as follow:

Mar 25 17:24:38 swift-desktop account-server ERROR __call__ error with PUT /sda5/40821/AUTH_cadad33181144d32af4d0f6ceea9bdba : #012Traceback (most recent call last):#012 File "/usr/lib/pymodules/python2.6/swift/account/server.py", line 305, in __call__#012 res = getattr(self, req.method)(req)#012 File "/usr/lib/pymodules/python2.6/swift/account/server.py", line 106, in PUT#012 broker.initialize(timestamp)#012 File "/usr/lib/pymodules/python2.6/swift/common/db.py", line 179, in initialize#012 mkdirs(self.db_dir)#012 File "/usr/lib/pymodules/python2.6/swift/common/utils.py", line 170, in mkdirs#012 os.makedirs(path)#012 File "/usr/lib/python2.6/os.py", line 150, in makedirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.6/os.py", line 150, in makedirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.6/os.py", line 150, in makedirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.6/os.py", line 157, in makedirs#012 mkdir(name, mode)#012OSError: [Errno 13] Permission denied: '/srv/node/sda5/accounts' (txn: txa9d5b4f6-2051-462f-8e8f-e1d1fa17c2d1) Mar 25 17:24:38 swift-desktop account-server 192.168.1.127 - - [25/Mar/2011:09:24:38 +0000] "PUT /sda5/40821/AUTH_cadad33181144d32af4d0f6ceea9bdba" 500 873 "txa9d5b4f6-2051-462f-8e8f-e1d1fa17c2d1" "-" "-" 0.0017 "" Mar 25 17:24:38 swift-desktop account-server ERROR __call__ error with PUT /sda7/40821/AUTH_cadad33181144d32af4d0f6ceea9bdba : #012Traceback (most recent call last):#012 File "/usr/lib/pymodules/python2.6/swift/account/server.py", line 305, in __call__#012 res = getattr(self, req.method)(req)#012 File "/usr/lib/pymodules/python2.6/swift/account/server.py", line 106, in PUT#012 broker.initialize(timestamp)#012 File "/usr/lib/pymodules/python2.6/swift/common/db.py", line 179, in initialize#012 mkdirs(self.db_dir)#012 File "/usr/lib/pymodules/python2.6/swift/common/utils.py", line 170, in mkdirs#012 os.makedirs(path)#012 File "/usr/lib/python2.6/os.py", line 150, in makedirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.6/os.py", line 150, in makedirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.6/os.py", line 150, in makedirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.6/os.py", line 157, in makedirs#012 mkdir(name, mode)#012OSError: [Errno 13] Permission denied: '/srv/node/sda7/accounts' (txn: txa9d5b4f6-2051-462f-8e8f-e1d1fa17c2d1) Mar 25 17:24:38 swift-desktop account-server 192.168.1.127 - - [25/Mar/2011:09:24:38 +0000] "PUT /sda7/40821/AUTH_cadad33181144d32af4d0f6ceea9bdba" 500 873 "txa9d5b4f6-2051-462f-8e8f-e1d1fa17c2d1" "-" "-" 0.0015 "" Mar 25 17:24:38 swift-desktop account-server ERROR __call__ error with PUT /sda6/40821/AUTH_cadad33181144d32af4d0f6ceea9bdba : #012Traceback (most recent call last):#012 File "/usr/lib/pymodules/python2.6/swift/account/server.py", line 305, in __call__#012 res = getattr(self, req.method)(req)#012 File "/usr/lib/pymodules/python2.6/swift/account/server.py", line 106, in PUT#012 broker.initialize(timestamp)#012 File "/usr/lib/pymodules/python2.6/swift/common/db.py", line 179, in initialize#012 mkdirs(self.db_dir)#012 File "/usr/lib/pymodules/python2.6/swift ... (more)

edit flag offensive delete link more
0

answered 2011-03-25 14:32:18 -0500

clay-gerrard gravatar image

OK, nice work - looks like you found the problem: Permission denied: '/srv/node/sda6/accounts'

Review the permissions setup docs for a SAIO at: http://swift.openstack.org/development_saio.html#using-a-partition-for-storage (http://swift.openstack.org/developmen...)

or multi-node: http://swift.openstack.org/howto_installmultinode.html#configure-the-storage-nodes (http://swift.openstack.org/howto_inst...)

basically you want to do something like: chown -R <your-user-name>:<your-group-name> /srv/node/sda[5-7]/

You should be able to verify the the user configured on your account-server.conf can create new files on these storage devices...

edit flag offensive delete link more
0

answered 2011-03-28 03:02:35 -0500

zyh-at-bupt gravatar image

hi, clayg, the result is as follow: swift@swift-desktop:~$ sudo swift-auth-add-user -K devauth -a system root testpass https://192.168.1.127:8080/v1/AUTH_b00ca72849ee4d659759e36b56a3d429 (https://192.168.1.127:8080/v1/AUTH_b0...)

Does this mean there is no problem?

next comand is curl -k -v -H 'X-Auth-Token: <token-from-x-auth-token-above>' <url-from-x-storage-url-above>

what is the <token-from-x-auth-token-above> ? and what is the <url-from-x-storage-url-above> ?

thank you very much again!

edit flag offensive delete link more
0

answered 2011-03-28 06:47:36 -0500

zyh-at-bupt gravatar image

Sorry, I don't check the comand carefully, now, the problem has been solved, thank you very much clayg. thank you !

edit flag offensive delete link more
0

answered 2011-04-28 23:21:03 -0500

moubarik-siham gravatar image

tks for you David Goetz i'm so sorry

error is

root@ubuntu:~# swift-auth-add-user -K devauth -a system root testpass Update failed: 503 Service Unavailable

root@ubuntu:~#

file /etc/swift.auth-server.conf

[DEFAULT] cert_file = /etc/swift/cert.crt key_file = /etc/swift/cert.key user = swift [pipeline:main] pipeline = auth-server [app:auth-server] use = egg:swift#auth default_cluster_url = https://127.0.0.1:8080/v1

Highly recommended to change this key to something else!

super_admin_key = devauth

file etc/swift/proxy-server.conf

[DEFAULT] cert_file = /etc/swift/cert.crt key_file = /etc/swift/cert.key

bind_port = 8080 workers = 8 user = swift [pipeline:main] pipeline = healthcheck cache auth proxy-server [app:proxy-server] use = egg:swift#proxy allow_account_management = true [filter:auth] use = egg:swift#auth ssl = true [filter:healthcheck] use = egg:swift#healthcheck [filter:cache] use = egg:swift#memcache

memcache_servers = 127.0.0.1:11211

/var/log/syslog

Apr 27 03:53:21 ubuntu container-replicator Attempted to replicate 0 dbs in 0.00540 seconds (0.00000/s) Apr 27 03:53:21 ubuntu container-replicator Removed 0 dbs Apr 27 03:53:21 ubuntu container-replicator 0 successes, 0 failures Apr 27 03:53:21 ubuntu container-replicator no_change:0 ts_repl:0 diff:0 rsync:0 hashmatch:0 empty:0 Apr 27 03:53:26 ubuntu object-replicator Starting object replication pass. Apr 27 03:53:26 ubuntu object-replicator sda1 is not mounted Apr 27 03:53:26 ubuntu object-replicator sda2 is not mounted Apr 27 03:53:26 ubuntu object-replicator sda3 is not mounted Apr 27 03:53:26 ubuntu object-replicator sda4 is not mounted Apr 27 03:53:26 ubuntu object-replicator Nothing replicated for 0.00181102752686 seconds. Apr 27 03:53:26 ubuntu object-replicator Object replication complete. (0.00 minutes) Apr 27 03:53:26 ubuntu proxy-server Error talking to memcached: 127.0.0.1:11211#012Traceback (most recent call last):#012 File "/usr/lib/pymodules/python2.6/swift/common/memcached.py", line 156, in get#012 while line[0].upper() != 'END':#012IndexError: list index out of range Apr 27 03:53:26 ubuntu auth-server validate_token('AUTH_tk7aa1868631f24460ae776dbeb67c6817', _, _) = (86399.951836109161, '.super_admin', '.single_use', '.reseller_admin') [0.01] Apr 27 03:53:26 ubuntu auth-server 127.0.0.1 - - [27/Apr/2011:10:53:26 +0000] "GET /token/AUTH_tk7aa1868631f24460ae776dbeb67c6817 HTTP/1.0" 204 - "-" "-" - - - - - - - - - "-" "127.0.0.1" "-" 0.0151 Apr 27 03:53:26 ubuntu proxy-server Account PUT returning 503 for [503, 503, 503] (txn: tx227682c4-972b-425e-94e2-68b2b9b1151e) Apr 27 03:53:26 ubuntu proxy-server - 127.0.0.1 27/Apr/2011/10/53/26 PUT /v1/AUTH_21b31b4545824f79b7113ad3dada3cc3 HTTP/1.0 503 - - .super_admin%3A.single_use%2CAUTH_tk7aa1868631f24460ae776dbeb67c6817 - - - tx227682c4-972b-425e-94e2-68b2b9b1151e - 0.0018 Apr 27 03:53:26 ubuntu auth-server ERROR attempting to create account https://127.0.0.1:8080/v1/AUTH_21b31b4545824f79b7113ad3dada3cc3 (https://127.0.0.1:8080/v1/AUTH_21b31b...) : 503 Internal Server Error Apr 27 03:53:26 ubuntu auth-server FAILED create_user('system', 'test', _, True, False) [0.08] Apr 27 03:53:26 ubuntu auth-server 127.0.0.1 - - [27/Apr/2011:10:53:26 +0000] "PUT /account/system/test HTTP/1.0" 503 - "-" "-" - - - - - - - - - "-" "127 ... (more)

edit flag offensive delete link more
0

answered 2013-06-12 12:58:38 -0500

My Swift Proxy log

Jun 12 07:50:33 SwiftProxyServer proxy-server ERROR Unhandled exception in request: #012Traceback (most recent call last):#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 1888, in handle_request#012 return handler(req)#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 93, in wrapped#012 return func(a, *kw)#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 645, in GET#012 return self.GETorHEAD(req)#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 1629, in GETorHEAD#012 self.account_name)#012Exception: Could not autocreate account 'AUTH_76d66f46c50b42fc8f88574f2cddf08f' (txn: txd44f7bc3cb5d4fc098f80857cd46239b) (client_ip: 10.1.168.105) Jun 12 07:50:33 SwiftProxyServer proxy-server 10.1.168.105 10.1.168.105 12/Jun/2013/12/50/33 GET /v1/AUTH_76d66f46c50b42fc8f88574f2cddf08f%3Fformat%3Djson HTTP/1.0 500 - - 55cff2a24a9b4eaf8cd33381a3c0ff16 - - - txd44f7bc3cb5d4fc098f80857cd46239b - 0.0149 - Jun 12 07:50:49 SwiftProxyServer proxy-server Account GET returning 503 for (503, 503, 503) (txn: txf414722b42aa44bc9933ba8aa9726b5a) (client_ip: 10.1.168.105) Jun 12 07:50:49 SwiftProxyServer proxy-server ERROR Unhandled exception in request: #012Traceback (most recent call last):#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 1888, in handle_request#012 return handler(req)#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 93, in wrapped#012 return func(a, *kw)#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 645, in GET#012 return self.GETorHEAD(req)#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 1629, in GETorHEAD#012 self.account_name)#012Exception: Could not autocreate account 'AUTH_76d66f46c50b42fc8f88574f2cddf08f' (txn: txf414722b42aa44bc9933ba8aa9726b5a) (client_ip: 10.1.168.105) Jun 12 07:50:49 SwiftProxyServer proxy-server 10.1.168.105 10.1.168.105 12/Jun/2013/12/50/49 GET /v1/AUTH_76d66f46c50b42fc8f88574f2cddf08f%3Fformat%3Djson HTTP/1.0 500 - - 55cff2a24a9b4eaf8cd33381a3c0ff16 - - - txf414722b42aa44bc9933ba8aa9726b5a - 0.0122 -

edit flag offensive delete link more
0

answered 2013-06-12 12:59:17 -0500

My Swift node log

Jun 12 07:50:43 Swiftnode1 container-replicator Removed 0 dbs Jun 12 07:50:43 Swiftnode1 container-replicator 0 successes, 0 failures Jun 12 07:50:43 Swiftnode1 container-replicator no_change:0 ts_repl:0 diff:0 rsy nc:0 diff_capped:0 hashmatch:0 empty:0 Jun 12 07:50:45 Swiftnode1 account-replicator Beginning replication run Jun 12 07:50:45 Swiftnode1 account-replicator Replication run OVER Jun 12 07:50:45 Swiftnode1 account-replicator Attempted to replicate 0 dbs in 0. 00045 seconds (0.00000/s) Jun 12 07:50:45 Swiftnode1 account-replicator Removed 0 dbs Jun 12 07:50:45 Swiftnode1 account-replicator 0 successes, 0 failures Jun 12 07:50:45 Swiftnode1 account-replicator no_change:0 ts_repl:0 diff:0 rsync :0 diff_capped:0 hashmatch:0 empty:0 Jun 12 07:50:47 Swiftnode1 account-server 10.1.168.105 - - [12/Jun/2013:12:50:47 +0000] "GET /r0/246823/AUTH_76d66f46c50b42fc8f88574f2cddf08f" 404 - "txf414722b 42aa44bc9933ba8aa9726b5a" "-" "-" 0.0004 "" Jun 12 07:50:47 Swiftnode1 account-server ERROR __call__ error with PUT /r0/2468 23/AUTH_76d66f46c50b42fc8f88574f2cddf08f : #012Traceback (most recent call last) :#012 File "/usr/lib/python2.7/dist-packages/swift/account/server.py", line 317 , in __call__#012 res = getattr(self, req.method)(req)#012 File "/usr/lib/py thon2.7/dist-packages/swift/account/server.py", line 114, in PUT#012 broker.i nitialize(timestamp)#012 File "/usr/lib/python2.7/dist-packages/swift/common/db .py", line 180, in initialize#012 mkdirs(self.db_dir)#012 File "/usr/lib/pyt hon2.7/dist-packages/swift/common/utils.py", line 178, in mkdirs#012 os.maked irs(path)#012 File "/usr/lib/python2.7/os.py", line 150, in makedirs#012 mak edirs(head, mode)#012 File "/usr/lib/python2.7/os.py", line 150, in makedirs#01 2 makedirs(head, mode)#012 File "/usr/lib/python2.7/os.py", line 150, in mak edirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.7/os.py", line 150 , in makedirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.7/os.py", line 157, in makedirs#012 mkdir(name, mode)#012OSError: [Errno 13] Permission denied: '/srv/node/r0' (txn: txf414722b42aa44bc9933ba8aa9726b5a) Jun 12 07:50:47 Swiftnode1 account-server 10.1.168.105 - - [12/Jun/2013:12:50:47 +0000] "PUT /r0/246823/AUTH_76d66f46c50b42fc8f88574f2cddf08f" 500 960 "txf41472 2b42aa44bc9933ba8aa9726b5a" "-" "-" 0.0007 "" Jun 12 07:50:54 Swiftnode1 account-server 10.1.168.107 - - [12/Jun/2013:12:50:54 +0000] "HEAD /r0/147755/.expiring_objects" 404 - "tx07071b96b40f440295a46413ab6 1fac0" "-" "Swift Object Expirer" 0.0005 "" Jun 12 07:50:54 Swiftnode1 account-server 10.1.168.107 - - [12/Jun/2013:12:50:54 +0000] "GET /r0/147755/.expiring_objects" 404 - "txbe793e14471843e3b949b375cbfe 9024" "-" "Swift Object Expirer" 0.0001 ""

edit flag offensive delete link more
0

answered 2013-06-12 13:02:34 -0500

The command that I am trying to run on the swift proxy and the error that I get

root@SwiftProxyServer:~# swift -v -V 2.0 -A http://10.1.168.103:5000/v2.0/ -U admin:admin -K hastexo list Account GET failed: http://10.1.168.105:8080/v1/AUTH_76d66f46c50b42fc8f88574f2cddf08f?format=json (http://10.1.168.105:8080/v1/AUTH_76d6...) 500 Internal Server Error [first 60 chars of response] 500 Internal Server Error

The server has either erred or is root@SwiftProxyServer:~#

I have a separate swift proxy server and 3 nodes storage also Openstack installed on separate machine which has Precise Pangolin Ubuntu 12.04

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2011-03-22 07:59:04 -0500

Seen: 3,300 times

Last updated: Jun 12 '13