update failed: 503 service unavailable

asked 2011-03-22 07:59:04 -0500

zyh-at-bupt
11 ●2 ●2 ●4

when I create openstack object storage admin account, this problem happens. after I input: swift-auth-add-user -K devauth -a system root testpass the terminal output: update failed: 503 service unavailable

the /var/log/syslog is as follow: Mar 22 15:40:17 swift-desktop auth-server validate_token('AUTH_tk9ca08031dd164712a25c36e05131aee0', _, _) = (86399.977941989899, '.super_admin', '.single_use', '.reseller_admin') [0.00] Mar 22 15:40:17 swift-desktop auth-server 127.0.0.1 - - [22/Mar/2011:07:40:17 +0000] "GET /token/AUTH_tk9ca08031dd164712a25c36e05131aee0 HTTP/1.0" 204 - "-" "-" - - - - - - - - - "-" "127.0.0.1" "-" 0.0038 Mar 22 15:40:17 swift-desktop proxy-server ERROR with Account server 192.168.1.125:6004/sda8 re: Trying to PUT to /v1/AUTH_20f431da534d444899e34f5d551d8498: Connection refused (txn: txc7ff39aa-bfc3-425e-b596-d0c75304e6e6) Mar 22 15:40:17 swift-desktop proxy-server ERROR with Account server 192.168.1.125:6003/sda7 re: Trying to PUT to /v1/AUTH_20f431da534d444899e34f5d551d8498: Connection refused (txn: txc7ff39aa-bfc3-425e-b596-d0c75304e6e6) Mar 22 15:40:17 swift-desktop proxy-server Account PUT returning 503 for [400, 201, 503] (txn: txc7ff39aa-bfc3-425e-b596-d0c75304e6e6) Mar 22 15:40:17 swift-desktop auth-server ERROR attempting to create account https://swift-desktop:8080/v1/AUTH_20f431da534d444899e34f5d551d8498 (https://swift-desktop:8080/v1/AUTH_20...) : 503 Internal Server Error Mar 22 15:40:17 swift-desktop auth-server FAILED create_user('system', 'root', _, True, False) [0.05] Mar 22 15:40:17 swift-desktop auth-server 127.0.0.1 - - [22/Mar/2011:07:40:17 +0000] "PUT /account/system/root HTTP/1.0" 503 - "-" "-" - - - - - - - - - "-" "127.0.0.1" "-" 0.0511 Mar 22 15:40:17 swift-desktop proxy-server - 127.0.1.1 22/Mar/2011/07/40/17 PUT /v1/AUTH_20f431da534d444899e34f5d551d8498 HTTP/1.0 503 - - .super_admin%3A.single_use%2CAUTH_tk9ca08031dd164712a25c36e05131aee0 - - - txc7ff39aa-bfc3-425e-b596-d0c75304e6e6 - 0.0281

edit retag flag offensive close merge delete

add a comment

0

answered 2013-06-12 12:59:17 -0500

raghavendra-lad
1

My Swift node log

Jun 12 07:50:43 Swiftnode1 container-replicator Removed 0 dbs Jun 12 07:50:43 Swiftnode1 container-replicator 0 successes, 0 failures Jun 12 07:50:43 Swiftnode1 container-replicator no_change:0 ts_repl:0 diff:0 rsy nc:0 diff_capped:0 hashmatch:0 empty:0 Jun 12 07:50:45 Swiftnode1 account-replicator Beginning replication run Jun 12 07:50:45 Swiftnode1 account-replicator Replication run OVER Jun 12 07:50:45 Swiftnode1 account-replicator Attempted to replicate 0 dbs in 0. 00045 seconds (0.00000/s) Jun 12 07:50:45 Swiftnode1 account-replicator Removed 0 dbs Jun 12 07:50:45 Swiftnode1 account-replicator 0 successes, 0 failures Jun 12 07:50:45 Swiftnode1 account-replicator no_change:0 ts_repl:0 diff:0 rsync :0 diff_capped:0 hashmatch:0 empty:0 Jun 12 07:50:47 Swiftnode1 account-server 10.1.168.105 - - [12/Jun/2013:12:50:47 +0000] "GET /r0/246823/AUTH_76d66f46c50b42fc8f88574f2cddf08f" 404 - "txf414722b 42aa44bc9933ba8aa9726b5a" "-" "-" 0.0004 "" Jun 12 07:50:47 Swiftnode1 account-server ERROR __call__ error with PUT /r0/2468 23/AUTH_76d66f46c50b42fc8f88574f2cddf08f : #012Traceback (most recent call last) :#012 File "/usr/lib/python2.7/dist-packages/swift/account/server.py", line 317 , in __call__#012 res = getattr(self, req.method)(req)#012 File "/usr/lib/py thon2.7/dist-packages/swift/account/server.py", line 114, in PUT#012 broker.i nitialize(timestamp)#012 File "/usr/lib/python2.7/dist-packages/swift/common/db .py", line 180, in initialize#012 mkdirs(self.db_dir)#012 File "/usr/lib/pyt hon2.7/dist-packages/swift/common/utils.py", line 178, in mkdirs#012 os.maked irs(path)#012 File "/usr/lib/python2.7/os.py", line 150, in makedirs#012 mak edirs(head, mode)#012 File "/usr/lib/python2.7/os.py", line 150, in makedirs#01 2 makedirs(head, mode)#012 File "/usr/lib/python2.7/os.py", line 150, in mak edirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.7/os.py", line 150 , in makedirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.7/os.py", line 157, in makedirs#012 mkdir(name, mode)#012OSError: [Errno 13] Permission denied: '/srv/node/r0' (txn: txf414722b42aa44bc9933ba8aa9726b5a) Jun 12 07:50:47 Swiftnode1 account-server 10.1.168.105 - - [12/Jun/2013:12:50:47 +0000] "PUT /r0/246823/AUTH_76d66f46c50b42fc8f88574f2cddf08f" 500 960 "txf41472 2b42aa44bc9933ba8aa9726b5a" "-" "-" 0.0007 "" Jun 12 07:50:54 Swiftnode1 account-server 10.1.168.107 - - [12/Jun/2013:12:50:54 +0000] "HEAD /r0/147755/.expiring_objects" 404 - "tx07071b96b40f440295a46413ab6 1fac0" "-" "Swift Object Expirer" 0.0005 "" Jun 12 07:50:54 Swiftnode1 account-server 10.1.168.107 - - [12/Jun/2013:12:50:54 +0000] "GET /r0/147755/.expiring_objects" 404 - "txbe793e14471843e3b949b375cbfe 9024" "-" "Swift Object Expirer" 0.0001 ""

edit flag offensive delete link

add a comment

0

answered 2013-06-12 12:58:38 -0500

raghavendra-lad
1

My Swift Proxy log

Jun 12 07:50:33 SwiftProxyServer proxy-server ERROR Unhandled exception in request: #012Traceback (most recent call last):#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 1888, in handle_request#012 return handler(req)#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 93, in wrapped#012 return func(a, *kw)#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 645, in GET#012 return self.GETorHEAD(req)#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 1629, in GETorHEAD#012 self.account_name)#012Exception: Could not autocreate account 'AUTH_76d66f46c50b42fc8f88574f2cddf08f' (txn: txd44f7bc3cb5d4fc098f80857cd46239b) (client_ip: 10.1.168.105) Jun 12 07:50:33 SwiftProxyServer proxy-server 10.1.168.105 10.1.168.105 12/Jun/2013/12/50/33 GET /v1/AUTH_76d66f46c50b42fc8f88574f2cddf08f%3Fformat%3Djson HTTP/1.0 500 - - 55cff2a24a9b4eaf8cd33381a3c0ff16 - - - txd44f7bc3cb5d4fc098f80857cd46239b - 0.0149 - Jun 12 07:50:49 SwiftProxyServer proxy-server Account GET returning 503 for (503, 503, 503) (txn: txf414722b42aa44bc9933ba8aa9726b5a) (client_ip: 10.1.168.105) Jun 12 07:50:49 SwiftProxyServer proxy-server ERROR Unhandled exception in request: #012Traceback (most recent call last):#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 1888, in handle_request#012 return handler(req)#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 93, in wrapped#012 return func(a, *kw)#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 645, in GET#012 return self.GETorHEAD(req)#012 File "/usr/lib/python2.7/dist-packages/swift/proxy/server.py", line 1629, in GETorHEAD#012 self.account_name)#012Exception: Could not autocreate account 'AUTH_76d66f46c50b42fc8f88574f2cddf08f' (txn: txf414722b42aa44bc9933ba8aa9726b5a) (client_ip: 10.1.168.105) Jun 12 07:50:49 SwiftProxyServer proxy-server 10.1.168.105 10.1.168.105 12/Jun/2013/12/50/49 GET /v1/AUTH_76d66f46c50b42fc8f88574f2cddf08f%3Fformat%3Djson HTTP/1.0 500 - - 55cff2a24a9b4eaf8cd33381a3c0ff16 - - - txf414722b42aa44bc9933ba8aa9726b5a - 0.0122 -

edit flag offensive delete link

add a comment

0

answered 2013-05-23 07:51:26 -0500

raghavendra-lad
1

I have the Swift Proxy server and 3 nodes as per the hastexo documentation site. I still get the error when I try to test The error is

Account GET failed: http://10.1.168.105:8080/v1/AUTH_76d66f46c50b42fc8f88574f2cddf08f?format=json (http://10.1.168.105:8080/v1/AUTH_76d6...) 503 Internal Server Error

Any help..!!

edit flag offensive delete link

add a comment

0

answered 2011-04-28 23:21:03 -0500

moubarik-siham
1 ●1 ●1 ●1

tks for you David Goetz i'm so sorry

error is

root@ubuntu:~# swift-auth-add-user -K devauth -a system root testpass Update failed: 503 Service Unavailable

root@ubuntu:~#

file /etc/swift.auth-server.conf

[DEFAULT] cert_file = /etc/swift/cert.crt key_file = /etc/swift/cert.key user = swift [pipeline:main] pipeline = auth-server [app:auth-server] use = egg:swift#auth default_cluster_url = https://127.0.0.1:8080/v1

Highly recommended to change this key to something else!

super_admin_key = devauth

file etc/swift/proxy-server.conf

[DEFAULT] cert_file = /etc/swift/cert.crt key_file = /etc/swift/cert.key

bind_port = 8080 workers = 8 user = swift [pipeline:main] pipeline = healthcheck cache auth proxy-server [app:proxy-server] use = egg:swift#proxy allow_account_management = true [filter:auth] use = egg:swift#auth ssl = true [filter:healthcheck] use = egg:swift#healthcheck [filter:cache] use = egg:swift#memcache

memcache_servers = 127.0.0.1:11211

/var/log/syslog

Apr 27 03:53:21 ubuntu container-replicator Attempted to replicate 0 dbs in 0.00540 seconds (0.00000/s) Apr 27 03:53:21 ubuntu container-replicator Removed 0 dbs Apr 27 03:53:21 ubuntu container-replicator 0 successes, 0 failures Apr 27 03:53:21 ubuntu container-replicator no_change:0 ts_repl:0 diff:0 rsync:0 hashmatch:0 empty:0 Apr 27 03:53:26 ubuntu object-replicator Starting object replication pass. Apr 27 03:53:26 ubuntu object-replicator sda1 is not mounted Apr 27 03:53:26 ubuntu object-replicator sda2 is not mounted Apr 27 03:53:26 ubuntu object-replicator sda3 is not mounted Apr 27 03:53:26 ubuntu object-replicator sda4 is not mounted Apr 27 03:53:26 ubuntu object-replicator Nothing replicated for 0.00181102752686 seconds. Apr 27 03:53:26 ubuntu object-replicator Object replication complete. (0.00 minutes) Apr 27 03:53:26 ubuntu proxy-server Error talking to memcached: 127.0.0.1:11211#012Traceback (most recent call last):#012 File "/usr/lib/pymodules/python2.6/swift/common/memcached.py", line 156, in get#012 while line[0].upper() != 'END':#012IndexError: list index out of range Apr 27 03:53:26 ubuntu auth-server validate_token('AUTH_tk7aa1868631f24460ae776dbeb67c6817', _, _) = (86399.951836109161, '.super_admin', '.single_use', '.reseller_admin') [0.01] Apr 27 03:53:26 ubuntu auth-server 127.0.0.1 - - [27/Apr/2011:10:53:26 +0000] "GET /token/AUTH_tk7aa1868631f24460ae776dbeb67c6817 HTTP/1.0" 204 - "-" "-" - - - - - - - - - "-" "127.0.0.1" "-" 0.0151 Apr 27 03:53:26 ubuntu proxy-server Account PUT returning 503 for [503, 503, 503] (txn: tx227682c4-972b-425e-94e2-68b2b9b1151e) Apr 27 03:53:26 ubuntu proxy-server - 127.0.0.1 27/Apr/2011/10/53/26 PUT /v1/AUTH_21b31b4545824f79b7113ad3dada3cc3 HTTP/1.0 503 - - .super_admin%3A.single_use%2CAUTH_tk7aa1868631f24460ae776dbeb67c6817 - - - tx227682c4-972b-425e-94e2-68b2b9b1151e - 0.0018 Apr 27 03:53:26 ubuntu auth-server ERROR attempting to create account https://127.0.0.1:8080/v1/AUTH_21b31b4545824f79b7113ad3dada3cc3 (https://127.0.0.1:8080/v1/AUTH_21b31b...) : 503 Internal Server Error Apr 27 03:53:26 ubuntu auth-server FAILED create_user('system', 'test', _, True, False) [0.08] Apr 27 03:53:26 ubuntu auth-server 127.0.0.1 - - [27/Apr/2011:10:53:26 +0000] "PUT /account/system/test HTTP/1.0" 503 - "-" "-" - - - - - - - - - "-" "127 ... (more)

edit flag offensive delete link

add a comment

0

answered 2011-03-28 06:47:36 -0500

zyh-at-bupt
11 ●2 ●2 ●4

Sorry, I don't check the comand carefully, now, the problem has been solved, thank you very much clayg. thank you !

edit flag offensive delete link

add a comment

0

answered 2011-03-28 03:02:35 -0500

zyh-at-bupt
11 ●2 ●2 ●4

hi, clayg, the result is as follow: swift@swift-desktop:~$ sudo swift-auth-add-user -K devauth -a system root testpass https://192.168.1.127:8080/v1/AUTH_b00ca72849ee4d659759e36b56a3d429 (https://192.168.1.127:8080/v1/AUTH_b0...)

Does this mean there is no problem?

next comand is curl -k -v -H 'X-Auth-Token: <token-from-x-auth-token-above>' <url-from-x-storage-url-above>

what is the <token-from-x-auth-token-above> ? and what is the <url-from-x-storage-url-above> ?

thank you very much again!

edit flag offensive delete link

add a comment

0

answered 2011-03-25 14:32:18 -0500

clay-gerrard
41 ●1

OK, nice work - looks like you found the problem: Permission denied: '/srv/node/sda6/accounts'

Review the permissions setup docs for a SAIO at: http://swift.openstack.org/development_saio.html#using-a-partition-for-storage (http://swift.openstack.org/developmen...)

or multi-node: http://swift.openstack.org/howto_installmultinode.html#configure-the-storage-nodes (http://swift.openstack.org/howto_inst...)

basically you want to do something like: chown -R <your-user-name>:<your-group-name> /srv/node/sda[5-7]/

You should be able to verify the the user configured on your account-server.conf can create new files on these storage devices...

edit flag offensive delete link

add a comment

0

answered 2011-03-25 09:32:01 -0500

zyh-at-bupt
11 ●2 ●2 ●4

and the syslog on the storage node is as follow:

Mar 25 17:24:38 swift-desktop account-server ERROR __call__ error with PUT /sda5/40821/AUTH_cadad33181144d32af4d0f6ceea9bdba : #012Traceback (most recent call last):#012 File "/usr/lib/pymodules/python2.6/swift/account/server.py", line 305, in __call__#012 res = getattr(self, req.method)(req)#012 File "/usr/lib/pymodules/python2.6/swift/account/server.py", line 106, in PUT#012 broker.initialize(timestamp)#012 File "/usr/lib/pymodules/python2.6/swift/common/db.py", line 179, in initialize#012 mkdirs(self.db_dir)#012 File "/usr/lib/pymodules/python2.6/swift/common/utils.py", line 170, in mkdirs#012 os.makedirs(path)#012 File "/usr/lib/python2.6/os.py", line 150, in makedirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.6/os.py", line 150, in makedirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.6/os.py", line 150, in makedirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.6/os.py", line 157, in makedirs#012 mkdir(name, mode)#012OSError: [Errno 13] Permission denied: '/srv/node/sda5/accounts' (txn: txa9d5b4f6-2051-462f-8e8f-e1d1fa17c2d1) Mar 25 17:24:38 swift-desktop account-server 192.168.1.127 - - [25/Mar/2011:09:24:38 +0000] "PUT /sda5/40821/AUTH_cadad33181144d32af4d0f6ceea9bdba" 500 873 "txa9d5b4f6-2051-462f-8e8f-e1d1fa17c2d1" "-" "-" 0.0017 "" Mar 25 17:24:38 swift-desktop account-server ERROR __call__ error with PUT /sda7/40821/AUTH_cadad33181144d32af4d0f6ceea9bdba : #012Traceback (most recent call last):#012 File "/usr/lib/pymodules/python2.6/swift/account/server.py", line 305, in __call__#012 res = getattr(self, req.method)(req)#012 File "/usr/lib/pymodules/python2.6/swift/account/server.py", line 106, in PUT#012 broker.initialize(timestamp)#012 File "/usr/lib/pymodules/python2.6/swift/common/db.py", line 179, in initialize#012 mkdirs(self.db_dir)#012 File "/usr/lib/pymodules/python2.6/swift/common/utils.py", line 170, in mkdirs#012 os.makedirs(path)#012 File "/usr/lib/python2.6/os.py", line 150, in makedirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.6/os.py", line 150, in makedirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.6/os.py", line 150, in makedirs#012 makedirs(head, mode)#012 File "/usr/lib/python2.6/os.py", line 157, in makedirs#012 mkdir(name, mode)#012OSError: [Errno 13] Permission denied: '/srv/node/sda7/accounts' (txn: txa9d5b4f6-2051-462f-8e8f-e1d1fa17c2d1) Mar 25 17:24:38 swift-desktop account-server 192.168.1.127 - - [25/Mar/2011:09:24:38 +0000] "PUT /sda7/40821/AUTH_cadad33181144d32af4d0f6ceea9bdba" 500 873 "txa9d5b4f6-2051-462f-8e8f-e1d1fa17c2d1" "-" "-" 0.0015 "" Mar 25 17:24:38 swift-desktop account-server ERROR __call__ error with PUT /sda6/40821/AUTH_cadad33181144d32af4d0f6ceea9bdba : #012Traceback (most recent call last):#012 File "/usr/lib/pymodules/python2.6/swift/account/server.py", line 305, in __call__#012 res = getattr(self, req.method)(req)#012 File "/usr/lib/pymodules/python2.6/swift/account/server.py", line 106, in PUT#012 broker.initialize(timestamp)#012 File "/usr/lib/pymodules/python2.6/swift/common/db.py", line 179, in initialize#012 mkdirs(self.db_dir)#012 File "/usr/lib/pymodules/python2.6/swift ... (more)

edit flag offensive delete link

add a comment

0

answered 2013-06-12 13:02:34 -0500

raghavendra-lad
1

The command that I am trying to run on the swift proxy and the error that I get

root@SwiftProxyServer:~# swift -v -V 2.0 -A http://10.1.168.103:5000/v2.0/ -U admin:admin -K hastexo list Account GET failed: http://10.1.168.105:8080/v1/AUTH_76d66f46c50b42fc8f88574f2cddf08f?format=json (http://10.1.168.105:8080/v1/AUTH_76d6...) 500 Internal Server Error [first 60 chars of response] 500 Internal Server Error

The server has either erred or is root@SwiftProxyServer:~#

I have a separate swift proxy server and 3 nodes storage also Openstack installed on separate machine which has Precise Pangolin Ubuntu 12.04

edit flag offensive delete link

add a comment

0

answered 2011-03-24 15:02:56 -0500

clay-gerrard
41 ●1

Hrm.. so you should probalby fix the memcached thing. Make sure memcached is installed (aptitude install memcached -y) and running (service memcached restart)

Then either retry the account create, or you should be able to verify memcache is working by connecting and issuing a command directly:

$ telnet 192.168.1.127 11211 Trying 192.168.1.127... Connected to 192.168.1.127. Escape character is '^]'. version VERSION 1.4.2 ^]

telnet> quit Connection closed.

But I don't think that's the whole problem. The proxy is reporting that all the account servers are returning 503 Server Error. What errors do you see in syslog on the storage node (192.168.1.125)?

edit flag offensive delete link

add a comment

update failed: 503 service unavailable

18 answers

error is

root@ubuntu:~#

Highly recommended to change this key to something else!

super_admin_key = devauth

memcache_servers = 127.0.0.1:11211

/var/log/syslog

Your Answer

Get to know Ask OpenStack

Question Tools

Stats

Related questions

Feedback About This Page

OpenStack

Community

Documentation

Branding & Legal

update failed: 503 service unavailable edit

18 answers

error is

root@ubuntu:~#

Highly recommended to change this key to something else!

super_admin_key = devauth

memcache_servers = 127.0.0.1:11211

/var/log/syslog

Your Answer

Get to know Ask OpenStack

Question Tools

Stats

Related questions

Feedback About This Page

OpenStack

Community

Documentation

Branding & Legal

update failed: 503 service unavailable