Hi! When I am executing "swift stat" command I am getting Account HEAD failed: http://controller:8080/v1/AUTH_3babe56d610847c389f89c959f74dd44 503 Service Unavailable Failed Transaction ID: tx635b33ff8b4545afae451-00589b99db

asked 2017-02-08 11:08:36 -0600

Arpit Sharma gravatar image

updated 2017-02-10 10:36:08 -0600

rbowen gravatar image

Hi All,

I have installed two swift storage node with IP 192.168.1.194 & 192.168.1.195. I have one proxy-server node as 192.168.1.191. When I executing swift stat command then I am getting

Account HEAD failed: http://controller:8080/v1/AUTH_3babe56d610847c389f89c959f74dd44 503 Service Unavailable
Failed Transaction ID: tx635b33ff8b4545afae451-00589b99db

error. I have also checked with replacing swift storage IP by 0.0.0.0.0 in account-server.conf, object-server.conf and container-server.conf files.I have also checked with all ports. But still I am getting this error. Can anyone help me??

Here I am posting logs from proxy node(/var/log/message)

Feb  9 03:50:11 controller swift: ERROR Insufficient Storage 192.168.1.194:6002/sdc1 (txn: txb3328471f8bb4feca2cec-00589b999b)
Feb  9 03:50:11 controller swift: ERROR Insufficient Storage 192.168.1.194:6002/sdb1 (txn: txb3328471f8bb4feca2cec-00589b999b)
Feb  9 03:50:11 controller swift: ERROR Insufficient Storage 192.168.1.195:6002/sdc1 (txn: txb3328471f8bb4feca2cec-00589b999b)
Feb  9 03:50:11 controller swift: ERROR Insufficient Storage 192.168.1.195:6002/sdb1 (txn: txb3328471f8bb4feca2cec-00589b999b)
Feb  9 03:50:11 controller swift: Account HEAD returning 503 for [507, 507, 507, 507] (txn: txb3328471f8bb4feca2cec-00589b999b)
Feb  9 03:50:11 controller swift: - - 08/Feb/2017/22/20/11 GET /v1/.misplaced_objects/1486591200%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 404 - Swift%20Container%20Reconciler - - 70 - txb3328471f8bb4feca2cec-00589b999b - 0.0335 - - 1486592411.740717888 1486592411.774223089 -
Feb  9 03:50:11 controller swift: Account GET returning 503 for [] (txn: tx4c71cc5165a3426180e12-00589b999b)
Feb  9 03:50:13 controller swift: Account GET returning 503 for [] (txn: txdbeb707711ba4d0fa2b1a-00589b999d)
Feb  9 03:50:13 controller swift: - - 08/Feb/2017/22/20/13 GET /v1/.misplaced_objects%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 499 - Swift%20Container%20Reconciler - - 118 - tx4c71cc5165a3426180e12-00589b999b - 2.0105 - - 1486592411.775178909 1486592413.785631895 - (txn: txdbeb707711ba4d0fa2b1a-00589b999d)
Feb  9 03:50:17 controller swift: Account GET returning 503 for [] (txn: tx8b1c640bc6b1406e95a6d-00589b99a1)
Feb  9 03:50:17 controller swift: - - 08/Feb/2017/22/20/17 GET /v1/.misplaced_objects%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 499 - Swift%20Container%20Reconciler - - 118 - txdbeb707711ba4d0fa2b1a-00589b999d - 4.0123 - - 1486592413.780395031 1486592417.792692900 - (txn: tx8b1c640bc6b1406e95a6d-00589b99a1)
Feb  9 03:50:17 controller container-reconciler: Error listing containers in account .misplaced_objects (Unexpected response: 503 Service Unavailable) (txn: tx8b1c640bc6b1406e95a6d-00589b99a1)
Feb  9 03:50:17 controller swift: - - 08/Feb/2017/22/20/17 GET /v1/.misplaced_objects%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 499 - Swift%20Container%20Reconciler - - 118 - tx8b1c640bc6b1406e95a6d-00589b99a1 - 0.0060 - - 1486592417.787771940 1486592417.793772936 -
Feb  9 03:50:17 controller container-reconciler: Reconciler Stats: {} (txn: tx8b1c640bc6b1406e95a6d-00589b99a1)
Feb  9 03:50:17 controller container-reconciler: sleeping between intervals (30s) (txn: tx8b1c640bc6b1406e95a6d-00589b99a1)
Feb  9 03:50:43 controller proxy-server: STDERR: ERROR:root:Error connecting to memcached: controller:11211#012Traceback (most recent call last):#012  File "/usr/lib/python2.7/site-packages/swift/common/memcached.py", line 214, in _get_conns#012    fp, sock = self._client_cache[server].get()#012  File "/usr/lib/python2.7/site-packages/swift/common/memcached.py", line 129, in get#012    fp, sock = super(MemcacheConnPool ...
(more)
edit retag flag offensive close merge delete