Ask Your Question
0

Spectrum Protect and Swift

asked 2019-04-17 07:28:53 -0500

Priotto gravatar image

Hello Guys, how are you?

Im receiving logs of error from my Swift (openstack 3.12.1) installed with packstack (centos-release-openstack-pike). My swift configuration is default yet. I'm trying to make backup on my swift in a internal L3 network through a backup tools (Spectrum Protect). After about 2 minutes, I receive logs with error connection:

[...] 
2019-04-17 09:02:25 ANR3832I Local to Cloud Transfer process 424 for storage pool STGOPENSTACK started. (PROCESS: 424)
2019-04-17 09:03:14 ANR3714E Cannot connect to the cloud service provider with the cloud URL, http://10.18.1.30:5000/v2.0, for the connect operation on the STGOPENSTACK storage pool. (PROCESS: 416)
2019-04-17 09:03:14 ANR3714E Cannot connect to the cloud service provider with the cloud URL, http://10.18.1.30:5000/v2.0, for 1the connect operation on the STGOPENSTACK storage pool. (PROCESS: 384)
2019-04-17 09:03:14 ANR3714E Cannot connect to the cloud service provider with the cloud URL, http://10.18.1.30:5000/v2.0, for the connect operation on the STGOPENSTACK storage pool. (PROCESS: 421)
2019-04-17 09:03:14 ANR3714E Cannot connect to the cloud service provider with the cloud URL, http://10.18.1.30:5000/v2.0, for the connect operation on the STGOPENSTACK storage pool. (PROCESS: 415)
2019-04-17 09:03:14 ANR3714E Cannot connect to the cloud service provider with the cloud URL, http://10.18.1.30:5000/v2.0, for the connect operation on the STGOPENSTACK storage pool. (PROCESS: 421)
2019-04-17 09:03:14 ANR3714E Cannot connect to the cloud service provider with the cloud URL, http://10.18.1.30:5000/v2.0, for the connect operation on the STGOPENSTACK storage pool. (PROCESS: 371)
2019-04-17 09:03:14 ANR3714E Cannot connect to the cloud service provider with the cloud URL, http://10.18.1.30:5000/v2.0, for the connect operation on the STGOPENSTACK storage pool. (PROCESS: 421)
2019-04-17 09:03:14 ANR3714E Cannot connect to the cloud service provider with the cloud URL, http://10.18.1.30:5000/v2.0, for the connect operation on the STGOPENSTACK storage pool. (PROCESS: 423
[...]

But on begin of operation, the files are sent:

2019-04-17 09:01:13 ANR3833I Local to Cloud Transfer process 423 for storage pool STGOPENSTACK has completed. (PROCESS: 423)

Do you know if i need to set some configuration about number of conections or time out?

Thanks a lot!

edit retag flag offensive close merge delete

Comments

1

Are you sure 10.18.1.30:5000/v2.0 is correct? Keystone version 2 was obsoleted years ago.

If yes, what happens when you connect manually, e.g.

curl http://10.18.1.30:5000/v2.0
Bernd Bausch gravatar imageBernd Bausch ( 2019-04-17 07:43:20 -0500 )edit

1 answer

Sort by ยป oldest newest most voted
0

answered 2019-04-19 20:31:12 -0500

Priotto gravatar image

Thanks Bernd, I found the error, but i not found the solution yet. Im using de the verision 2 in pike, because this is a limitation of Spectrum Protect.

Apr 18 22:33:19 BL06L02 proxy-server: STDERR: WARNING:requests.packages.urllib3.connectionpool:Connection pool is full, discarding connection: 10.18.1.30 (txn: txbbed0634b417499d948be-005cb9253c)
Apr 18 22:33:19 BL06L02 proxy-server: STDERR: WARNING:requests.packages.urllib3.connectionpool:Connection pool is full, discarding connection: 10.18.1.30 (txn: tx5c792c0f3d894c518df81-005cb9253c)
Apr 18 22:33:19 BL06L02 proxy-server: STDERR: WARNING:requests.packages.urllib3.connectionpool:Connection pool is full, discarding connection: 10.18.1.30 (txn: tx5f8eb3e1caa0412a99d88-005cb9253c)
Apr 18 22:33:19 BL06L02 proxy-server: STDERR: WARNING:requests.packages.urllib3.connectionpool:Connection pool is full, discarding connection: 10.18.1.30 (txn: txf3cbfb1b84d04475853d9-005cb9253c)
Apr 18 22:33:20 BL06L02 proxy-server: STDERR: WARNING:requests.packages.urllib3.connectionpool:Connection pool is full, discarding connection: 10.18.1.30 (txn: txd0491ba1b73c40d29b8ad-005cb9253c) (client_ip: 10.40.0.210)
Apr 18 22:33:20 BL06L02 proxy-server: STDERR: WARNING:requests.packages.urllib3.connectionpool:Connection pool is full, discarding connection: 10.18.1.30 (txn: tx8fecef8ff8af452bae6bf-005cb9253c) (client_ip: 10.40.0.210)
Apr 18 22:33:20 BL06L02 proxy-server: STDERR: WARNING:requests.packages.urllib3.connectionpool:Connection pool is full, discarding connection: 10.18.1.30 (txn: txa26a50233c404681a85ed-005cb9253c) (client_ip: 10.40.0.210)
Apr 18 22:33:20 BL06L02 proxy-server: STDERR: WARNING:requests.packages.urllib3.connectionpool:Connection pool is full, discarding connection: 10.18.1.30 (txn: tx303f84a6066546de8bdce-005cb9253d)
Apr 18 22:33:21 BL06L02 proxy-server: STDERR: WARNING:requests.packages.urllib3.connectionpool:Connection pool is full, discarding connection: 10.18.1.30 (txn: txdc751936557f4e0f80955-005cb9253c) (client_ip: 10.40.0.210)
Apr 18 22:33:21 BL06L02 proxy-server: STDERR: WARNING:requests.packages.urllib3.connectionpool:Connection pool is full, discarding connection: 10.18.1.30 (txn: tx8c5a505f691f4fa6895f7-005cb9253e)

I've already tried to increase de number of workers, to increase and decrease number of max clients in proxy server etc.. but up to now nothing worked. After restarte the services , Swift works good for some minutes, about 4 or 5 minutes.

I need help please.

Thanks a lot.

edit flag offensive delete link more

Comments

1

The same or a similar problem has been raised as a bug: https://bugs.launchpad.net/python-swi.... This is a bug in the swift client; not sure if it applies to your situation.

Can you configure Spectrum to open fewer connections?

I suggest you get help from the distribution list.

Bernd Bausch gravatar imageBernd Bausch ( 2019-04-20 00:48:48 -0500 )edit

Unfortunately I do not think so. I will create a virtual machine in lab for tests ..

Priotto gravatar imagePriotto ( 2019-04-22 08:46:22 -0500 )edit

I created a ubuntu server 16.04 with pike, my version in "prodution" is centos (logs above). In Ubuntu i received the same error, but now i have error on memcached too. =(

Priotto gravatar imagePriotto ( 2019-04-22 18:16:56 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

Stats

Asked: 2019-04-17 07:23:42 -0500

Seen: 31 times

Last updated: Apr 17