发起问题

elliotp 的档案 - activity

2020-04-20 13:57:58 -0500 获得奖牌  热门的问题 (source)
2019-10-30 09:08:30 -0500 获得奖牌  受欢迎的问题 (source)
2019-10-09 06:08:01 -0500 问了问题 Replacing scp with bbcp to obtain fast vm migration (10Gb/sec)

Problem: We use local storage for instances. Sometimes an instance can reach 1TB root disk. When migrating such instances between compute nodes it can take many hours.

We use 2 x 10Gb/sec bonded network, enterprise SSDs in RAID 10.

Solution: After testing several solutions (including manual netcat, HPN-SSH), we have found 'bbcp' (http://pcbunn.cithep.caltech.edu/bbcp...) - using bbcp with the default of 4 streams, we can obtain 1.1GB/sec of data transfer (saturating a 10Gb/sec link and most likely the SSD write speed on the target host). We have successfully migrated a 1TB file in 16 minutes.

bbcp could be used as a drop in replacement for scp for migrations, as it runs over SSH, and 'just works'.

Question: How would one have OpenStack's migration feature use bbcp rather than scp? Solutions such as:

  • A configuration parameter to provide the migration vehicle of bbcp rather than scp.
  • Editing the source code somewhere to call bbcp rather than scp.
  • Possibly aliasing scp on the command line to call bbcp instead (although i wanted to avoid this and use it for migrations only).

If anyone has any insight on the above it would be greatly appreciated.

2018-04-24 03:52:20 -0500 获得奖牌  著名问题 (source)
2018-04-20 23:57:17 -0500 获得奖牌  热门的问题 (source)
2018-04-20 22:25:56 -0500 获得奖牌  受欢迎的问题 (source)
2018-04-19 08:38:05 -0500 问了问题 Can OpenStack live backup instances (Pike)?

Hi,

We're running Pike. I'm trying to implement backups - incremental, non incremental, snapshots, anything. At the moment we can't work out if it is at all possible to live backup instances, i.e without interruption to normal functionality? Or is Ceph / other storage required for CoW?

We've tried both with volume backed instances (cinder nfs), and local storaged backed instances with the following:

openstack server backup create

openstack volume backup create

In both cases, the instance is taken offline for 20 minutes to backup.

Thanks,

Elliot

2017-06-06 15:48:13 -0500 获得奖牌  著名问题 (source)
2017-01-09 15:45:34 -0500 获得奖牌  热门的问题 (source)
2017-01-05 09:46:25 -0500 获得奖牌  学生 (source)
2017-01-05 09:46:13 -0500 获得奖牌  自学者 (source)
2017-01-05 09:46:13 -0500 获得奖牌  老师 (source)
2016-12-21 02:31:54 -0500 获得奖牌  著名问题 (source)
2016-12-20 23:06:33 -0500 获得奖牌  热门的问题 (source)
2016-12-20 06:26:40 -0500 评论问题 Neutron Error - RTNETLINK answers: File exists

Thank you, this has helped. For some reason it looks like Neutron is trying to add brq8ac8c00b-41 on 10.0.0.11 when my management interface bond0:1 has this IP already configured statically. Is this normal?

2016-12-19 14:29:23 -0500 获得奖牌  受欢迎的问题 (source)
2016-12-17 02:24:53 -0500 问了问题 Neutron Error - RTNETLINK answers: File exists

I've setup Newton following the installation guide onto Ubuntu 16.04.

When I add a provider network subnet, i get an error in the Neutron logs, this is preventing instances from being created successfully. I've enabled debug logging, this is the issue:

2016-12-17 08:13:58.016 21759 DEBUG neutron.agent.linux.utils [req-70f08375-446d-464c-ba75-fc4a4c6367de - - - - -] Running command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', '-4', 'addr', 'add', '10.0.0.11/24', 'scope', 'global', 'dev', 'brq8ac8c00b-41', 'brd', '10.0.0.255'] create_process /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:83

2016-12-17 08:13:58.503 21759 ERROR neutron.agent.linux.utils [req-70f08375-446d-464c-ba75-fc4a4c6367de - - - - -] Exit code: 2; Stdin: ; Stdout: ; Stderr: RTNETLINK answers: File exists

The problem is that brq8ac8c00b-41 already exists (as shown if i run 'ifconfig'), but it appears to be trying to be adding it again, and duplicating my management interface IP on the controller.

If i remove the subnet, the error stops. I'm adding the subnet with the following (ips removed for security):

openstack subnet create --network provider   --allocation-pool start=x.x.x.17,end=x.x.x.23  --dns-nameserver 8.8.8.8 --gateway x.x.x.1  --subnet-range x.x.x.x/24 provider

The provider network is the shared, flat network.

I'm not sure if this is to do with my network config, which is as follows. bond0 is the provider network, bond0:1 is management with a static ip set. Neutron appears to want to create brq8ac8c00b-41 which has the same IP as bond0:1

bond0     Link encap:Ethernet  HWaddr 0c:c4:7a:de:bf:24
          ...
          UP BROADCAST RUNNING MASTER MULTICAST  MTU:1500  Metric:1
          RX packets:334060 errors:0 dropped:1157 overruns:0 frame:0
          TX packets:2866 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:25286767 (25.2 MB)  TX bytes:1099326 (1.0 MB)

bond0:1   Link encap:Ethernet  HWaddr 0c:c4:7a:de:bf:24
          inet addr:10.0.0.11  Bcast:10.0.0.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MASTER MULTICAST  MTU:1500  Metric:1

brq8ac8c00b-41 Link encap:Ethernet  HWaddr 2e:bd:04:69:cb:f7
          inet addr:10.0.0.11  Bcast:10.0.0.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:144 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:6048 (6.0 KB)
2016-12-13 09:22:38 -0500 获得奖牌  受欢迎的问题 (source)
2016-12-05 09:04:11 -0500 问了问题 Which method to deploy openstack? Manually vs Ansible Vs Autopilot Vs Fuel

Scenario / hardware:

  • 1 x controller node 8 x compute nodes
  • (2TB memory total, all local SSD disk storage only)
  • For a small web and vps host
  • On to Ubuntu 16.04

Initally offering basic image, compute and networking, will be adding centralised block storage, object storage and other items later. No plans to scale up on the above in the next 2 years.

I have installed openstack manually in a test environment on Ubuntu 16.04 by following the standard install documentation. I have a good amount of experience with Ansible.

Which method would you use to deploy openstack in this scenario and why? Such as:

  • Manually
  • Ansible
  • Fuel
  • Autopilot
  • any others?
2016-06-27 04:56:16 -0500 获得奖牌  热门的问题 (source)
2016-06-12 13:51:22 -0500 获得奖牌  著名问题 (source)
2016-05-05 04:43:32 -0500 获得奖牌  著名问题 (source)
2016-05-04 08:36:45 -0500 获得奖牌  受欢迎的问题 (source)
2016-05-04 04:02:50 -0500 评论回答 External network for new Mitaka install?

Glad you got it sorted! I've only done option 1 so far, as i wanted to keep it simple. Can you do me a favour and create an instance on the provider network only (no nat) and see if you can ping it? I still can't get any external access to instances on the provider network.

2016-05-03 11:00:16 -0500 问了问题 New Instance won't Ping

I've followed the Mitaka setup guide for my first OpenStack cloud. This all went ok (2nd time around!), however i'm now having issues with networking. The instance launches ok, and it's assigned an IP via DHCP, but it won't ping. I don't know if my network is setup right, so i've provided the appropriate outputs below.

I setup Mitaka with option 2 - 'self service networks', but for simplicity i've only created a Flat DHCP 'provider' network just to get a feel for things. On my test setup I only have 1 working public IP address, x.x.x.111

    root@controller:~# openstack network list
+--------------------------------------+----------+--------------------------------------+
| ID                                   | Name     | Subnets                              |
+--------------------------------------+----------+--------------------------------------+
| 2a14a7d2-929b-49f8-8711-f5f1742fc523 | provider | 17681cf7-5ac7-426d-8ea8-91b3cf810141 |
+--------------------------------------+----------+--------------------------------------+


root@controller:~# openstack network show  2a14a7d2-929b-49f8-8711-f5f1742fc523
+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        | nova                                 |
| created_at                | 2016-04-29T19:25:56                  |
| description               |                                      |
| id                        | 2a14a7d2-929b-49f8-8711-f5f1742fc523 |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| mtu                       | 1500                                 |
| name                      | provider                             |
| port_security_enabled     | True                                 |
| project_id                | 4864e2e05328471a849c9cb26ed4e27e     |
| provider:network_type     | flat                                 |
| provider:physical_network | provider                             |
| provider:segmentation_id  | None                                 |
| router_external           | Internal                             |
| shared                    | True                                 |
| status                    | ACTIVE                               |
| subnets                   | 17681cf7-5ac7-426d-8ea8-91b3cf810141 |
| tags                      | []                                   |
| updated_at                | 2016-05-02T20:35:32                  |
+---------------------------+--------------------------------------+


root@controller:~# openstack subnet show 17681cf7-5ac7-426d-8ea8-91b3cf810141
+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| allocation_pools  | x.x.164.111-x.x.164.111      |
| cidr              | x.x.164.0/24                     |
| created_at        | 2016-04-30T07:16:23                  |
| description       |                                      |
| dns_nameservers   | 213.186.33.99                        |
| enable_dhcp       | True                                 |
| gateway_ip        | x.x.164.252                      |
| host_routes       |                                      |
| id                | 17681cf7-5ac7-426d-8ea8-91b3cf810141 |
| ip_version        | 4                                    |
| ipv6_address_mode | None                                 |
| ipv6_ra_mode      | None                                 |
| name              | provider                             |
| network_id        | 2a14a7d2-929b-49f8-8711-f5f1742fc523 |
| project_id        | 4864e2e05328471a849c9cb26ed4e27e     |
| subnetpool_id     | None                                 |
| updated_at        | 2016-04-30T07:16:23                  |
+-------------------+--------------------------------------+

root@controller:~# openstack server show f604d990-cadc-433c-b617-e3ea5f68f3ad
+--------------------------------------+----------------------------------------------------------+
| Field                                | Value                                                    |
+--------------------------------------+----------------------------------------------------------+
| OS-DCF:diskConfig                    | AUTO                                                     |
| OS-EXT-AZ:availability_zone          | nova                                                     |
| OS-EXT-SRV-ATTR:host                 | compute1                                                 |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | compute1                                                 |
| OS-EXT-SRV-ATTR:instance_name        | instance-0000000c                                        |
| OS-EXT-STS:power_state               | 1                                                        |
| OS-EXT-STS:task_state                | None                                                     |
| OS-EXT-STS:vm_state                  | active                                                   |
| OS-SRV-USG:launched_at               | 2016-05-03T15:30:34.000000                               |
| OS-SRV-USG:terminated_at             | None                                                     |
| accessIPv4                           |                                                          |
| accessIPv6                           |                                                          |
| addresses                            | provider=x.x.x.111                                       |
| config_drive                         |                                                          |
| created                              | 2016-05-03T15:30:27Z                                     |
| flavor                               | m1.medium (3)                                            |
| hostId                               | a8af2b53ead6cfc050a24e875e3c42fa32ece6c3002652123cd04d2c |
| id                                   | f604d990-cadc-433c-b617-e3ea5f68f3ad                     |
| image                                | Ubuntu 14.04 LTS (63576a8c-408f-4a59-947d-d7ab3bd60a67)  |
| key_name                             | mykey                                                    |
| name                                 | test                                                     |
| os-extended-volumes:volumes_attached | []                                                       |
| progress                             | 0                                                        |
| project_id                           | 4864e2e05328471a849c9cb26ed4e27e                         |
| properties                           |                                                          |
| security_groups                      | [{u'name': u'default'}]                                  |
| status                               | ACTIVE                                                   |
| updated                              | 2016-05-03T15:30:34Z                                     |
| user_id                              | 93f3b9fa687647e2838afac8f40ae020                         |
+--------------------------------------+----------------------------------------------------------+

root@controller:~# openstack security group show default
+-------------+--------------------------------------------------------------------------------------------------------+
| Field       | Value                                                                                                  |
+-------------+--------------------------------------------------------------------------------------------------------+
| description | Default security group                                                                                 |
| id          | 2884d4ac-a91f-411a-9a2b-eb249ddf5ef0                                                                   |
| name        | default                                                                                                |
| project_id  | 4864e2e05328471a849c9cb26ed4e27e                                                                       |
| rules       | id='10f8ef55-2275-4f25-94f9-4e38dbec3ccf', ip_protocol='tcp', ip_range='0.0.0.0/0', port_range='22:22' |
|             | id='b5ce2770-f099-4944-b7f8-8cc660c09a40', remote_security_group='default'                             |
|             | id='eda22bb6-529b-45f7-b4ab-48ef1b8b271a', ip_protocol='icmp', ip_range='0.0.0.0/0'                    |
|             | id='ef5edd41-c81c-42dc-8f95-26ad9ff20dc4', remote_security_group='default'                             |
+-------------+--------------------------------------------------------------------------------------------------------+
2016-05-03 10:36:57 -0500 回答问题 External network for new Mitaka install?

Did you follow the guides on http://docs.openstack.org/mitaka/install-guide-ubuntu/launch-instance.html (this page) under the 'Create virtual networks' header? It shows how to create the provider and self service network.

I've done this, and I'm in the same boat as you unfortunately - new install of Mitaka and have no external network access.

2016-04-29 15:47:23 -0500 回答问题 Can't Create Instance - Unable to Establish Connection to 127.0.0.1:9696

Resolved by re-imaging and reinstalling - no idea what this problem was, and i don't think i ever will!

2016-04-29 08:59:57 -0500 获得奖牌  编辑 (source)
2016-04-29 08:59:16 -0500 获得奖牌  热门的问题 (source)
2016-04-28 07:12:42 -0500 获得奖牌  热门的问题 (source)
2016-04-28 07:11:43 -0500 获得奖牌  粉丝
2016-04-26 13:33:44 -0500 获得奖牌  受欢迎的问题 (source)
2016-04-25 16:15:16 -0500 获得奖牌  受欢迎的问题 (source)
2016-04-25 10:38:26 -0500 回答问题 neutron-linuxbridge-agent Stuck in Loop - RTNETLINK answers: Operation not supported

Problem was due to lack of vxlan support in kernel. Switched to generic ubuntu kernel and issue has resolved.

2016-04-24 17:09:40 -0500 问了问题 neutron-linuxbridge-agent Stuck in Loop - RTNETLINK answers: Operation not supported

I've setup a Openstack following the Ubuntu installation guide. It looks like I have a Neutron issue on my compute node. It's stuck at 100% CPU, looping continuously over the following. Judging by the 'RTNETLINK answers: Operation not supported', it's trying to do something to the network interfaces, but can't - something to do with the vxlan. I've tried rebooting the node, and tracing through the code, but I'm not having much luck.

 2016-04-25 00:04:26.613 17806 INFO neutron.common.config [-] Logging enabled!
2016-04-25 00:04:26.614 17806 INFO neutron.common.config [-] /usr/bin/neutron-linuxbridge-agent version 8.0.0
2016-04-25 00:04:26.614 17806 INFO neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent [-] Interface mappings: {'provider': 'eth0'}
2016-04-25 00:04:26.615 17806 INFO neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent [-] Bridge mappings: {}
2016-04-25 00:04:26.810 17806 ERROR neutron.agent.linux.utils [-] Exit code: 2; Stdin: ; Stdout: ; Stderr: RTNETLINK answers: Operation not supported

2016-04-25 00:04:26.828 17806 CRITICAL neutron [-] RuntimeError: Exit code: 2; Stdin: ; Stdout: ; Stderr: RTNETLINK answers: Operation not supported

2016-04-25 00:04:26.828 17806 ERROR neutron Traceback (most recent call last):
2016-04-25 00:04:26.828 17806 ERROR neutron   File "/usr/bin/neutron-linuxbridge-agent", line 10, in <module>
2016-04-25 00:04:26.828 17806 ERROR neutron     sys.exit(main())
2016-04-25 00:04:26.828 17806 ERROR neutron   File "/usr/lib/python2.7/dist-packages/neutron/cmd/eventlet/plugins/linuxbridge_neutron_agent.py", line 21, in main
2016-04-25 00:04:26.828 17806 ERROR neutron     agent_main.main()
2016-04-25 00:04:26.828 17806 ERROR neutron   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 888, in main
2016-04-25 00:04:26.828 17806 ERROR neutron     manager = LinuxBridgeManager(bridge_mappings, interface_mappings)
2016-04-25 00:04:26.828 17806 ERROR neutron   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 76, in __init__
2016-04-25 00:04:26.828 17806 ERROR neutron     self.check_vxlan_support()
2016-04-25 00:04:26.828 17806 ERROR neutron   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 618, in check_vxlan_support
2016-04-25 00:04:26.828 17806 ERROR neutron     if self.vxlan_ucast_supported():
2016-04-25 00:04:26.828 17806 ERROR neutron   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 581, in vxlan_ucast_supported
2016-04-25 00:04:26.828 17806 ERROR neutron     test_iface = self.ensure_vxlan(seg_id)
2016-04-25 00:04:26.828 17806 ERROR neutron   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 286, in ensure_vxlan
2016-04-25 00:04:26.828 17806 ERROR neutron     return None
2016-04-25 00:04:26.828 17806 ERROR neutron   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-04-25 00:04:26.828 17806 ERROR neutron     self.force_reraise()
2016-04-25 00:04:26.828 17806 ERROR neutron   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-04-25 00:04:26.828 17806 ...
(more)
2016-04-24 10:26:17 -0500 问了问题 Can't Create Instance - Unable to Establish Connection to 127.0.0.1:9696

I've setup OpenStack for the first time to start learning. I've followed the installation guide and i believe i've got everything correct. However, when trying to create an instance i get the error:

Build of instance e948205a-2287-4b0e-9829-f2c6fe3a93eb aborted: Unable to establish connection to http://127.0.0.1:9696/v2.0/extensions.json (http://127.0.0.1:9696/v2.0/extensions...)

From what I understand this is the api request to Neutron. Neutron is running on the controller and it's listening:

netstat -ln | grep 9696 tcp 0
0 0.0.0.0:9696 0.0.0.0:*
LISTEN

What I don't understand, and I'm not sure if this is part of the problem, is that it should be looking for http://controller:9696/v2.0/extensions.json (http://controller:9696/v2.0/extension...) rather than 127.0.0.1? I don't know if this is being run from the compute node and therefore won't find it on localhost. I've checked all configs for mentions of 127.0.0.1 but can't find it, and I've checked the api endpoints in the Keystone database. I've also rebooted both controller and compute node. My other assumption is that I have an auth problem, but I don't know how to identify this.

My neutron api endpoints:

| 440735e5dd8d468e89de9a8077ea9491 | RegionOne | neutron      | network      | True    | public    | http://controller:9696                    |
| 5985d944b02b4148a87cafae8df006c8 | RegionOne | neutron      | network      | True    | internal  | http://controller:9696                    |

I've checked all of the Nova and Neutron logs, and i can't see any errors in there so I'm at a loss how to continue debugging.

Update: Further debugging and testing is showing i can authenticate and get a response from neutron manually with the curl test below, this responds with expected data.

curl -i -H'X-Auth-Token: MY_TOKEN' http://controller:9696/v2.0/extensions.json

I now have debug info in the create error:

| {u'message': u'Build of instance 3e2f5678-6a4a-478b-8953-d10db929d367 aborted: Unable to establish connection to http://127.0.0.1:9696/v2.0/extensions.json', u'code': 500, u'details': u'  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1926, in _do_build_and_run_instance\n    filter_properties)\n  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2083, in _build_and_run_instance\n    \'create.error\', fault=e)\n  File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__\n    self.force_reraise()\n  File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise\n    six.reraise(self.type_, self.value, self.tb)\n  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2067, in _build_and_run_instance\n    instance=instance)\n  File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__\n    self.gen.throw(type, value, traceback)\n  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2244, in _build_resources\n    reason=six.text_type(exc))\n', u'created': u'2016-04-29T13:56:55Z'} |