Ask Your Question

chakravarthy's profile - activity

2019-06-11 04:41:07 -0500 received badge  Famous Question (source)
2019-05-15 09:25:25 -0500 received badge  Famous Question (source)
2019-05-15 09:25:25 -0500 received badge  Popular Question (source)
2019-05-15 09:25:25 -0500 received badge  Notable Question (source)
2019-04-04 08:51:46 -0500 received badge  Notable Question (source)
2019-04-04 01:02:55 -0500 received badge  Popular Question (source)
2019-04-03 07:43:41 -0500 asked a question Failed to import plugin clustering && Internal Server Error (HTTP 500)

After installing Heat and Magnum in queens version of Openstack, started seeing below errors in every openstack cli command:

$ openstack hypervisor list
WARNING: Failed to import plugin clustering.

and in specific openstack commands like:

$ openstack coe service list
WARNING: Failed to import plugin clustering.
Internal Server Error (HTTP 500)
$ magnum service-list
ERROR: Internal Server Error (HTTP 500)

What could be the issue and how to resolve this?

2019-04-02 09:52:51 -0500 answered a question openstack as loadbalancer for kubernetes

I am also working on this area unsuccessfully by installing Neutron Lbass and Octavia. Today i read about magnum API service which manages Kubernetes cluster. You can take a look at this https://docs.openstack.org/magnum/ocata/dev/kubernetes-load-balancer.html (link) to have a better understanding. I will give it a try tomorrow. Mean while you too can give it a try.

2019-04-02 03:50:40 -0500 commented answer VNC console in dashboard failed to connect to server (code: 1006)

I reinstalled everything and didn't see this issue. I have not included above change and still it works. just followed the instructions from the official documentation.

2019-04-01 09:15:39 -0500 asked a question Any document providing step by step Octavia installation on ubnutu?

I am finding it difficult to install a load balancer (Octavia) in queens version of Openstack on Ubuntu. Any one has any proper link to install Octavia or lbassv2?

What I have already tried unsuccessfully?

https://wiki.openstack.org/wiki/Neutron/LBaaS/HowToRun#Getting_the_Code (https://wiki.openstack.org/wiki/Neutr...) (Ubuntu Packages Setup)

https://docs.openstack.org/python-octaviaclient/latest/install/index.html (https://docs.openstack.org/python-oct...)

on restarting neutron services, seeing errors like below in neutron-server.log:

2019-04-01 17:25:04.9enter code here85 2989 INFO neutron.services.service_base [req-05a59469-8411-4b1d-b561-02194a3f344a] Default provider is not specified for service type L3_ROUTER_NAT
2019-04-01 17:25:04.985 2989 INFO neutron.manager [req-05a59469-8411-4b1d-b561-02194a3f344a] Loading Plugin: neutron.plugins.services.agent_loadbalancer.plugin.LoadBalancerPluginv2
2019-04-01 17:25:04.985 2989 ERROR neutron_lib.utils.runtime [req-05a59469-8411-4b1d-b561-02194a3f344a] Error loading class by alias: NoMatches: No 'neutron.service_plugins' driver found, looking for 'neutron.plugins.services.agent_loadbalancer.plugin.LoadBalancerPluginv2'

2019-04-01 17:29:14.398 3655 INFO neutron.db.l3_agentschedulers_db [req-7d6a48ae-0166-4891-8267-2a5ef5477c3f - - - - -] Skipping period L3 agent status check because automatic router rescheduling is disabled.
2019-04-01 17:29:14.398 3655 WARNING stevedore.named [req-7d6a48ae-0166-4891-8267-2a5ef5477c3f - - - - -] Could not load neutron_lbaas.drivers.octavia.driver.OctaviaDriver
2019-04-01 17:29:14.399 3655 INFO neutron.services.service_base [req-7d6a48ae-0166-4891-8267-2a5ef5477c3f - - - - -] Default provider is not specified for service type L3_ROUTER_NAT
2019-04-01 17:29:14.399 3655 INFO neutron.manager [req-7d6a48ae-0166-4891-8267-2a5ef5477c3f - - - - -] Loading Plugin: neutron_lbaas.services.loadbalancer.plugin.LoadBalancerPluginv2
2019-04-01 17:29:14.399 3655 ERROR neutron_lib.utils.runtime [req-7d6a48ae-0166-4891-8267-2a5ef5477c3f - - - - -] Error loading class by alias: NoMatches: No 'neutron.service_plugins' driver found, looking for 'neutron_lbaas.services.loadbalancer.plugin.LoadBalancerPluginv2'

---

2019-04-01 17:50:23.688 6570 WARNING stevedore.named [req-1d30fd3c-45b8-43d0-b46f-8ec0d735493e - - - - -] Could not load neutron_lbaas.drivers.octavia.driver.OctaviaDriver
2019-04-01 17:50:23.689 6570 INFO neutron.services.service_base [req-1d30fd3c-45b8-43d0-b46f-8ec0d735493e - - - - -] Default provider is not specified for service type L3_ROUTER_NAT
2019-04-01 17:50:23.689 6570 INFO neutron.manager [req-1d30fd3c-45b8-43d0-b46f-8ec0d735493e - - - - -] Loading Plugin: lbaasv2
2019-04-01 17:50:23.689 6570 ERROR neutron_lib.utils.runtime [req-1d30fd3c-45b8-43d0-b46f-8ec0d735493e - - - - -] Error loading class by alias: NoMatches: No 'neutron.service_plugins' driver found, looking for 'lbaasv2'
2019-04-01 07:46:19 -0500 received badge  Famous Question (source)
2019-04-01 07:38:12 -0500 received badge  Famous Question (source)
2019-03-15 10:58:47 -0500 received badge  Notable Question (source)
2019-03-15 10:58:47 -0500 received badge  Popular Question (source)
2019-03-15 05:45:11 -0500 received badge  Notable Question (source)
2019-03-14 01:49:20 -0500 commented question VNC console in dashboard failed to connect to server (code: 1006)

@Mohit, thanks for your comment. changing controller to IP didn't fix this issue. tried restarting the nova services in controller and compute machines and also tried restarting the VM.

2019-03-13 15:54:02 -0500 received badge  Popular Question (source)
2019-03-13 09:33:52 -0500 asked a question VNC console in dashboard failed to connect to server (code: 1006)

Unable to access VM thorough console in dashboard. I have multi-node Queens version of openstack bare metal setup on ubuntu 16.

Errors:

Failed to connect to server (code: 1006)

2019-03-13 18:55:15.926 9339 INFO nova.console.websocketproxy [req-db19bd87-c70b-481d-8939-d3957fe2d393 - - - - -] handler exception: [Errno 110] ETIMEDOUT

2019-03-13 13:25:13,556 - url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [0/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by <class 'socket.error'>: [Errno 101] Network is unreachable)]

My vnc configuration in controller's nova.conf is as mentioned below:

[DEFAULT]
my_ip = 10.0.0.11
[vnc]
enabled = true
server_listen = $my_ip
server_proxyclient_address = $my_ip

My vnc configuration in compute's nova.conf is as mentioned below:

[DEFAULT]
my_ip = 10.0.0.31
[vnc]
enabled = true
server_listen = 0.0.0.0
server_proxyclient_address = $my_ip
novncproxy_base_url = http://controller:6080/vnc_auto.html

My VM's console log points to route error:

ci-info: !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!Route info failed!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
2019-03-13 13:25:13,556 - url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [0/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by <class 'socket.error'>: [Errno 101] Network is unreachable)]
...
2019-03-13 13:27:19,970 - DataSourceEc2.py[CRITICAL]: Giving up on md from ['http://169.254.169.254/2009-04-04/meta-data/instance-id'] after 126 seconds
2019-03-13 13:27:19,973 - util.py[WARNING]: Getting data from <class 'cloudinit.sources.DataSourceCloudStack.DataSourceCloudStack'> failed

My nova-novncproxy.log point to timeout error:

2019-03-13 18:52:18.040 9266 INFO nova.console.websocketproxy [-] WebSocket server settings:
2019-03-13 18:52:18.040 9266 INFO nova.console.websocketproxy [-]   - Listen on 0.0.0.0:6080
2019-03-13 18:52:18.040 9266 INFO nova.console.websocketproxy [-]   - Flash security policy server
2019-03-13 18:52:18.041 9266 INFO nova.console.websocketproxy [-]   - Web server (no directory listings). Web root: /usr/share/novnc
2019-03-13 18:52:18.041 9266 INFO nova.console.websocketproxy [-]   - No SSL/TLS support (no cert file)
2019-03-13 18:52:18.041 9266 INFO nova.console.websocketproxy [-]   - proxying from 0.0.0.0:6080 to None:None
2019-03-13 18:53:05.622 9339 INFO nova.console.websocketproxy [-] 10.0.0.11 - - [13/Mar/2019 18:53:05] 10.0.0.11: Plain non-SSL (ws://) WebSocket connection
2019-03-13 18:53:05.639 9339 INFO nova.console.websocketproxy [-] 10.0.0.11 - - [13/Mar/2019 18:53:05] 10.0.0.11: Version hybi-13, base64: 'False'
2019-03-13 18:53:05.640 9339 INFO nova.console.websocketproxy [-] 10.0.0.11 - - [13/Mar/2019 18:53:05] 10.0.0.11: Path: '/websockify'
2019-03-13 18:53:05.890 9339 INFO nova.console.websocketproxy [req-db19bd87-c70b-481d-8939-d3957fe2d393 - - - - -]   2: connect info: {u'instance_uuid': u'6c1337ca-f4d3-4072-9133-ce03afac1f53', u'internal_access_path': None, u'last_activity_at': 1552483384.72316, u'console_type': u'novnc', u'host': u'10.0.0.31', u'token': u'39e439b5-4406-4fbb-b305-90ba3e800cb1', u'access_url': u'http://controller:6080/vnc_auto.html?token=39e439b5-4406-4fbb-b305-90ba3e800cb1', u'port': u'5900'}
2019-03-13 ...
(more)
2019-03-13 07:01:28 -0500 answered a question cannot ssh to vm deployed on provider network

I could resolve this issue by adding br-ex(br-provider) to my compute node, all thanks to @Bernd Bausch

Below are the changes I made to fix this issue.

  1. Create the OVS provider bridge:

    $ ovs-vsctl add-br br-provider

  2. In the /etc/neutron/plugins/ml2/openvswitch_agent.ini file, configure the layer-2 agent.

    [ovs]

    bridge_mappings = provider:br-provider

    local_ip = OVERLAY_INTERFACE_IP_ADDRESS

    [agent]

    tunnel_types = vxlan

    l2_population = True

    [securitygroup]

    firewall_driver = iptables_hybrid

    Note: Replace OVERLAY_INTERFACE_IP_ADDRESS with the IP address of the interface that handles VXLAN overlays for provider networks.

Reference link: https://docs.openstack.org/ocata/networking-guide/deploy-ovs-selfservice.html (https://docs.openstack.org/ocata/netw...)

2019-03-13 06:45:40 -0500 received badge  Famous Question (source)
2019-01-18 07:13:59 -0500 asked a question cannot ssh to vm deployed on provider network

I could ssh to any VM deployed on private(selfservice) network but I ccouldn't ssh to a VM deployed on public(provider) network.

Not sure what logs I should be looking into to debug this issue. Any suggestions to debug or fix this issue would be of great help. I will share if any logs are required.

Thanks, Chakravarthy

2019-01-18 07:13:59 -0500 answered a question Message: No valid host was found. There are not enough hosts available., Code: 500

I could resolve this issue by adding br-ex(br-provider) to my compute node, all thanks to @Bernd Bausch

Below are the changes I made to fix this issue.

  1. Create the OVS provider bridge:

    $ ovs-vsctl add-br br-provider

  2. In the /etc/neutron/plugins/ml2/openvswitch_agent.ini file, configure the layer-2 agent.

    [ovs]

    bridge_mappings = provider:br-provider

    local_ip = OVERLAY_INTERFACE_IP_ADDRESS

    [agent]

    tunnel_types = vxlan

    l2_population = True

    [securitygroup]

    firewall_driver = iptables_hybrid

    Note: Replace OVERLAY_INTERFACE_IP_ADDRESS with the IP address of the interface that handles VXLAN overlays for self-service networks.

Reference link: https://docs.openstack.org/ocata/networking-guide/deploy-ovs-selfservice.html (https://docs.openstack.org/ocata/netw...)

2019-01-11 00:43:56 -0500 received badge  Notable Question (source)
2019-01-11 00:43:52 -0500 received badge  Enthusiast
2019-01-08 02:08:54 -0500 commented question Message: No valid host was found. There are not enough hosts available., Code: 500

Could you please put some light on them and any inputs on how to resolve this issue would be great.

Thank you.

2019-01-08 02:08:54 -0500 commented question Message: No valid host was found. There are not enough hosts available., Code: 500

Thank you @Bernd Bausch for your comments. Regarding flavors, later I tried with flavor id and I didn't see the issue with flavor.

Updated the question with openvswitch agent logs. They do say of some port not being present, but I didn't understand them.

2019-01-08 00:20:25 -0500 received badge  Editor (source)
2019-01-08 00:19:04 -0500 received badge  Popular Question (source)
2019-01-04 08:08:52 -0500 asked a question Message: No valid host was found. There are not enough hosts available., Code: 500

I see the above error when trying to create a stack using heat template in Ocata version of openstack, although I have enough resources available in my compute node. My setup has a controller, 2 compute nodes(compute, compute1) and a storage node.

From dashboard I can see that my

first compute node(compute) has used 88 VCPU's of total 144 VCPU's, has used 176GB RAM of total 256GB, has used 1.5TB of total 1.7TB of HDD

second compute node(compute1) has used 0 VCPU's of total 4 VCPU's, has used 1.4GB RAM of total 16GB of RAM, has used 5GB of total 580GB of HDD

I have copied most of the logs that could of use to identify the issue.

Sorry if I have added more than required logs. I will be happy to remove logs which are not required or add more logs if required.

Logs:

nova-api.log:
GET /v2.1/flavors/24c15ae6-d915-4cf8-a906-25d05db3ca8c HTTP/1.1" status: 200 len: 796 time: 0.0383818
2019-01-04 15:58:01.707 12156 INFO nova.api.openstack.wsgi [req-ce5070a4-e476-44f6-97d8-c8d408da634d 3d72bfdca5b74b6cb5bb8d88df6e13b8 1b23511421a34771be312bc10ecb95a5 - default default] HTTP exception thrown: Flavor m1.medium could not be found.
2019-01-04 15:58:01.708 12156 INFO nova.osapi_compute.wsgi.server [req-ce5070a4-e476-44f6-97d8-c8d408da634d 3d72bfdca5b74b6cb5bb8d88df6e13b8 1b23511421a34771be312bc10ecb95a5 - default default] 10.0.0.11 "GET /v2.1/flavors/m1.medium HTTP/1.1" status: 404 len: 436 time: 0.0614309
2019-01-04 15:58:01.810 12156 INFO nova.osapi_compute.wsgi.server [req-72c15f10-49d8-4419-a861-82f81e3c00cf 3d72bfdca5b74b6cb5bb8d88df6e13b8 1b23511421a34771be312bc10ecb95a5 - default default] 10.0.0.11 "GET /v2.1/flavors HTTP/1.1" status: 200 len: 1748 time: 0.0810490
2019-01-04 15:58:01.842 12156 INFO nova.osapi_compute.wsgi.server [req-bdf96a6f-357b-4d36-8fe0-86514c4187f3 3d72bfdca5b74b6cb5bb8d88df6e13b8 1b23511421a34771be312bc10ecb95a5 - default default] 10.0.0.11 "GET /v2.1/flavors/24c15ae6-d915-4cf8-a906-25d05db3ca8c HTTP/1.1" status: 200 len: 796 time: 0.0276790

In above log I see that the flavor m1.medium(24c15ae6-d915-4cf8-a906-25d05db3ca8c) is not found and immediately found later and I see these logs repeatedly. Not sure why?

nova-conductor.log
2019-01-04 16:06:51.514 11293 ERROR nova.scheduler.utils [req-061757b4-2c9b-4103-9604-66ef59989d1b 3d72bfdca5b74b6cb5bb8d88df6e13b8 1b23511421a34771be312bc10ecb95a5 - - -] [instance: cea485ed-d0c6-44af-a425-ec10d51bfa7d] Error from last host: compute (node compute): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1787, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2025, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance cea485ed-d0c6-44af-a425-ec10d51bfa7d was re-scheduled: Binding failed for port 8501b140-ed8b-4ce9-80b8-a03e1c1bfc12, please check neutron logs for more information.\n']
2019-01-04 16:06:51.672 11293 WARNING nova.scheduler.utils [req-061757b4-2c9b-4103-9604-66ef59989d1b 3d72bfdca5b74b6cb5bb8d88df6e13b8 1b23511421a34771be312bc10ecb95a5 - - -] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available.
Traceback (most recent call last):

  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 218, in inner
    return func(*args, **kwargs)

  File "/usr/lib/python2.7/dist-packages/nova/scheduler/manager.py", line 98, in select_destinations
    dests = self.driver.select_destinations(ctxt, spec_obj)

  File "/usr/lib/python2.7/dist-packages ...
(more)