Ask Your Question
0

[Errno 101] Network is unreachable

asked 2014-03-29 07:45:12 -0500

Diplomat gravatar image

Hey guys, I have this strange error when I'm trying to launch an instance. Any ideas what could be wrong?

url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [0/120s]: request error [[Errno 101] Network is unreachable]

edit retag flag offensive close merge delete

Comments

Say for instance :-

                        $ ip netns list

                         qrouter-d72adddf-4c02-4916-ae6d-16bfdaf59d99
                         qdhcp-1a4157a6-5cf2-46e3-bdea-1533c8f54cdf

                   What returns 

                    $ ip netns exec qrouter-d72adddf-4c02-4916-ae6d-16bfdaf59d99 \
                       iptables -L -t nat | grep 169

                   Should be 

                     REDIRECT   tcp  --  anywhere             169.254.169.254      tcp dpt:http redir ports 8700
dbaxps gravatar imagedbaxps ( 2014-03-29 09:39:19 -0500 )edit

My system (2 tenants) [root@dfw02 ~(keystone_admin)]$ ip netns list

qdhcp-1eea88bb-4952-4aa4-9148-18b61c22d5b7
qdhcp-426bb226-0ab9-440d-ba14-05634a17fb2b
qrouter-86b3008c-297f-4301-9bdc-766b839785f1
qrouter-bf360d81-79fb-4636-8241-0a843f228fc8

[root@dfw02 ~(keystone_admin)]$ ip netns exec qrouter-86b3008c-297f-4301-9bdc-766b839785f1 \
> iptables -L -t nat | grep 169
REDIRECT   tcp  --  anywhere             169.254.169.254      tcp dpt:http redir ports 8700

[root@dfw02 ~(keystone_admin)]$ ip netns exec qrouter-bf360d81-79fb-4636-8241-0a843f228fc8 \
> iptables -L -t nat | grep 169
REDIRECT   tcp  --  anywhere             169.254.169.254      tcp dpt:http redir ports 8700
dbaxps gravatar imagedbaxps ( 2014-03-29 09:50:28 -0500 )edit

Hey! Thank you for your answer.. here are my results:

[root@os1-phx ~]# ip netns list
qdhcp-a0f77214-ee62-4b7e-a7dc-f94fc4607fde
qdhcp-acd1faa1-7eff-449c-9490-cce2d6eaa003
qrouter-9295270a-acb1-4b1f-80c5-4b882cec731e
[root@os1-phx ~]# ip netns exec qrouter-9295270a-acb1-4b1f-80c5-4b882cec731e \
> iptables -L -t nat | grep 169
REDIRECT   tcp  --  anywhere             169.254.169.254     tcp dpt:http redir                                                      ports 9697
Diplomat gravatar imageDiplomat ( 2014-03-29 11:07:37 -0500 )edit

1 answer

Sort by ยป oldest newest most voted
-1

answered 2014-03-29 12:24:04 -0500

dbaxps gravatar image

updated 2014-03-30 14:31:02 -0500

   I have in /etc/sysconfig/iptables on Controller:-
                    -A INPUT -p tcp -m multiport --dports 8700 -m comment --comment "001 metadata incoming"
                in other words 


                    [root@dfw02 ~(keystone_admin)]$ iptables-save | grep 8700
                    -A INPUT -p tcp -m multiport --dports 8700 -m comment --comment "001 metadata incoming" -j ACCEPT

                So   8700 is neutron  metadata port.
                 Run
                 #  netstat -lntp | grep 9697      
                 #   iptables-save | grep 9697
                                To find out what you have on 9697.   It's a core issue

    Also make sure /etc/systcl.conf on Controller :-

                  net.ipv4.ip_forward = 1
                  net.ipv4.conf.all.rp_filter=0
                  net.ipv4.conf.default.rp_filter=0

      and /etc/sysctl.conf on compute nodes :-

       net.ipv4.ip_forward=1 
       net.bridge.bridge-nf-call-ip6tables=1
       net.bridge.bridge-nf-call-iptables=1
       net.bridge.bridge-nf-call-arptables=1


 You may have 9697 as metadata port on old system. I would expect entries for 9697 be like shown bellow for
 8700 on F20.

        Entries of port 8700 on my Controller :-
        [root@dfw02 nova(keystone_boris)]$ cat nova.conf | grep 8700
        metadata_listen_port = 8700

        [root@dfw02 nova(keystone_boris)]$ cd ../neutron

        [root@dfw02 neutron(keystone_boris)]$ ls -l
        total 72
        -rw-r-----. 1 root neutron   884 Jan 23 12:48 api-paste.ini
        -rw-r-----. 1 root neutron  2998 Mar 16 13:02 dhcp_agent.ini
        -rw-r--r--. 1 root neutron    73 Mar 16 13:26 dnsmasq.conf
        -rw-r--r--. 1 root neutron    79 Feb 26 12:51 dnsmasq-neutron.conf
        -rw-r-----. 1 root neutron   109 Dec 16 05:36 fwaas_driver.ini
        -rw-r-----. 1 root neutron  2520 Feb 18 22:57 l3_agent.ini
        -rw-r-----. 1 root neutron  1104 Dec 16 05:36 lbaas_agent.ini
        -rw-r-----. 1 root neutron  1084 Jan 23 18:25 metadata_agent.ini
        -rw-r--r--. 1 root neutron   876 Jan 23 12:58 neutron.conf
        -rw-r-----. 1 root neutron 13635 Jan 23 11:55 neutron.save
        lrwxrwxrwx. 1 root root       55 Jan 23 11:49 plugin.ini -> /etc/neutron/plugins/openvswitch/ovs_neutron_plugin.ini
        drwxr-xr-x. 3 root root     4096 Jan 23 11:01 plugins
        -rw-r-----. 1 root neutron  5853 Dec 16 05:36 policy.json
        -rw-r--r--. 1 root root       79 Dec 18 17:30 release
        -rw-r--r--. 1 root root     1214 Dec 16 05:36 rootwrap.conf

        [root@dfw02 neutron(keystone_boris)]$ cat l3_agent.ini | grep 8700
        metadata_port = 8700

        [root@dfw02 neutron(keystone_boris)]$ cat metadata_agent.ini | grep 8700
        nova_metadata_port = 8700

        [root@dfw02 ~(keystone_admin)]$ netstat -lntp | grep 8700
        tcp        0      0 0.0.0.0:8700            0.0.0.0:*               LISTEN      2749/python         
        [root@dfw02 ~(keystone_admin)]$ ps -ef | grep 2749
        nova      2749     1  0 09:34 ?        00:00:05 /usr/bin/python /usr/bin/nova-api --logfile /var/log/nova/api.log
        nova      2852  2749  0 09:34 ?        00:00:00 /usr/bin/python /usr/bin/nova-api --logfile /var/log/nova/api.log
        nova      2893  2749  0 09:34 ?        00:00:03 /usr/bin/python /usr/bin/nova-api --logfile /var/log/nova/api.log
        nova      2894  2749  0 09:34 ?        00:00:00 /usr/bin/python /usr/bin/nova-api --logfile /var/log/nova/api.log
        root      8080  4116  0 09:46 pts/0    00:00:00 grep --color=auto 2749

I have also verified ...
(more)
edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower

Stats

Asked: 2014-03-29 07:45:12 -0500

Seen: 3,201 times

Last updated: Mar 30 '14