OpenStack Bobcat : Neutron ネットワークを構成する (VXLAN)2023/10/24 |
|
OpenStack Network Service（Neutron）による仮想ネットワークの構成です。
例として、VXLAN タイプのネットワークを構成します。
事前に以下のように Control ノード、 Network ノード、 Compute ノードの 各 Neutron サービスノードを構築済みであることが前提です。
また、当例では Network ノードが 2 つのネットワークインターフェースを持っているものとします。
------------+--------------------------+--------------------------+------------
| | |
eth0|10.0.0.30 eth0|10.0.0.50 eth0|10.0.0.51
+-----------+-----------+ +-----------+-----------+ +-----------+-----------+
| [ dlp.srv.world ] | | [ network.srv.world ] | | [ node01.srv.world ] |
| (Control Node) | | (Network Node) | | (Compute Node) |
| | | | | |
| MariaDB RabbitMQ | | Neutron L2/L3 Agent | | Libvirt |
| Memcached Nginx | | Neutron Metadata | | Nova Compute |
| Keystone httpd | | Open vSwitch | | Neutron L2 Agent |
| Glance Nova API | | | | Open vSwitch |
| Neutron Server | | | | |
| Neutron Metadata | | | | |
+-----------------------+ +-----------+-----------+ +-----------------------+
eth1|(UP with no IP)
|
| [1] | Control ノードで以下のように設定変更します。 |
|
[root@dlp ~(keystone)]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # 最終行付近 : [tenant_network_types] に値を追記 [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan
# 最終行に追記 [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000 systemctl restart neutron-server |
| [2] | Network ノードで以下のように設定変更します。 |
|
# ブリッジ追加 [root@network ~]# ovs-vsctl add-br br-eth1
# 追加したブリッジのポートに [eth1] を追加 # [eth1] は環境によって異なるため自身の名称に置き換え [root@network ~]# ovs-vsctl add-port br-eth1 eth1
[root@network ~]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # 最終行付近 : [tenant_network_types] に値を追記 [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan
# 最終行に追記 [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000
[root@network ~]#
vi /etc/neutron/plugins/ml2/openvswitch_agent.ini # 最終行に追記
[agent]
tunnel_types = vxlan
prevent_arp_spoofing = True
[ovs]
# [local_ip] には当ノードのローカル IP アドレスを指定
local_ip = 10.0.0.50
bridge_mappings = physnet1:br-eth1
[root@network ~]#
systemctl restart neutron-dhcp-agent neutron-l3-agent neutron-metadata-agent neutron-openvswitch-agent
# Firewalld 稼働中の場合は VXLAN ポート許可 [root@network ~]# firewall-cmd --add-port=4789/udp [root@network ~]# firewall-cmd --runtime-to-permanent |
| [3] | Compute ノードで以下のように設定変更します。 |
|
[root@node01 ~]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # 最終行付近 : [tenant_network_types] に値を追記 [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan
# 最終行に追記 [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000
[root@node01 ~]#
vi /etc/neutron/plugins/ml2/openvswitch_agent.ini # 最終行に追記
[agent]
tunnel_types = vxlan
prevent_arp_spoofing = True
[ovs]
# [local_ip] には当ノードのローカル IP アドレスを指定
local_ip = 10.0.0.51
[root@node01 ~]#
systemctl restart neutron-openvswitch-agent
# Firewalld 稼働中の場合は VXLAN ポート許可 [root@node01 ~]# firewall-cmd --add-port=4789/udp [root@node01 ~]# firewall-cmd --runtime-to-permanent |
| [4] | 仮想ルーターを作成します。作業場所はどこでもよいですが、当例では Control ノード上で作業します。 |
|
[root@dlp ~(keystone)]# openstack router create router01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2023-10-24T06:19:13Z | | description | | | distributed | False | | enable_ndp_proxy | None | | external_gateway_info | null | | flavor_id | None | | ha | False | | id | aaa3591a-6a4b-4505-a532-2710e7173c68 | | name | router01 | | project_id | d9d13fdc603c42f69a0ea034b64a3cdb | | revision_number | 1 | | routes | | | status | ACTIVE | | tags | | | tenant_id | d9d13fdc603c42f69a0ea034b64a3cdb | | updated_at | 2023-10-24T06:19:13Z | +-------------------------+--------------------------------------+ |
| [5] | 内部用のネットワークを作成し、仮想ルーターに関連付けます。 |
|
# 内部用ネットワーク作成 [root@dlp ~(keystone)]# openstack network create private --provider-network-type vxlan +---------------------------+--------------------------------------+ | Field | Value | +---------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2023-10-24T06:19:42Z | | description | | | dns_domain | None | | id | 8c925702-1181-4c2a-8e27-b1d6afb9c3de | | ipv4_address_scope | None | | ipv6_address_scope | None | | is_default | False | | is_vlan_transparent | None | | mtu | 1450 | | name | private | | port_security_enabled | True | | project_id | d9d13fdc603c42f69a0ea034b64a3cdb | | provider:network_type | vxlan | | provider:physical_network | None | | provider:segmentation_id | 621 | | qos_policy_id | None | | revision_number | 1 | | router:external | Internal | | segments | None | | shared | False | | status | ACTIVE | | subnets | | | tags | | | tenant_id | d9d13fdc603c42f69a0ea034b64a3cdb | | updated_at | 2023-10-24T06:19:42Z | +---------------------------+--------------------------------------+ # 内部用ネットワークにサブネット作成 [root@dlp ~(keystone)]# openstack subnet create private-subnet --network private \ --subnet-range 192.168.100.0/24 --gateway 192.168.100.1 \ --dns-nameserver 10.0.0.10 +----------------------+--------------------------------------+ | Field | Value | +----------------------+--------------------------------------+ | allocation_pools | 192.168.100.2-192.168.100.254 | | cidr | 192.168.100.0/24 | | created_at | 2023-10-24T06:20:10Z | | description | | | dns_nameservers | 10.0.0.10 | | dns_publish_fixed_ip | None | | enable_dhcp | True | | gateway_ip | 192.168.100.1 | | host_routes | | | id | 6d794ec8-8649-41b9-ae1d-b4d8ea24218d | | ip_version | 4 | | ipv6_address_mode | None | | ipv6_ra_mode | None | | name | private-subnet | | network_id | 8c925702-1181-4c2a-8e27-b1d6afb9c3de | | project_id | d9d13fdc603c42f69a0ea034b64a3cdb | | revision_number | 0 | | segment_id | None | | service_types | | | subnetpool_id | None | | tags | | | updated_at | 2023-10-24T06:20:10Z | +----------------------+--------------------------------------+ # 仮想ルーターに内部ネットワークを設定 [root@dlp ~(keystone)]# openstack router add subnet router01 private-subnet
|
| [6] | 外部接続用のネットワークを作成し、仮想ルーターに関連付けます。 |
|
# 外部用ネットワーク作成 [root@dlp ~(keystone)]# openstack network create \ --provider-physical-network physnet1 \ --provider-network-type flat --external public +---------------------------+--------------------------------------+ | Field | Value | +---------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2023-10-24T06:21:38Z | | description | | | dns_domain | None | | id | fbb4c1cd-5033-479f-9482-d8493f20c014 | | ipv4_address_scope | None | | ipv6_address_scope | None | | is_default | False | | is_vlan_transparent | None | | mtu | 1500 | | name | public | | port_security_enabled | True | | project_id | d9d13fdc603c42f69a0ea034b64a3cdb | | provider:network_type | flat | | provider:physical_network | physnet1 | | provider:segmentation_id | None | | qos_policy_id | None | | revision_number | 1 | | router:external | External | | segments | None | | shared | False | | status | ACTIVE | | subnets | | | tags | | | tenant_id | d9d13fdc603c42f69a0ea034b64a3cdb | | updated_at | 2023-10-24T06:21:38Z | +---------------------------+--------------------------------------+ # 外部用ネットワークにサブネット作成 [root@dlp ~(keystone)]# openstack subnet create public-subnet \ --network public --subnet-range 10.0.0.0/24 \ --allocation-pool start=10.0.0.200,end=10.0.0.254 \ --gateway 10.0.0.1 --dns-nameserver 10.0.0.10 --no-dhcp +----------------------+--------------------------------------+ | Field | Value | +----------------------+--------------------------------------+ | allocation_pools | 10.0.0.200-10.0.0.254 | | cidr | 10.0.0.0/24 | | created_at | 2023-10-24T06:22:04Z | | description | | | dns_nameservers | 10.0.0.10 | | dns_publish_fixed_ip | None | | enable_dhcp | False | | gateway_ip | 10.0.0.1 | | host_routes | | | id | 88e85964-6c74-414e-bbfc-f9979c12f5b6 | | ip_version | 4 | | ipv6_address_mode | None | | ipv6_ra_mode | None | | name | public-subnet | | network_id | fbb4c1cd-5033-479f-9482-d8493f20c014 | | project_id | d9d13fdc603c42f69a0ea034b64a3cdb | | revision_number | 0 | | segment_id | None | | service_types | | | subnetpool_id | None | | tags | | | updated_at | 2023-10-24T06:22:04Z | +----------------------+--------------------------------------+ # 仮想ルーターにゲートウェイを設定 [root@dlp ~(keystone)]# openstack router set router01 --external-gateway public |
| [7] | 作成したネットワークは、外部用はデフォルトで全プロジェクトがアクセス可能ですが、内部用はデフォルトでは [admin] プロジェクトのみがアクセス可能なため、内部ネットワークを利用させたいプロジェクトにアクセス権限を付与しておきます。 |
|
# ネットワーク RBAC リスト表示 [root@dlp ~(keystone)]# openstack network rbac list +--------------------------------------+-------------+--------------------------------------+ | ID | Object Type | Object ID | +--------------------------------------+-------------+--------------------------------------+ | 5498954e-3272-4353-b4ba-2365b224bc60 | network | fbb4c1cd-5033-479f-9482-d8493f20c014 | +--------------------------------------+-------------+--------------------------------------+ # RBAC の詳細 # [access_as_external] のみ全プロジェクトがアクセス可能な状態 [root@dlp ~(keystone)]# openstack network rbac show 5498954e-3272-4353-b4ba-2365b224bc60 +-------------------+--------------------------------------+ | Field | Value | +-------------------+--------------------------------------+ | action | access_as_external | | id | 5498954e-3272-4353-b4ba-2365b224bc60 | | object_id | fbb4c1cd-5033-479f-9482-d8493f20c014 | | object_type | network | | project_id | d9d13fdc603c42f69a0ea034b64a3cdb | | target_project_id | * | +-------------------+--------------------------------------+ # 作成済みネットワーク一覧 [root@dlp ~(keystone)]# openstack network list +--------------------------------------+---------+--------------------------------------+ | ID | Name | Subnets | +--------------------------------------+---------+--------------------------------------+ | 8c925702-1181-4c2a-8e27-b1d6afb9c3de | private | 6d794ec8-8649-41b9-ae1d-b4d8ea24218d | | fbb4c1cd-5033-479f-9482-d8493f20c014 | public | 88e85964-6c74-414e-bbfc-f9979c12f5b6 | +--------------------------------------+---------+--------------------------------------+ # 作成済みプロジェクト一覧 [root@dlp ~(keystone)]# openstack project list +----------------------------------+-----------+ | ID | Name | +----------------------------------+-----------+ | 5d97881520b34e6bbf1f15e778c82fe4 | service | | d9d13fdc603c42f69a0ea034b64a3cdb | admin | | f4598dfd3b8a47149234b6892d18d5a4 | hiroshima | +----------------------------------+-----------+ # [private] への [access_as_shared] アクセス権を [hiroshima] プロジェクトに付与 [root@dlp ~(keystone)]# netID=$(openstack network list | grep private | awk '{ print $2 }') [root@dlp ~(keystone)]# prjID=$(openstack project list | grep hiroshima | awk '{ print $2 }') [root@dlp ~(keystone)]# openstack network rbac create --target-project $prjID --type network --action access_as_shared $netID +-------------------+--------------------------------------+ | Field | Value | +-------------------+--------------------------------------+ | action | access_as_shared | | id | 2d8e3683-1f95-451b-b38d-f29c692c758d | | object_id | 8c925702-1181-4c2a-8e27-b1d6afb9c3de | | object_type | network | | project_id | d9d13fdc603c42f69a0ea034b64a3cdb | | target_project_id | f4598dfd3b8a47149234b6892d18d5a4 | +-------------------+--------------------------------------+ |
| [8] | 内部ネットワークへのアクセス権を付与したプロジェクトに所属する任意のユーザーでログインし、 作成した内部ネットワークをインスタンスに紐付けてインスタンスを作成/起動します。 |
|
# 利用可能な [flavor] 確認 [cent@dlp ~(keystone)]$ openstack flavor list +----+-----------+------+------+-----------+-------+-----------+ | ID | Name | RAM | Disk | Ephemeral | VCPUs | Is Public | +----+-----------+------+------+-----------+-------+-----------+ | 1 | m1.small | 2048 | 10 | 0 | 1 | True | | 2 | m1.medium | 4096 | 10 | 0 | 2 | True | | 3 | m1.large | 8192 | 10 | 0 | 4 | True | | 4 | m2.large | 8192 | 10 | 10 | 4 | True | | 5 | m3.large | 8192 | 50 | 0 | 4 | True | +----+-----------+------+------+-----------+-------+-----------+ # 利用可能なイメージ確認 [cent@dlp ~(keystone)]$ openstack image list +--------------------------------------+----------------+--------+ | ID | Name | Status | +--------------------------------------+----------------+--------+ | bcbaa323-2438-4f5e-9473-49f633bb8f9b | CentOS-Stream9 | active | +--------------------------------------+----------------+--------+ # 利用可能なネットワーク確認 [cent@dlp ~(keystone)]$ openstack network list +--------------------------------------+---------+--------------------------------------+ | ID | Name | Subnets | +--------------------------------------+---------+--------------------------------------+ | 8c925702-1181-4c2a-8e27-b1d6afb9c3de | private | 6d794ec8-8649-41b9-ae1d-b4d8ea24218d | | fbb4c1cd-5033-479f-9482-d8493f20c014 | public | 88e85964-6c74-414e-bbfc-f9979c12f5b6 | +--------------------------------------+---------+--------------------------------------+ # インスタンス用のセキュリティグループを作成 [cent@dlp ~(keystone)]$ openstack security group create secgroup01 +-----------------+----------------------------------------------------------------------------+ | Field | Value | +-----------------+----------------------------------------------------------------------------+ | created_at | 2023-10-24T06:01:52Z | | description | secgroup01 | | id | 2fece9fc-ab36-430c-818e-c9c19404c02c | | name | secgroup01 | | project_id | f4598dfd3b8a47149234b6892d18d5a4 | | revision_number | 1 | | rules | created_at='2023-10-24T06:01:52Z', direction='egress', ethertype='IPv6'... | | | created_at='2023-10-24T06:01:52Z', direction='egress', ethertype='IPv4'... | | shared | False | | stateful | True | | tags | [] | | updated_at | 2023-10-24T06:01:52Z | +-----------------+----------------------------------------------------------------------------+ # インスタンス接続用の SSH キーペア作成 [cent@dlp ~(keystone)]$ ssh-keygen -q -N "" Enter file in which to save the key (/home/cent/.ssh/id_rsa): # 公開鍵登録 [cent@dlp ~(keystone)]$ openstack keypair create --public-key ~/.ssh/id_rsa.pub mykey +-------------+-------------------------------------------------+ | Field | Value | +-------------+-------------------------------------------------+ | created_at | None | | fingerprint | ae:d2:da:33:67:de:c7:1d:a5:bd:97:b2:31:de:be:0d | | id | mykey | | is_deleted | None | | name | mykey | | type | ssh | | user_id | d70a5f7908de4cd9aa8e189b725244a9 | +-------------+-------------------------------------------------+[cent@dlp ~(keystone)]$ netID=$(openstack network list | grep private | awk '{ print $2 }')
[cent@dlp ~(keystone)]$
[cent@dlp ~(keystone)]$ openstack server create --flavor m1.medium --image CentOS-Stream9 --security-group secgroup01 --nic net-id=$netID --key-name mykey CentOS-St9
openstack server list +--------------------------------------+------------+--------+------------------------+----------------+-----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+------------+--------+------------------------+----------------+-----------+ | 5daa5207-b055-4028-a4ca-467ac255b2aa | CentOS-St9 | ACTIVE | private=192.168.100.18 | CentOS-Stream9 | m1.medium | +--------------------------------------+------------+--------+------------------------+----------------+-----------+ |
| [9] | 作成した仮想マシンインスタンスにフローティング IP を割り当てます。 |
|
[cent@dlp ~(keystone)]$ openstack floating ip create public +---------------------+--------------------------------------+ | Field | Value | +---------------------+--------------------------------------+ | created_at | 2023-10-24T06:35:44Z | | description | | | dns_domain | None | | dns_name | None | | fixed_ip_address | None | | floating_ip_address | 10.0.0.241 | | floating_network_id | fbb4c1cd-5033-479f-9482-d8493f20c014 | | id | ee4e093b-efd2-4231-8477-711b4edcf0ac | | name | 10.0.0.241 | | port_details | None | | port_id | None | | project_id | f4598dfd3b8a47149234b6892d18d5a4 | | qos_policy_id | None | | revision_number | 0 | | router_id | None | | status | DOWN | | subnet_id | None | | tags | [] | | updated_at | 2023-10-24T06:35:44Z | +---------------------+--------------------------------------+
[cent@dlp ~(keystone)]$
openstack server add floating ip CentOS-St9 10.0.0.241
# 設定確認 [cent@dlp ~(keystone)]$ openstack floating ip show 10.0.0.241 +---------------------+--------------------------------------------------------------------------+ | Field | Value | +---------------------+--------------------------------------------------------------------------+ | created_at | 2023-10-24T06:35:44Z | | description | | | dns_domain | None | | dns_name | None | | fixed_ip_address | 192.168.100.18 | | floating_ip_address | 10.0.0.241 | | floating_network_id | fbb4c1cd-5033-479f-9482-d8493f20c014 | | id | ee4e093b-efd2-4231-8477-711b4edcf0ac | | name | 10.0.0.241 | | port_details | admin_state_up='True', device_id='5daa5207-b055-4028-a4ca-467ac255b2a... | | port_id | 08e55fd5-d3dd-4307-8029-896c200f7594 | | project_id | f4598dfd3b8a47149234b6892d18d5a4 | | qos_policy_id | None | | revision_number | 2 | | router_id | aaa3591a-6a4b-4505-a532-2710e7173c68 | | status | ACTIVE | | subnet_id | None | | tags | [] | | updated_at | 2023-10-24T06:36:13Z | +---------------------+--------------------------------------------------------------------------+[cent@dlp ~(keystone)]$ openstack server list +--------------------------------------+------------+--------+------------------------------------+----------------+-----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+------------+--------+------------------------------------+----------------+-----------+ | 5daa5207-b055-4028-a4ca-467ac255b2aa | CentOS-St9 | ACTIVE | private=10.0.0.241, 192.168.100.18 | CentOS-Stream9 | m1.medium | +--------------------------------------+------------+--------+------------------------------------+----------------+-----------+ |
| [10] | 起動した仮想マシンインスタンスに SSH 接続できるように、先に作成したセキュリティグループにポート許可の設定を追加します。 |
|
# ICMP 許可 [cent@dlp ~(keystone)]$ openstack security group rule create --protocol icmp --ingress secgroup01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | created_at | 2023-10-24T06:05:30Z | | description | | | direction | ingress | | ether_type | IPv4 | | id | 1d7f2882-a65c-4fa9-b642-df039d313b91 | | name | None | | normalized_cidr | 0.0.0.0/0 | | port_range_max | None | | port_range_min | None | | project_id | f4598dfd3b8a47149234b6892d18d5a4 | | protocol | icmp | | remote_address_group_id | None | | remote_group_id | None | | remote_ip_prefix | 0.0.0.0/0 | | revision_number | 0 | | security_group_id | 2fece9fc-ab36-430c-818e-c9c19404c02c | | tags | [] | | updated_at | 2023-10-24T06:05:30Z | +-------------------------+--------------------------------------+ # SSH 許可 [cent@dlp ~(keystone)]$ openstack security group rule create --protocol tcp --dst-port 22:22 secgroup01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | created_at | 2023-10-24T06:05:48Z | | description | | | direction | ingress | | ether_type | IPv4 | | id | 0f593e44-0200-41a2-9cc7-cd084225eaaf | | name | None | | normalized_cidr | 0.0.0.0/0 | | port_range_max | 22 | | port_range_min | 22 | | project_id | f4598dfd3b8a47149234b6892d18d5a4 | | protocol | tcp | | remote_address_group_id | None | | remote_group_id | None | | remote_ip_prefix | 0.0.0.0/0 | | revision_number | 0 | | security_group_id | 2fece9fc-ab36-430c-818e-c9c19404c02c | | tags | [] | | updated_at | 2023-10-24T06:05:48Z | +-------------------------+--------------------------------------+[cent@dlp ~(keystone)]$ openstack security group rule list secgroup01 +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ | ID | IP Protocol | Ethertype | IP Range | Port Range | Direction | Remote Security Group | Remote Address Group | +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ | 0f593e44-0200-41a2-9cc7-cd084225eaaf | tcp | IPv4 | 0.0.0.0/0 | 22:22 | ingress | None | None | | 1d7f2882-a65c-4fa9-b642-df039d313b91 | icmp | IPv4 | 0.0.0.0/0 | | ingress | None | None | | 1e13fbf6-d297-4a18-a595-59bacbc6355e | None | IPv6 | ::/0 | | egress | None | None | | a48fa185-3668-4245-81e9-39a4e1fbc7ef | None | IPv4 | 0.0.0.0/0 | | egress | None | None | +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ |
| [11] | 仮想マシンインスタンスに割りあてられたフローティング IP 宛てに SSH 接続することで、インスタンスに SSH ログインできます。 |
|
[cent@dlp ~(keystone)]$ openstack server list +--------------------------------------+------------+--------+------------------------------------+----------------+-----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+------------+--------+------------------------------------+----------------+-----------+ | 5daa5207-b055-4028-a4ca-467ac255b2aa | CentOS-St9 | ACTIVE | private=10.0.0.241, 192.168.100.18 | CentOS-Stream9 | m1.medium | +--------------------------------------+------------+--------+------------------------------------+----------------+-----------+[cent@dlp ~(keystone)]$ ssh centos@10.0.0.241 The authenticity of host '10.0.0.241 (10.0.0.241)' can't be established. ED25519 key fingerprint is SHA256:vHeIhGLeCE3w1EsEUqYBIKr71dn8MOl5rdWc9/sUPeM. This key is not known by any other names Are you sure you want to continue connecting (yes/no/[fingerprint])? yes Warning: Permanently added '10.0.0.241' (ED25519) to the list of known hosts. [centos@centos-st9 ~]$ # ログインできた |
| Sponsored Link |
|
|