CentOS Stream 9
Sponsored Link

OpenStack Zed : Neutron ネットワークを構成する (Geneve)2022/11/10

 
OpenStack Network Service(Neutron)による仮想ネットワークの構成です。
例として、Geneve カプセル化によるネットワークを構成します。
事前に以下のように Control ノードNetwork ノードCompute ノードの 各サービスノードを構築済みであることが前提です。
また、当例では Network ノードと Compute ノードが 2 つのネットワークインターフェースを持っているものとします。
------------+-----------------------------+-----------------------------+------------
            |                             |                             |
        eth0|10.0.0.30                eth0|10.0.0.50                eth0|10.0.0.51
+-----------+-----------+     +-----------+-----------+     +-----------+-----------+
|   [ dlp.srv.world ]   |     | [ network.srv.world ] |     |  [ node01.srv.world ] |
|     (Control Node)    |     |     (Network Node)    |     |     (Compute Node)    |
|                       |     |                       |     |                       |
|  MariaDB    RabbitMQ  |     |      Open vSwitch     |     |        Libvirt        |
|  Memcached  Nginx     |     |     Neutron Server    |     |      Nova Compute     |
|  Keystone   httpd     |     |      OVN-Northd       |     |      Open vSwitch     |
|  Glance     Nova API  |     |         Nginx         |     |   OVN Metadata Agent  |
|                       |     |                       |     |     OVN-Controller    |
+-----------------------+     +-----------+-----------+     +-----------+-----------+
                                      eth1|(UP with no IP)          eth1|(UP with no IP)

[1] Network ノードと Compute ノードの両方でブリッジマッピングを設定しておきます。
# ブリッジ作成 (名称は任意)

[root@network ~]#
ovs-vsctl add-br br-eth1
# 追加したブリッジのポートに [eth1] を追加
# [eth1] は環境によって異なるため自身の環境に置き換え

[root@network ~]#
ovs-vsctl add-port br-eth1 eth1
# ブリッジと [physnet1] をマッピング ([physnet1] の名称は任意)

[root@network ~]#
ovs-vsctl set open . external-ids:ovn-bridge-mappings=physnet1:br-eth1

[2] 仮想ルーターを作成します。作業場所はどこでもよいですが、当例では Control ノード上で作業します。
[root@dlp ~(keystone)]#
openstack router create router01

+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| admin_state_up          | UP                                   |
| availability_zone_hints |                                      |
| availability_zones      |                                      |
| created_at              | 2022-11-10T06:27:33Z                 |
| description             |                                      |
| external_gateway_info   | null                                 |
| flavor_id               | None                                 |
| id                      | f903d9e2-e823-4b84-b61f-00d96a31d35f |
| name                    | router01                             |
| project_id              | 939974d6fc8e400eb01f7dd749935ea3     |
| revision_number         | 0                                    |
| routes                  |                                      |
| status                  | ACTIVE                               |
| tags                    |                                      |
| updated_at              | 2022-11-10T06:27:33Z                 |
+-------------------------+--------------------------------------+
[3] 内部用のネットワークを作成し、仮想ルーターに関連付けます。
# 内部用ネットワーク作成

[root@dlp ~(keystone)]#
openstack network create private --provider-network-type geneve

+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2022-11-10T06:28:37Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | c9c79a1d-136e-4036-8fe0-eaac79f05f5d |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| is_vlan_transparent       | None                                 |
| mtu                       | 1442                                 |
| name                      | private                              |
| port_security_enabled     | True                                 |
| project_id                | 939974d6fc8e400eb01f7dd749935ea3     |
| provider:network_type     | geneve                               |
| provider:physical_network | None                                 |
| provider:segmentation_id  | 10682                                |
| qos_policy_id             | None                                 |
| revision_number           | 1                                    |
| router:external           | Internal                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| tags                      |                                      |
| updated_at                | 2022-11-10T06:28:37Z                 |
+---------------------------+--------------------------------------+

# 内部用ネットワークにサブネット作成

[root@dlp ~(keystone)]#
openstack subnet create private-subnet --network private \
--subnet-range 192.168.100.0/24 --gateway 192.168.100.1 \
--dns-nameserver 10.0.0.10

+----------------------+--------------------------------------+
| Field                | Value                                |
+----------------------+--------------------------------------+
| allocation_pools     | 192.168.100.2-192.168.100.254        |
| cidr                 | 192.168.100.0/24                     |
| created_at           | 2022-11-10T06:29:07Z                 |
| description          |                                      |
| dns_nameservers      | 10.0.0.10                            |
| dns_publish_fixed_ip | None                                 |
| enable_dhcp          | True                                 |
| gateway_ip           | 192.168.100.1                        |
| host_routes          |                                      |
| id                   | 85e66c6a-66eb-490f-a4fa-e21f91678c89 |
| ip_version           | 4                                    |
| ipv6_address_mode    | None                                 |
| ipv6_ra_mode         | None                                 |
| name                 | private-subnet                       |
| network_id           | c9c79a1d-136e-4036-8fe0-eaac79f05f5d |
| project_id           | 939974d6fc8e400eb01f7dd749935ea3     |
| revision_number      | 0                                    |
| segment_id           | None                                 |
| service_types        |                                      |
| subnetpool_id        | None                                 |
| tags                 |                                      |
| updated_at           | 2022-11-10T06:29:07Z                 |
+----------------------+--------------------------------------+

# 仮想ルーターに内部ネットワークを設定

[root@dlp ~(keystone)]#
openstack router add subnet router01 private-subnet
[4] 外部接続用のネットワークを作成し、仮想ルーターに関連付けます。
# 外部用ネットワーク作成

[root@dlp ~(keystone)]#
openstack network create \
--provider-physical-network physnet1 \
--provider-network-type flat --external public

+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2022-11-10T06:30:14Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | 004ca400-3d79-4c1b-b8fb-bba1e273000e |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| is_vlan_transparent       | None                                 |
| mtu                       | 1500                                 |
| name                      | public                               |
| port_security_enabled     | True                                 |
| project_id                | 939974d6fc8e400eb01f7dd749935ea3     |
| provider:network_type     | flat                                 |
| provider:physical_network | physnet1                             |
| provider:segmentation_id  | None                                 |
| qos_policy_id             | None                                 |
| revision_number           | 1                                    |
| router:external           | External                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| tags                      |                                      |
| updated_at                | 2022-11-10T06:30:14Z                 |
+---------------------------+--------------------------------------+

# 外部用ネットワークにサブネット作成

[root@dlp ~(keystone)]#
openstack subnet create public-subnet \
--network public --subnet-range 10.0.0.0/24 \
--allocation-pool start=10.0.0.200,end=10.0.0.254 \
--gateway 10.0.0.1 --dns-nameserver 10.0.0.10 --no-dhcp

+----------------------+--------------------------------------+
| Field                | Value                                |
+----------------------+--------------------------------------+
| allocation_pools     | 10.0.0.200-10.0.0.254                |
| cidr                 | 10.0.0.0/24                          |
| created_at           | 2022-11-10T06:30:45Z                 |
| description          |                                      |
| dns_nameservers      | 10.0.0.10                            |
| dns_publish_fixed_ip | None                                 |
| enable_dhcp          | False                                |
| gateway_ip           | 10.0.0.1                             |
| host_routes          |                                      |
| id                   | 80213093-ac95-469a-b4d9-8c6adc93cfe1 |
| ip_version           | 4                                    |
| ipv6_address_mode    | None                                 |
| ipv6_ra_mode         | None                                 |
| name                 | public-subnet                        |
| network_id           | 004ca400-3d79-4c1b-b8fb-bba1e273000e |
| project_id           | 939974d6fc8e400eb01f7dd749935ea3     |
| revision_number      | 0                                    |
| segment_id           | None                                 |
| service_types        |                                      |
| subnetpool_id        | None                                 |
| tags                 |                                      |
| updated_at           | 2022-11-10T06:30:45Z                 |
+----------------------+--------------------------------------+

# 仮想ルーターにゲートウェイを設定

[root@dlp ~(keystone)]#
openstack router set router01 --external-gateway public

[5] 作成したネットワークは、外部用はデフォルトで全プロジェクトがアクセス可能ですが、内部用はデフォルトでは [admin] プロジェクトのみがアクセス可能なため、内部ネットワークを利用させたいプロジェクトにアクセス権限を付与しておきます。
# ネットワーク RBAC リスト表示

[root@dlp ~(keystone)]#
openstack network rbac list

+--------------------------------------+-------------+--------------------------------------+
| ID                                   | Object Type | Object ID                            |
+--------------------------------------+-------------+--------------------------------------+
| 917144a3-3646-4dd9-965d-cb8b425b0657 | network     | 004ca400-3d79-4c1b-b8fb-bba1e273000e |
+--------------------------------------+-------------+--------------------------------------+

# RBAC の詳細
# [access_as_external] のみ全プロジェクトがアクセス可能な状態

[root@dlp ~(keystone)]#
openstack network rbac show 917144a3-3646-4dd9-965d-cb8b425b0657

+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| action            | access_as_external                   |
| id                | 917144a3-3646-4dd9-965d-cb8b425b0657 |
| object_id         | 004ca400-3d79-4c1b-b8fb-bba1e273000e |
| object_type       | network                              |
| project_id        | 939974d6fc8e400eb01f7dd749935ea3     |
| target_project_id | *                                    |
+-------------------+--------------------------------------+

# 作成済みネットワーク一覧

[root@dlp ~(keystone)]#
openstack network list

+--------------------------------------+---------+--------------------------------------+
| ID                                   | Name    | Subnets                              |
+--------------------------------------+---------+--------------------------------------+
| 004ca400-3d79-4c1b-b8fb-bba1e273000e | public  | 80213093-ac95-469a-b4d9-8c6adc93cfe1 |
| c9c79a1d-136e-4036-8fe0-eaac79f05f5d | private | 85e66c6a-66eb-490f-a4fa-e21f91678c89 |
+--------------------------------------+---------+--------------------------------------+

# 作成済みプロジェクト一覧

[root@dlp ~(keystone)]#
openstack project list

+----------------------------------+-----------+
| ID                               | Name      |
+----------------------------------+-----------+
| 28b6e37c787240e4a975d3614821cc71 | hiroshima |
| 62f531f4d2934e75b8d7f11cd7d53be3 | service   |
| 939974d6fc8e400eb01f7dd749935ea3 | admin     |
+----------------------------------+-----------+

# [private] への [access_as_shared] アクセス権を [hiroshima] プロジェクトに付与

[root@dlp ~(keystone)]#
netID=$(openstack network list | grep private | awk '{ print $2 }')

[root@dlp ~(keystone)]#
prjID=$(openstack project list | grep hiroshima | awk '{ print $2 }')

[root@dlp ~(keystone)]#
openstack network rbac create --target-project $prjID --type network --action access_as_shared $netID

+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| action            | access_as_shared                     |
| id                | a363eca5-83e0-4376-9ebe-ea256676db23 |
| object_id         | c9c79a1d-136e-4036-8fe0-eaac79f05f5d |
| object_type       | network                              |
| project_id        | 939974d6fc8e400eb01f7dd749935ea3     |
| target_project_id | 28b6e37c787240e4a975d3614821cc71     |
+-------------------+--------------------------------------+
[6] 内部ネットワークへのアクセス権を付与したプロジェクトに所属する任意のユーザーでログインし、 作成した内部ネットワークをインスタンスに紐付けてインスタンスを作成/起動します。
# 利用可能な [flavor] 確認

[cent@dlp ~(keystone)]$
openstack flavor list

+----+----------+------+------+-----------+-------+-----------+
| ID | Name     |  RAM | Disk | Ephemeral | VCPUs | Is Public |
+----+----------+------+------+-----------+-------+-----------+
| 0  | m1.small | 2048 |   10 |         0 |     1 | True      |
+----+----------+------+------+-----------+-------+-----------+

# 利用可能なイメージ確認

[cent@dlp ~(keystone)]$
openstack image list

+--------------------------------------+----------------+--------+
| ID                                   | Name           | Status |
+--------------------------------------+----------------+--------+
| 8367cc21-61f4-480b-8d03-90c057c7a7cf | CentOS-Stream9 | active |
+--------------------------------------+----------------+--------+

# 利用可能なネットワーク確認

[cent@dlp ~(keystone)]$
openstack network list

+--------------------------------------+---------+--------------------------------------+
| ID                                   | Name    | Subnets                              |
+--------------------------------------+---------+--------------------------------------+
| 004ca400-3d79-4c1b-b8fb-bba1e273000e | public  | 80213093-ac95-469a-b4d9-8c6adc93cfe1 |
| c9c79a1d-136e-4036-8fe0-eaac79f05f5d | private | 85e66c6a-66eb-490f-a4fa-e21f91678c89 |
+--------------------------------------+---------+--------------------------------------+

# インスタンス用のセキュリティグループを作成

[cent@dlp ~(keystone)]$
openstack security group create secgroup01

+-----------------+-------------------------------------------------------------------------------+
| Field           | Value                                                                         |
+-----------------+-------------------------------------------------------------------------------+
| created_at      | 2022-11-10T06:36:10Z                                                          |
| description     | secgroup01                                                                    |
| id              | 71c73ff4-0dda-4c2b-89ae-59096a53ecdd                                          |
| name            | secgroup01                                                                    |
| project_id      | 28b6e37c787240e4a975d3614821cc71                                              |
| revision_number | 1                                                                             |
| rules           | created_at='2022-11-10T06:36:10Z', direction='egress', ethertype='IPv6', i... |
|                 | created_at='2022-11-10T06:36:10Z', direction='egress', ethertype='IPv4', i... |
| stateful        | True                                                                          |
| tags            | []                                                                            |
| updated_at      | 2022-11-10T06:36:10Z                                                          |
+-----------------+-------------------------------------------------------------------------------+

# インスタンス接続用の SSH キーペア作成

[cent@dlp ~(keystone)]$
ssh-keygen -q -N ""

Enter file in which to save the key (/home/cent/.ssh/id_rsa):
# 公開鍵登録

[cent@dlp ~(keystone)]$
openstack keypair create --public-key ~/.ssh/id_rsa.pub mykey

+-------------+-------------------------------------------------+
| Field       | Value                                           |
+-------------+-------------------------------------------------+
| created_at  | None                                            |
| fingerprint | a1:2b:03:93:7b:5c:55:94:44:65:80:fe:e0:a7:b6:ba |
| id          | mykey                                           |
| is_deleted  | None                                            |
| name        | mykey                                           |
| type        | ssh                                             |
| user_id     | 9e8824a151c949ad9105535ead452501                |
+-------------+-------------------------------------------------+

[cent@dlp ~(keystone)]$
netID=$(openstack network list | grep private | awk '{ print $2 }')

[cent@dlp ~(keystone)]$
openstack server create --flavor m1.small --image CentOS-Stream9 --security-group secgroup01 --nic net-id=$netID --key-name mykey CentOS-St9
[cent@dlp ~(keystone)]$
openstack server list

+--------------------------------------+------------+--------+------------------------+----------------+----------+
| ID                                   | Name       | Status | Networks               | Image          | Flavor   |
+--------------------------------------+------------+--------+------------------------+----------------+----------+
| 158685ed-8159-4aad-a294-3227b427f7e1 | CentOS-St9 | ACTIVE | private=192.168.100.75 | CentOS-Stream9 | m1.small |
+--------------------------------------+------------+--------+------------------------+----------------+----------+
[7] 作成した仮想マシンインスタンスにフローティング IP を割り当てます。
[cent@dlp ~(keystone)]$
openstack floating ip create public

+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| created_at          | 2022-11-10T06:38:41Z                 |
| description         |                                      |
| dns_domain          |                                      |
| dns_name            |                                      |
| fixed_ip_address    | None                                 |
| floating_ip_address | 10.0.0.218                           |
| floating_network_id | 004ca400-3d79-4c1b-b8fb-bba1e273000e |
| id                  | dc4d6b9a-7285-402a-8b3f-1f52bfb7d271 |
| name                | 10.0.0.218                           |
| port_details        | None                                 |
| port_id             | None                                 |
| project_id          | 28b6e37c787240e4a975d3614821cc71     |
| qos_policy_id       | None                                 |
| revision_number     | 0                                    |
| router_id           | None                                 |
| status              | DOWN                                 |
| subnet_id           | None                                 |
| tags                | []                                   |
| updated_at          | 2022-11-10T06:38:41Z                 |
+---------------------+--------------------------------------+

[cent@dlp ~(keystone)]$
openstack server add floating ip CentOS-St9 10.0.0.218
# 設定確認

[cent@dlp ~(keystone)]$
openstack floating ip show 10.0.0.218

+---------------------+---------------------------------------------------------------------------+
| Field               | Value                                                                     |
+---------------------+---------------------------------------------------------------------------+
| created_at          | 2022-11-10T06:38:41Z                                                      |
| description         |                                                                           |
| dns_domain          |                                                                           |
| dns_name            |                                                                           |
| fixed_ip_address    | 192.168.100.75                                                            |
| floating_ip_address | 10.0.0.218                                                                |
| floating_network_id | 004ca400-3d79-4c1b-b8fb-bba1e273000e                                      |
| id                  | dc4d6b9a-7285-402a-8b3f-1f52bfb7d271                                      |
| name                | 10.0.0.218                                                                |
| port_details        | admin_state_up='True', device_id='158685ed-8159-4aad-a294-3227b427f7e1... |
| port_id             | e8f2a330-cb05-4903-a358-4ddfefd27ba6                                      |
| project_id          | 28b6e37c787240e4a975d3614821cc71                                          |
| qos_policy_id       | None                                                                      |
| revision_number     | 2                                                                         |
| router_id           | f903d9e2-e823-4b84-b61f-00d96a31d35f                                      |
| status              | ACTIVE                                                                    |
| subnet_id           | None                                                                      |
| tags                | []                                                                        |
| updated_at          | 2022-11-10T06:39:11Z                                                      |
+---------------------+---------------------------------------------------------------------------+

[cent@dlp ~(keystone)]$
openstack server list

+--------------------------------------+------------+--------+------------------------------------+----------------+----------+
| ID                                   | Name       | Status | Networks                           | Image          | Flavor   |
+--------------------------------------+------------+--------+------------------------------------+----------------+----------+
| 158685ed-8159-4aad-a294-3227b427f7e1 | CentOS-St9 | ACTIVE | private=10.0.0.218, 192.168.100.75 | CentOS-Stream9 | m1.small |
+--------------------------------------+------------+--------+------------------------------------+----------------+----------+
[8] 起動した仮想マシンインスタンスに SSH 接続できるように、先に作成したセキュリティグループにポート許可の設定を追加します。
# ICMP 許可

[cent@dlp ~(keystone)]$
openstack security group rule create --protocol icmp --ingress secgroup01

+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| created_at              | 2022-11-10T06:40:35Z                 |
| description             |                                      |
| direction               | ingress                              |
| ether_type              | IPv4                                 |
| id                      | 137c9cd5-3811-47aa-b509-75e5c99d5d32 |
| name                    | None                                 |
| port_range_max          | None                                 |
| port_range_min          | None                                 |
| project_id              | 28b6e37c787240e4a975d3614821cc71     |
| protocol                | icmp                                 |
| remote_address_group_id | None                                 |
| remote_group_id         | None                                 |
| remote_ip_prefix        | 0.0.0.0/0                            |
| revision_number         | 0                                    |
| security_group_id       | 71c73ff4-0dda-4c2b-89ae-59096a53ecdd |
| tags                    | []                                   |
| updated_at              | 2022-11-10T06:40:35Z                 |
+-------------------------+--------------------------------------+

# SSH 許可

[cent@dlp ~(keystone)]$
openstack security group rule create --protocol tcp --dst-port 22:22 secgroup01

+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| created_at              | 2022-11-10T06:40:57Z                 |
| description             |                                      |
| direction               | ingress                              |
| ether_type              | IPv4                                 |
| id                      | 3d7d2f52-23be-4c19-adfb-d59c27bb9dc9 |
| name                    | None                                 |
| port_range_max          | 22                                   |
| port_range_min          | 22                                   |
| project_id              | 28b6e37c787240e4a975d3614821cc71     |
| protocol                | tcp                                  |
| remote_address_group_id | None                                 |
| remote_group_id         | None                                 |
| remote_ip_prefix        | 0.0.0.0/0                            |
| revision_number         | 0                                    |
| security_group_id       | 71c73ff4-0dda-4c2b-89ae-59096a53ecdd |
| tags                    | []                                   |
| updated_at              | 2022-11-10T06:40:57Z                 |
+-------------------------+--------------------------------------+

[cent@dlp ~(keystone)]$
openstack security group rule list secgroup01

+--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+
| ID                                   | IP Protocol | Ethertype | IP Range  | Port Range | Direction | Remote Security Group | Remote Address Group |
+--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+
| 137c9cd5-3811-47aa-b509-75e5c99d5d32 | icmp        | IPv4      | 0.0.0.0/0 |            | ingress   | None                  | None                 |
| 3d7d2f52-23be-4c19-adfb-d59c27bb9dc9 | tcp         | IPv4      | 0.0.0.0/0 | 22:22      | ingress   | None                  | None                 |
| 66dd3e72-11bf-4081-b628-ed1f3bd15b08 | None        | IPv6      | ::/0      |            | egress    | None                  | None                 |
| 92ce5b78-7c05-41f7-b8a2-364b2786ef0e | None        | IPv4      | 0.0.0.0/0 |            | egress    | None                  | None                 |
+--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+
[9] 仮想マシンインスタンスに割りあてられたフローティング IP 宛てに SSH 接続することで、インスタンスに SSH ログインできます。
[cent@dlp ~(keystone)]$
openstack server list

+--------------------------------------+------------+--------+------------------------------------+----------------+----------+
| ID                                   | Name       | Status | Networks                           | Image          | Flavor   |
+--------------------------------------+------------+--------+------------------------------------+----------------+----------+
| 158685ed-8159-4aad-a294-3227b427f7e1 | CentOS-St9 | ACTIVE | private=10.0.0.218, 192.168.100.75 | CentOS-Stream9 | m1.small |
+--------------------------------------+------------+--------+------------------------------------+----------------+----------+

[cent@dlp ~(keystone)]$
ssh centos@10.0.0.218

The authenticity of host '10.0.0.218 (10.0.0.218)' can't be established.
ED25519 key fingerprint is SHA256:RtD2el4xoW20XopH62igQcxVluk2fFCuzQ5rb4c77Ec.
This key is not known by any other names
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added '10.0.0.218' (ED25519) to the list of known hosts.
[centos@centos-st9 ~]$     # ログインできた
関連コンテンツ