CentOS Stream 8
Sponsored Link

OpenStack Yoga : Neutron ネットワークを構成する (Geneve)2022/05/31

 
OpenStack Network Service(Neutron)による仮想ネットワークの構成です。
例として、Geneve カプセル化によるネットワークを構成します。
事前に以下のように Control ノードNetwork ノードCompute ノードの 各サービスノードを構築済みであることが前提です。
また、当例では Network ノードと Compute ノードが 2 つのネットワークインターフェースを持っているものとします。
------------+-----------------------------+-----------------------------+------------
            |                             |                             |
        eth0|10.0.0.30                eth0|10.0.0.50                eth0|10.0.0.51
+-----------+-----------+     +-----------+-----------+     +-----------+-----------+
|   [ dlp.srv.world ]   |     | [ network.srv.world ] |     |  [ node01.srv.world ] |
|     (Control Node)    |     |     (Network Node)    |     |     (Compute Node)    |
|                       |     |                       |     |                       |
|  MariaDB    RabbitMQ  |     |      Open vSwitch     |     |        Libvirt        |
|  Memcached  httpd     |     |     Neutron Server    |     |      Nova Compute     |
|  Keystone   Glance    |     |      OVN-Northd       |     |      Open vSwitch     |
|  Nova API             |     |                       |     |   OVN Metadata Agent  |
|                       |     |                       |     |     OVN-Controller    |
+-----------------------+     +-----------+-----------+     +-----------+-----------+
                                      eth1|(UP with no IP)          eth1|(UP with no IP)

[1] Network ノードと Compute ノードの両方でブリッジマッピングを設定しておきます。
# ブリッジ作成 (名称は任意)

[root@network ~]#
ovs-vsctl add-br br-eth1
# 追加したブリッジのポートに [eth1] を追加
# [eth1] は環境によって異なるため自身の環境に置き換え

[root@network ~]#
ovs-vsctl add-port br-eth1 eth1
# ブリッジと [physnet1] をマッピング ([physnet1] の名称は任意)

[root@network ~]#
ovs-vsctl set open . external-ids:ovn-bridge-mappings=physnet1:br-eth1

[2] 仮想ルーターを作成します。作業場所はどこでもよいですが、当例では Control ノード上で作業します。
[root@dlp ~(keystone)]#
openstack router create router01

+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| admin_state_up          | UP                                   |
| availability_zone_hints |                                      |
| availability_zones      |                                      |
| created_at              | 2022-05-31T13:35:40Z                 |
| description             |                                      |
| external_gateway_info   | null                                 |
| flavor_id               | None                                 |
| id                      | 5b1c174d-a712-4a01-8c99-ad3c6c2ebd00 |
| name                    | router01                             |
| project_id              | 0609d3b3b398456187fb705ec9224c4a     |
| revision_number         | 0                                    |
| routes                  |                                      |
| status                  | ACTIVE                               |
| tags                    |                                      |
| updated_at              | 2022-05-31T13:35:40Z                 |
+-------------------------+--------------------------------------+
[3] 内部用のネットワークを作成し、仮想ルーターに関連付けます。
# 内部用ネットワーク作成

[root@dlp ~(keystone)]#
openstack network create private --provider-network-type geneve

+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2022-05-31T13:36:07Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | 0f0af4c7-f2d1-4c13-b30c-4619ff33db0c |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| is_vlan_transparent       | None                                 |
| mtu                       | 1442                                 |
| name                      | private                              |
| port_security_enabled     | True                                 |
| project_id                | 0609d3b3b398456187fb705ec9224c4a     |
| provider:network_type     | geneve                               |
| provider:physical_network | None                                 |
| provider:segmentation_id  | 5891                                 |
| qos_policy_id             | None                                 |
| revision_number           | 1                                    |
| router:external           | Internal                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| tags                      |                                      |
| updated_at                | 2022-05-31T13:36:07Z                 |
+---------------------------+--------------------------------------+

# 内部用ネットワークにサブネット作成

[root@dlp ~(keystone)]#
openstack subnet create private-subnet --network private \
--subnet-range 192.168.100.0/24 --gateway 192.168.100.1 \
--dns-nameserver 10.0.0.10

+----------------------+--------------------------------------+
| Field                | Value                                |
+----------------------+--------------------------------------+
| allocation_pools     | 192.168.100.2-192.168.100.254        |
| cidr                 | 192.168.100.0/24                     |
| created_at           | 2022-05-31T13:36:47Z                 |
| description          |                                      |
| dns_nameservers      | 10.0.0.10                            |
| dns_publish_fixed_ip | None                                 |
| enable_dhcp          | True                                 |
| gateway_ip           | 192.168.100.1                        |
| host_routes          |                                      |
| id                   | 748c0a25-c6d8-48fd-829e-8b15783b7f8a |
| ip_version           | 4                                    |
| ipv6_address_mode    | None                                 |
| ipv6_ra_mode         | None                                 |
| name                 | private-subnet                       |
| network_id           | 0f0af4c7-f2d1-4c13-b30c-4619ff33db0c |
| project_id           | 0609d3b3b398456187fb705ec9224c4a     |
| revision_number      | 0                                    |
| segment_id           | None                                 |
| service_types        |                                      |
| subnetpool_id        | None                                 |
| tags                 |                                      |
| updated_at           | 2022-05-31T13:36:47Z                 |
+----------------------+--------------------------------------+

# 仮想ルーターに内部ネットワークを設定

[root@dlp ~(keystone)]#
openstack router add subnet router01 private-subnet
[4] 外部接続用のネットワークを作成し、仮想ルーターに関連付けます。
# 外部用ネットワーク作成

[root@dlp ~(keystone)]#
openstack network create \
--provider-physical-network physnet1 \
--provider-network-type flat --external public

+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2022-05-31T13:37:35Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | 0c96d581-95f3-4e72-9626-d0a94407d0ec |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| is_vlan_transparent       | None                                 |
| mtu                       | 1500                                 |
| name                      | public                               |
| port_security_enabled     | True                                 |
| project_id                | 0609d3b3b398456187fb705ec9224c4a     |
| provider:network_type     | flat                                 |
| provider:physical_network | physnet1                             |
| provider:segmentation_id  | None                                 |
| qos_policy_id             | None                                 |
| revision_number           | 1                                    |
| router:external           | External                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| tags                      |                                      |
| updated_at                | 2022-05-31T13:37:36Z                 |
+---------------------------+--------------------------------------+

# 外部用ネットワークにサブネット作成

[root@dlp ~(keystone)]#
openstack subnet create public-subnet \
--network public --subnet-range 10.0.0.0/24 \
--allocation-pool start=10.0.0.200,end=10.0.0.254 \
--gateway 10.0.0.1 --dns-nameserver 10.0.0.10 --no-dhcp

+----------------------+--------------------------------------+
| Field                | Value                                |
+----------------------+--------------------------------------+
| allocation_pools     | 10.0.0.200-10.0.0.254                |
| cidr                 | 10.0.0.0/24                          |
| created_at           | 2022-05-31T13:38:10Z                 |
| description          |                                      |
| dns_nameservers      | 10.0.0.10                            |
| dns_publish_fixed_ip | None                                 |
| enable_dhcp          | False                                |
| gateway_ip           | 10.0.0.1                             |
| host_routes          |                                      |
| id                   | e20328ce-a24a-4804-be39-88f18800526f |
| ip_version           | 4                                    |
| ipv6_address_mode    | None                                 |
| ipv6_ra_mode         | None                                 |
| name                 | public-subnet                        |
| network_id           | 0c96d581-95f3-4e72-9626-d0a94407d0ec |
| project_id           | 0609d3b3b398456187fb705ec9224c4a     |
| revision_number      | 0                                    |
| segment_id           | None                                 |
| service_types        |                                      |
| subnetpool_id        | None                                 |
| tags                 |                                      |
| updated_at           | 2022-05-31T13:38:10Z                 |
+----------------------+--------------------------------------+

# 仮想ルーターにゲートウェイを設定

[root@dlp ~(keystone)]#
openstack router set router01 --external-gateway public

[5] 作成したネットワークは、外部用はデフォルトで全プロジェクトがアクセス可能ですが、内部用はデフォルトでは [admin] プロジェクトのみがアクセス可能なため、内部ネットワークを利用させたいプロジェクトにアクセス権限を付与しておきます。
# ネットワーク RBAC リスト表示

[root@dlp ~(keystone)]#
openstack network rbac list

+--------------------------------------+-------------+--------------------------------------+
| ID                                   | Object Type | Object ID                            |
+--------------------------------------+-------------+--------------------------------------+
| f31f2808-ae3d-4716-a2d2-693e5e581dbb | network     | 0c96d581-95f3-4e72-9626-d0a94407d0ec |
+--------------------------------------+-------------+--------------------------------------+

# RBAC の詳細
# [access_as_external] のみ全プロジェクトがアクセス可能な状態

[root@dlp ~(keystone)]#
openstack network rbac show f31f2808-ae3d-4716-a2d2-693e5e581dbb

+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| action            | access_as_external                   |
| id                | f31f2808-ae3d-4716-a2d2-693e5e581dbb |
| name              | None                                 |
| object_id         | 0c96d581-95f3-4e72-9626-d0a94407d0ec |
| object_type       | network                              |
| project_id        | 0609d3b3b398456187fb705ec9224c4a     |
| target_project_id | *                                    |
+-------------------+--------------------------------------+

# 作成済みネットワーク一覧

[root@dlp ~(keystone)]#
openstack network list

+--------------------------------------+---------+--------------------------------------+
| ID                                   | Name    | Subnets                              |
+--------------------------------------+---------+--------------------------------------+
| 0c96d581-95f3-4e72-9626-d0a94407d0ec | public  | e20328ce-a24a-4804-be39-88f18800526f |
| 0f0af4c7-f2d1-4c13-b30c-4619ff33db0c | private | 748c0a25-c6d8-48fd-829e-8b15783b7f8a |
+--------------------------------------+---------+--------------------------------------+

# 作成済みプロジェクト一覧

[root@dlp ~(keystone)]#
openstack project list

+----------------------------------+-----------+
| ID                               | Name      |
+----------------------------------+-----------+
| 0609d3b3b398456187fb705ec9224c4a | admin     |
| 3d85d1e79d654b3dade01eb5bfbf0679 | hiroshima |
| 8787527217494c6a87dd5a3b68dce1ef | service   |
+----------------------------------+-----------+

# [private] への [access_as_shared] アクセス権を [hiroshima] プロジェクトに付与

[root@dlp ~(keystone)]#
netID=$(openstack network list | grep private | awk '{ print $2 }')

[root@dlp ~(keystone)]#
prjID=$(openstack project list | grep hiroshima | awk '{ print $2 }')

[root@dlp ~(keystone)]#
openstack network rbac create --target-project $prjID --type network --action access_as_shared $netID

+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| action            | access_as_shared                     |
| id                | a869be9d-3a2b-4abd-bea5-cc6cc094763f |
| name              | None                                 |
| object_id         | 0f0af4c7-f2d1-4c13-b30c-4619ff33db0c |
| object_type       | network                              |
| project_id        | 0609d3b3b398456187fb705ec9224c4a     |
| target_project_id | 3d85d1e79d654b3dade01eb5bfbf0679     |
+-------------------+--------------------------------------+
[6] 内部ネットワークへのアクセス権を付与したプロジェクトに所属する任意のユーザーでログインし、 作成した内部ネットワークをインスタンスに紐付けてインスタンスを作成/起動します。
# 利用可能な [flavor] 確認

[cent@dlp ~(keystone)]$
openstack flavor list

+----+----------+------+------+-----------+-------+-----------+
| ID | Name     |  RAM | Disk | Ephemeral | VCPUs | Is Public |
+----+----------+------+------+-----------+-------+-----------+
| 0  | m1.small | 2048 |   10 |         0 |     1 | True      |
+----+----------+------+------+-----------+-------+-----------+

# 利用可能なイメージ確認

[cent@dlp ~(keystone)]$
openstack image list

+--------------------------------------+-----------------+--------+
| ID                                   | Name            | Status |
+--------------------------------------+-----------------+--------+
| 7be5b7ab-36e8-43c7-95dd-34b4139a0e44 | CentOS-Stream-8 | active |
+--------------------------------------+-----------------+--------+

# 利用可能なネットワーク確認

[cent@dlp ~(keystone)]$
openstack network list

+--------------------------------------+---------+--------------------------------------+
| ID                                   | Name    | Subnets                              |
+--------------------------------------+---------+--------------------------------------+
| 0c96d581-95f3-4e72-9626-d0a94407d0ec | public  | e20328ce-a24a-4804-be39-88f18800526f |
| 0f0af4c7-f2d1-4c13-b30c-4619ff33db0c | private | 748c0a25-c6d8-48fd-829e-8b15783b7f8a |
+--------------------------------------+---------+--------------------------------------+

# インスタンス用のセキュリティグループを作成

[cent@dlp ~(keystone)]$
openstack security group create secgroup01

+-----------------+------------------------------------------------------------------------------+
| Field           | Value                                                                        |
+-----------------+------------------------------------------------------------------------------+
| created_at      | 2022-05-31T13:44:33Z                                                         |
| description     | secgroup01                                                                   |
| id              | 78a872a1-e325-4a8d-b9a2-1ef6661a354c                                         |
| name            | secgroup01                                                                   |
| project_id      | 3d85d1e79d654b3dade01eb5bfbf0679                                             |
| revision_number | 1                                                                            |
| rules           | created_at='2022-05-31T13:44:33Z', direction='egress', ethertype='IPv4'..... |
|                 | created_at='2022-05-31T13:44:33Z', direction='egress', ethertype='IPv6'..... |
| stateful        | True                                                                         |
| tags            | []                                                                           |
| updated_at      | 2022-05-31T13:44:33Z                                                         |
+-----------------+------------------------------------------------------------------------------+

# インスタンス接続用の SSH キーペア作成

[cent@dlp ~(keystone)]$
ssh-keygen -q -N ""

Enter file in which to save the key (/home/cent/.ssh/id_rsa):
# 公開鍵登録

[cent@dlp ~(keystone)]$
openstack keypair create --public-key ~/.ssh/id_rsa.pub mykey

+-------------+-------------------------------------------------+
| Field       | Value                                           |
+-------------+-------------------------------------------------+
| created_at  | None                                            |
| fingerprint | c4:14:39:58:5c:2e:4f:ed:a8:07:14:d4:3a:f1:e6:dc |
| id          | mykey                                           |
| is_deleted  | None                                            |
| name        | mykey                                           |
| type        | ssh                                             |
| user_id     | ed0bc393ae81411fa1db0828e1d5e160                |
+-------------+-------------------------------------------------+

[cent@dlp ~(keystone)]$
netID=$(openstack network list | grep private | awk '{ print $2 }')

[cent@dlp ~(keystone)]$
openstack server create --flavor m1.small --image CentOS-Stream-8 --security-group secgroup01 --nic net-id=$netID --key-name mykey CentOS-St8
[cent@dlp ~(keystone)]$
openstack server list

+--------------------------------------+------------+--------+-------------------------+-----------------+----------+
| ID                                   | Name       | Status | Networks                | Image           | Flavor   |
+--------------------------------------+------------+--------+-------------------------+-----------------+----------+
| fa3a20c0-f0f4-46eb-b63f-69abba312d03 | CentOS-St8 | ACTIVE | private=192.168.100.140 | CentOS-Stream-8 | m1.small |
+--------------------------------------+------------+--------+-------------------------+-----------------+----------+
[7] 作成した仮想マシンインスタンスにフローティング IP を割り当てます。
[cent@dlp ~(keystone)]$
openstack floating ip create public

+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| created_at          | 2022-05-31T13:47:27Z                 |
| description         |                                      |
| dns_domain          |                                      |
| dns_name            |                                      |
| fixed_ip_address    | None                                 |
| floating_ip_address | 10.0.0.251                           |
| floating_network_id | 0c96d581-95f3-4e72-9626-d0a94407d0ec |
| id                  | f6e72615-343b-4aff-a433-d6409feb478d |
| name                | 10.0.0.251                           |
| port_details        | None                                 |
| port_id             | None                                 |
| project_id          | 3d85d1e79d654b3dade01eb5bfbf0679     |
| qos_policy_id       | None                                 |
| revision_number     | 0                                    |
| router_id           | None                                 |
| status              | DOWN                                 |
| subnet_id           | None                                 |
| tags                | []                                   |
| updated_at          | 2022-05-31T13:47:27Z                 |
+---------------------+--------------------------------------+

[cent@dlp ~(keystone)]$
openstack server add floating ip CentOS-St8 10.0.0.251
# 設定確認

[cent@dlp ~(keystone)]$
openstack floating ip show 10.0.0.251

+---------------------+--------------------------------------------------------------------------+
| Field               | Value                                                                    |
+---------------------+--------------------------------------------------------------------------+
| created_at          | 2022-05-31T13:47:27Z                                                     |
| description         |                                                                          |
| dns_domain          |                                                                          |
| dns_name            |                                                                          |
| fixed_ip_address    | 192.168.100.140                                                          |
| floating_ip_address | 10.0.0.251                                                               |
| floating_network_id | 0c96d581-95f3-4e72-9626-d0a94407d0ec                                     |
| id                  | f6e72615-343b-4aff-a433-d6409feb478d                                     |
| name                | 10.0.0.251                                                               |
| port_details        | admin_state_up='True', device_id='fa3a20c0-f0f4-46eb-b63f-69abba312..... |
| port_id             | a067b36e-587d-4393-9bba-a3cfe792acff                                     |
| project_id          | 3d85d1e79d654b3dade01eb5bfbf0679                                         |
| qos_policy_id       | None                                                                     |
| revision_number     | 2                                                                        |
| router_id           | 5b1c174d-a712-4a01-8c99-ad3c6c2ebd00                                     |
| status              | ACTIVE                                                                   |
| subnet_id           | None                                                                     |
| tags                | []                                                                       |
| updated_at          | 2022-05-31T13:47:59Z                                                     |
+---------------------+--------------------------------------------------------------------------+

[cent@dlp ~(keystone)]$
openstack server list

+--------------------------------------+------------+--------+-------------------------------------+-----------------+----------+
| ID                                   | Name       | Status | Networks                            | Image           | Flavor   |
+--------------------------------------+------------+--------+-------------------------------------+-----------------+----------+
| fa3a20c0-f0f4-46eb-b63f-69abba312d03 | CentOS-St8 | ACTIVE | private=10.0.0.251, 192.168.100.140 | CentOS-Stream-8 | m1.small |
+--------------------------------------+------------+--------+-------------------------------------+-----------------+----------+
[8] 起動した仮想マシンインスタンスに SSH 接続できるように、先に作成したセキュリティグループにポート許可の設定を追加します。
# ICMP 許可

[cent@dlp ~(keystone)]$
openstack security group rule create --protocol icmp --ingress secgroup01

+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| created_at              | 2022-05-31T13:49:16Z                 |
| description             |                                      |
| direction               | ingress                              |
| ether_type              | IPv4                                 |
| id                      | 7563a489-c02c-4345-8a12-05e3933f1ff6 |
| name                    | None                                 |
| port_range_max          | None                                 |
| port_range_min          | None                                 |
| project_id              | 3d85d1e79d654b3dade01eb5bfbf0679     |
| protocol                | icmp                                 |
| remote_address_group_id | None                                 |
| remote_group_id         | None                                 |
| remote_ip_prefix        | 0.0.0.0/0                            |
| revision_number         | 0                                    |
| security_group_id       | 78a872a1-e325-4a8d-b9a2-1ef6661a354c |
| tags                    | []                                   |
| tenant_id               | 3d85d1e79d654b3dade01eb5bfbf0679     |
| updated_at              | 2022-05-31T13:49:16Z                 |
+-------------------------+--------------------------------------+

# SSH 許可

[cent@dlp ~(keystone)]$
openstack security group rule create --protocol tcp --dst-port 22:22 secgroup01

+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| created_at              | 2022-05-31T13:49:39Z                 |
| description             |                                      |
| direction               | ingress                              |
| ether_type              | IPv4                                 |
| id                      | 72624fd0-33d1-459f-bedd-8c3d458cb17f |
| name                    | None                                 |
| port_range_max          | 22                                   |
| port_range_min          | 22                                   |
| project_id              | 3d85d1e79d654b3dade01eb5bfbf0679     |
| protocol                | tcp                                  |
| remote_address_group_id | None                                 |
| remote_group_id         | None                                 |
| remote_ip_prefix        | 0.0.0.0/0                            |
| revision_number         | 0                                    |
| security_group_id       | 78a872a1-e325-4a8d-b9a2-1ef6661a354c |
| tags                    | []                                   |
| tenant_id               | 3d85d1e79d654b3dade01eb5bfbf0679     |
| updated_at              | 2022-05-31T13:49:39Z                 |
+-------------------------+--------------------------------------+

[cent@dlp ~(keystone)]$
openstack security group rule list secgroup01

+--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+
| ID                                   | IP Protocol | Ethertype | IP Range  | Port Range | Direction | Remote Security Group | Remote Address Group |
+--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+
| 45ce1597-8b9b-48c7-9816-25705af47281 | None        | IPv4      | 0.0.0.0/0 |            | egress    | None                  | None                 |
| 72624fd0-33d1-459f-bedd-8c3d458cb17f | tcp         | IPv4      | 0.0.0.0/0 | 22:22      | ingress   | None                  | None                 |
| 7563a489-c02c-4345-8a12-05e3933f1ff6 | icmp        | IPv4      | 0.0.0.0/0 |            | ingress   | None                  | None                 |
| f210397e-d184-4412-965f-a60d1b7331ed | None        | IPv6      | ::/0      |            | egress    | None                  | None                 |
+--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+
[9] 仮想マシンインスタンスに割りあてられたフローティング IP 宛てに SSH 接続することで、インスタンスに SSH ログインできます。
[cent@dlp ~(keystone)]$
openstack server list

+--------------------------------------+------------+--------+-------------------------------------+-----------------+----------+
| ID                                   | Name       | Status | Networks                            | Image           | Flavor   |
+--------------------------------------+------------+--------+-------------------------------------+-----------------+----------+
| fa3a20c0-f0f4-46eb-b63f-69abba312d03 | CentOS-St8 | ACTIVE | private=10.0.0.251, 192.168.100.140 | CentOS-Stream-8 | m1.small |
+--------------------------------------+------------+--------+-------------------------------------+-----------------+----------+

[cent@dlp ~(keystone)]$
ssh centos@10.0.0.251

The authenticity of host '10.0.0.251 (10.0.0.251)' can't be established.
ECDSA key fingerprint is SHA256:nW8sHRlBHMR6VZoTlXqMMIHcvAiFDyDa1nHAQDcLzRQ.
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added '10.0.0.251' (ECDSA) to the list of known hosts.
Activate the web console with: systemctl enable --now cockpit.socket

[centos@centos-st8 ~]$     # ログインできた
関連コンテンツ