OpenStack Epoxy : Neutron Network (VXLAN)2025/05/22 |
|
Configure virtual networking by OpenStack Network Service (Neutron).
For example, configure VXLAN type of networking on here. Furthermore, this example is based on the environment that Network Node has 2 network interfaces.
------------+--------------------------+--------------------------+------------
| | |
eth0|10.0.0.30 eth0|10.0.0.50 eth0|10.0.0.51
+-----------+-----------+ +-----------+-----------+ +-----------+-----------+
| [ dlp.srv.world ] | | [ network.srv.world ] | | [ node01.srv.world ] |
| (Control Node) | | (Network Node) | | (Compute Node) |
| | | | | |
| MariaDB RabbitMQ | | Neutron L2/L3 Agent | | Libvirt |
| Memcached Nginx | | Neutron Metadata | | Nova Compute |
| Keystone httpd | | Open vSwitch | | Neutron L2 Agent |
| Glance Nova API | | | | Open vSwitch |
| Neutron Server | | | | |
| Neutron Metadata | | | | |
+-----------------------+ +-----------+-----------+ +-----------------------+
eth1|(UP with no IP)
|
| [1] | Change settings on Control Node. |
|
[root@dlp ~(keystone)]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # add a value to [tenant_network_types] [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan
# add to last line [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000 systemctl restart neutron-server |
| [2] | Change settings on Network Node. |
|
# add bridge [root@network ~]# ovs-vsctl add-br br-eth1
# add [eth1] to the port of the bridge above # replace the interface name [eth1] to your own environment [root@network ~]# ovs-vsctl add-port br-eth1 eth1
[root@network ~]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # add a value to [tenant_network_types] [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan mechanism_drivers = openvswitch extension_drivers = port_security,qos # add to last line [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000
[root@network ~]#
vi /etc/neutron/plugins/ml2/openvswitch_agent.ini # add to last line
[agent]
tunnel_types = vxlan
prevent_arp_spoofing = True
[ovs]
# specify IP address of this host for [local_ip]
local_ip = 10.0.0.50
bridge_mappings = physnet1:br-eth1
[root@network ~]#
systemctl restart neutron-dhcp-agent neutron-l3-agent neutron-metadata-agent neutron-openvswitch-agent
# if Firewalld is running, allow VXLAN port [root@network ~]# firewall-cmd --add-port=4789/udp [root@network ~]# firewall-cmd --runtime-to-permanent |
| [3] | Change settings on Compute Node. |
|
[root@node01 ~]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # add a value to [tenant_network_types] [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan mechanism_drivers = openvswitch extension_drivers = port_security,qos # add to last line [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000
[root@node01 ~]#
vi /etc/neutron/plugins/ml2/openvswitch_agent.ini # add to last line
[agent]
tunnel_types = vxlan
prevent_arp_spoofing = True
[ovs]
# specify IP address of this host for [local_ip]
local_ip = 10.0.0.51
[root@node01 ~]#
systemctl restart neutron-openvswitch-agent
# if Firewalld is running, allow VXLAN port [root@node01 ~]# firewall-cmd --add-port=4789/udp [root@node01 ~]# firewall-cmd --runtime-to-permanent |
| [4] | Create a Virtual router. It's OK to work on any node. (This example is on Control Node) |
|
[root@dlp ~(keystone)]# openstack router create router01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2025-05-22T01:38:38Z | | description | | | distributed | False | | enable_ndp_proxy | None | | external_gateway_info | null | | flavor_id | None | | ha | False | | id | ddbaabcc-a6b0-419f-bffb-4baea93f2a0a | | name | router01 | | project_id | 8f6f2ea0aec84c6f919d15236063d7c0 | | revision_number | 1 | | routes | | | status | ACTIVE | | tags | | | tenant_id | 8f6f2ea0aec84c6f919d15236063d7c0 | | updated_at | 2025-05-22T01:38:38Z | +-------------------------+--------------------------------------+ |
| [5] | Create internal network and associate with the router above. |
|
# create internal network [root@dlp ~(keystone)]# openstack network create private --provider-network-type vxlan +---------------------------+--------------------------------------+ | Field | Value | +---------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2025-05-22T01:39:03Z | | description | | | dns_domain | None | | id | 9c241043-0551-4164-85b0-2abb4147e281 | | ipv4_address_scope | None | | ipv6_address_scope | None | | is_default | None | | is_vlan_qinq | None | | is_vlan_transparent | None | | mtu | 1450 | | name | private | | port_security_enabled | True | | project_id | 8f6f2ea0aec84c6f919d15236063d7c0 | | provider:network_type | vxlan | | provider:physical_network | None | | provider:segmentation_id | 458 | | qos_policy_id | None | | revision_number | 1 | | router:external | Internal | | segments | None | | shared | False | | status | ACTIVE | | subnets | | | tags | | | updated_at | 2025-05-22T01:39:03Z | +---------------------------+--------------------------------------+ # create subnet in the internal network [root@dlp ~(keystone)]# openstack subnet create private-subnet --network private \ --subnet-range 192.168.100.0/24 --gateway 192.168.100.1 \ --dns-nameserver 10.0.0.10 +----------------------+--------------------------------------+ | Field | Value | +----------------------+--------------------------------------+ | allocation_pools | 192.168.100.2-192.168.100.254 | | cidr | 192.168.100.0/24 | | created_at | 2025-05-22T01:39:29Z | | description | | | dns_nameservers | 10.0.0.10 | | dns_publish_fixed_ip | None | | enable_dhcp | True | | gateway_ip | 192.168.100.1 | | host_routes | | | id | b2306c3d-ffac-49a3-b288-b0cb82585258 | | ip_version | 4 | | ipv6_address_mode | None | | ipv6_ra_mode | None | | name | private-subnet | | network_id | 9c241043-0551-4164-85b0-2abb4147e281 | | project_id | 8f6f2ea0aec84c6f919d15236063d7c0 | | revision_number | 0 | | router:external | False | | segment_id | None | | service_types | | | subnetpool_id | None | | tags | | | updated_at | 2025-05-22T01:39:29Z | +----------------------+--------------------------------------+ # set internal network to the router above [root@dlp ~(keystone)]# openstack router add subnet router01 private-subnet
|
| [6] | Create external network and associate with the router above. |
|
# create external network [root@dlp ~(keystone)]# openstack network create \ --provider-physical-network physnet1 \ --provider-network-type flat --external public +---------------------------+--------------------------------------+ | Field | Value | +---------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2025-05-22T01:39:57Z | | description | | | dns_domain | None | | id | 9aa11acd-b6d0-42d4-9478-b3d722827efb | | ipv4_address_scope | None | | ipv6_address_scope | None | | is_default | False | | is_vlan_qinq | None | | is_vlan_transparent | None | | mtu | 1500 | | name | public | | port_security_enabled | True | | project_id | 8f6f2ea0aec84c6f919d15236063d7c0 | | provider:network_type | flat | | provider:physical_network | physnet1 | | provider:segmentation_id | None | | qos_policy_id | None | | revision_number | 1 | | router:external | External | | segments | None | | shared | False | | status | ACTIVE | | subnets | | | tags | | | updated_at | 2025-05-22T01:39:57Z | +---------------------------+--------------------------------------+ # create subnet in the external network [root@dlp ~(keystone)]# openstack subnet create public-subnet \ --network public --subnet-range 10.0.0.0/24 \ --allocation-pool start=10.0.0.200,end=10.0.0.254 \ --gateway 10.0.0.1 --dns-nameserver 10.0.0.10 --no-dhcp +----------------------+--------------------------------------+ | Field | Value | +----------------------+--------------------------------------+ | allocation_pools | 10.0.0.200-10.0.0.254 | | cidr | 10.0.0.0/24 | | created_at | 2025-05-22T01:40:21Z | | description | | | dns_nameservers | 10.0.0.10 | | dns_publish_fixed_ip | None | | enable_dhcp | False | | gateway_ip | 10.0.0.1 | | host_routes | | | id | c711a742-a432-45a3-99c9-f59eb07c9522 | | ip_version | 4 | | ipv6_address_mode | None | | ipv6_ra_mode | None | | name | public-subnet | | network_id | 9aa11acd-b6d0-42d4-9478-b3d722827efb | | project_id | 8f6f2ea0aec84c6f919d15236063d7c0 | | revision_number | 0 | | router:external | True | | segment_id | None | | service_types | | | subnetpool_id | None | | tags | | | updated_at | 2025-05-22T01:40:21Z | +----------------------+--------------------------------------+ # set gateway to the router above [root@dlp ~(keystone)]# openstack router set router01 --external-gateway public |
| [7] | By default, it's possible to access for all projects to external network, however, for internal network, only admin projects can access to it, so grant access permission of internal network to a project you'd like to let users in the project use. |
|
# show network RBAC list [root@dlp ~(keystone)]# openstack network rbac list +--------------------------------------+-------------+--------------------------------------+ | ID | Object Type | Object ID | +--------------------------------------+-------------+--------------------------------------+ | cb384ed8-f76a-4261-bfd4-7d6daf472f23 | network | 9aa11acd-b6d0-42d4-9478-b3d722827efb | +--------------------------------------+-------------+--------------------------------------+ # RBAC details # all projects can access only to [access_as_external] [root@dlp ~(keystone)]# openstack network rbac show cb384ed8-f76a-4261-bfd4-7d6daf472f23 +-------------------+--------------------------------------+ | Field | Value | +-------------------+--------------------------------------+ | action | access_as_external | | id | cb384ed8-f76a-4261-bfd4-7d6daf472f23 | | object_id | 9aa11acd-b6d0-42d4-9478-b3d722827efb | | object_type | network | | project_id | 8f6f2ea0aec84c6f919d15236063d7c0 | | target_project_id | * | +-------------------+--------------------------------------+ # show network list [root@dlp ~(keystone)]# openstack network list +--------------------------------------+---------+--------------------------------------+ | ID | Name | Subnets | +--------------------------------------+---------+--------------------------------------+ | 9aa11acd-b6d0-42d4-9478-b3d722827efb | public | c711a742-a432-45a3-99c9-f59eb07c9522 | | 9c241043-0551-4164-85b0-2abb4147e281 | private | b2306c3d-ffac-49a3-b288-b0cb82585258 | +--------------------------------------+---------+--------------------------------------+ # show project list [root@dlp ~(keystone)]# openstack project list +----------------------------------+-----------+ | ID | Name | +----------------------------------+-----------+ | 03262019a5e54890be53c2fc96ed98d0 | service | | 6cd379304e2447da8514a66bb6cdfda5 | hiroshima | | 8f6f2ea0aec84c6f919d15236063d7c0 | admin | +----------------------------------+-----------+ # grant [access_as_shared] permission for [private] to [hiroshima] project [root@dlp ~(keystone)]# netID=$(openstack network list | grep private | awk '{ print $2 }') [root@dlp ~(keystone)]# prjID=$(openstack project list | grep hiroshima | awk '{ print $2 }') [root@dlp ~(keystone)]# openstack network rbac create --target-project $prjID --type network --action access_as_shared $netID +-------------------+--------------------------------------+ | Field | Value | +-------------------+--------------------------------------+ | action | access_as_shared | | id | c4bae13a-c189-4c0d-97c9-a850dedd3476 | | object_id | 9c241043-0551-4164-85b0-2abb4147e281 | | object_type | network | | project_id | 8f6f2ea0aec84c6f919d15236063d7c0 | | target_project_id | 6cd379304e2447da8514a66bb6cdfda5 | +-------------------+--------------------------------------+ |
| [8] | Login as a user who can use Openstack system and Create and start a Virtual machine Instance with the network created above. |
|
# show available [flavor] list [cent@dlp ~(keystone)]$ openstack flavor list +----+-----------+-------+------+-----------+-------+-----------+ | ID | Name | RAM | Disk | Ephemeral | VCPUs | Is Public | +----+-----------+-------+------+-----------+-------+-----------+ | 1 | m1.tiny | 2048 | 10 | 0 | 1 | True | | 2 | m1.small | 4096 | 10 | 0 | 2 | True | | 3 | m1.medium | 8192 | 10 | 0 | 4 | True | | 4 | m1.large | 16384 | 10 | 0 | 8 | True | | 5 | m2.large | 16384 | 10 | 10 | 8 | True | +----+-----------+-------+------+-----------+-------+-----------+ # show available image list [cent@dlp ~(keystone)]$ openstack image list +--------------------------------------+----------------+--------+ | ID | Name | Status | +--------------------------------------+----------------+--------+ | 8bbf2495-d1b0-4c12-89d3-bf6ca71b2a2d | CentOS-Stream9 | active | +--------------------------------------+----------------+--------+ # show available network list [cent@dlp ~(keystone)]$ openstack network list +--------------------------------------+---------+--------------------------------------+ | ID | Name | Subnets | +--------------------------------------+---------+--------------------------------------+ | 9aa11acd-b6d0-42d4-9478-b3d722827efb | public | c711a742-a432-45a3-99c9-f59eb07c9522 | | 9c241043-0551-4164-85b0-2abb4147e281 | private | b2306c3d-ffac-49a3-b288-b0cb82585258 | +--------------------------------------+---------+--------------------------------------+ # create a security group for instances [cent@dlp ~(keystone)]$ openstack security group create secgroup01 +-----------------+----------------------------------------------------------------------------+ | Field | Value | +-----------------+----------------------------------------------------------------------------+ | created_at | 2025-05-22T01:28:43Z | | description | secgroup01 | | id | 9d815817-44f8-414a-b02e-d314e481bdaa | | name | secgroup01 | | project_id | 6cd379304e2447da8514a66bb6cdfda5 | | revision_number | 1 | | rules | created_at='2025-05-22T01:28:43Z', direction='egress', ethertype='IPv4'... | | | created_at='2025-05-22T01:28:43Z', direction='egress', ethertype='IPv6'... | | shared | False | | stateful | True | | tags | [] | | updated_at | 2025-05-22T01:28:43Z | +-----------------+----------------------------------------------------------------------------+ # create an SSH keypair for connecting to instances [cent@dlp ~(keystone)]$ ssh-keygen -q -N "" Enter file in which to save the key (/home/cent/.ssh/id_rsa): # add public-key [cent@dlp ~(keystone)]$ openstack keypair create --public-key ~/.ssh/id_rsa.pub mykey +-------------+-------------------------------------------------+ | Field | Value | +-------------+-------------------------------------------------+ | created_at | None | | fingerprint | 35:95:78:3a:58:27:a7:93:4f:14:52:41:07:97:af:cc | | id | mykey | | is_deleted | None | | name | mykey | | type | ssh | | user_id | b6e98dc2822541dd8c4571ac4ed54778 | +-------------+-------------------------------------------------+[cent@dlp ~(keystone)]$ netID=$(openstack network list | grep private | awk '{ print $2 }')
[cent@dlp ~(keystone)]$
[cent@dlp ~(keystone)]$ openstack server create --flavor m1.small --image CentOS-Stream9 --security-group secgroup01 --nic net-id=$netID --key-name mykey CentOS-9
openstack server list +--------------------------------------+----------+--------+-------------------------+----------------+----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+----------+--------+-------------------------+----------------+----------+ | c893d245-0cf0-4672-be6c-d073746d6851 | CentOS-9 | ACTIVE | private=192.168.100.139 | CentOS-Stream9 | m1.small | +--------------------------------------+----------+--------+-------------------------+----------------+----------+ |
| [9] | Assign floating IP address to the Instance above. |
|
[cent@dlp ~(keystone)]$ openstack floating ip create public +---------------------+--------------------------------------+ | Field | Value | +---------------------+--------------------------------------+ | created_at | 2025-05-22T01:45:58Z | | description | | | dns_domain | None | | dns_name | None | | fixed_ip_address | None | | floating_ip_address | 10.0.0.225 | | floating_network_id | 9aa11acd-b6d0-42d4-9478-b3d722827efb | | id | 3055b150-fdbd-4ffe-be6d-eb7ff62ea7bd | | name | 10.0.0.225 | | port_details | None | | port_id | None | | project_id | 6cd379304e2447da8514a66bb6cdfda5 | | qos_policy_id | None | | revision_number | 0 | | router_id | None | | status | DOWN | | subnet_id | None | | tags | [] | | updated_at | 2025-05-22T01:45:58Z | +---------------------+--------------------------------------+
[cent@dlp ~(keystone)]$
openstack server add floating ip CentOS-9 10.0.0.225
# confirm settings [cent@dlp ~(keystone)]$ openstack floating ip show 10.0.0.225 +---------------------+--------------------------------------------------------------------------+ | Field | Value | +---------------------+--------------------------------------------------------------------------+ | created_at | 2025-05-22T01:45:58Z | | description | | | dns_domain | None | | dns_name | None | | fixed_ip_address | 192.168.100.139 | | floating_ip_address | 10.0.0.225 | | floating_network_id | 9aa11acd-b6d0-42d4-9478-b3d722827efb | | id | 3055b150-fdbd-4ffe-be6d-eb7ff62ea7bd | | name | 10.0.0.225 | | port_details | admin_state_up='True', device_id='c893d245-0cf0-4672-be6c-d073746d685... | | port_id | 993d5435-5c87-4f75-91dc-65edab6ff5a3 | | project_id | 6cd379304e2447da8514a66bb6cdfda5 | | qos_policy_id | None | | revision_number | 2 | | router_id | ddbaabcc-a6b0-419f-bffb-4baea93f2a0a | | status | ACTIVE | | subnet_id | None | | tags | [] | | updated_at | 2025-05-22T01:46:33Z | +---------------------+--------------------------------------------------------------------------+[cent@dlp ~(keystone)]$ openstack server list +--------------------------------------+----------+--------+-------------------------------------+----------------+----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+----------+--------+-------------------------------------+----------------+----------+ | c893d245-0cf0-4672-be6c-d073746d6851 | CentOS-9 | ACTIVE | private=10.0.0.225, 192.168.100.139 | CentOS-Stream9 | m1.small | +--------------------------------------+----------+--------+-------------------------------------+----------------+----------+ |
| [10] | Configure security settings for the security group you created above to access with SSH and ICMP. |
|
# permit ICMP [cent@dlp ~(keystone)]$ openstack security group rule create --protocol icmp --ingress secgroup01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | belongs_to_default_sg | False | | created_at | 2025-05-22T01:31:35Z | | description | | | direction | ingress | | ether_type | IPv4 | | id | e8488851-7c9a-45a9-8652-288ebe7d4c87 | | name | None | | normalized_cidr | 0.0.0.0/0 | | port_range_max | None | | port_range_min | None | | project_id | 6cd379304e2447da8514a66bb6cdfda5 | | protocol | icmp | | remote_address_group_id | None | | remote_group_id | None | | remote_ip_prefix | 0.0.0.0/0 | | revision_number | 0 | | security_group_id | 9d815817-44f8-414a-b02e-d314e481bdaa | | tags | [] | | updated_at | 2025-05-22T01:31:35Z | +-------------------------+--------------------------------------+ # permit SSH [cent@dlp ~(keystone)]$ openstack security group rule create --protocol tcp --dst-port 22:22 secgroup01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | belongs_to_default_sg | False | | created_at | 2025-05-22T01:31:50Z | | description | | | direction | ingress | | ether_type | IPv4 | | id | 2d1d4d1e-a69f-4e59-95dd-ba07e2c583a7 | | name | None | | normalized_cidr | 0.0.0.0/0 | | port_range_max | 22 | | port_range_min | 22 | | project_id | 6cd379304e2447da8514a66bb6cdfda5 | | protocol | tcp | | remote_address_group_id | None | | remote_group_id | None | | remote_ip_prefix | 0.0.0.0/0 | | revision_number | 0 | | security_group_id | 9d815817-44f8-414a-b02e-d314e481bdaa | | tags | [] | | updated_at | 2025-05-22T01:31:50Z | +-------------------------+--------------------------------------+[cent@dlp ~(keystone)]$ openstack security group rule list secgroup01 +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ | ID | IP Protocol | Ethertype | IP Range | Port Range | Direction | Remote Security Group | Remote Address Group | +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ | 2d1d4d1e-a69f-4e59-95dd-ba07e2c583a7 | tcp | IPv4 | 0.0.0.0/0 | 22:22 | ingress | None | None | | 55c2f63a-1b77-44ef-84bc-e51689e8e964 | None | IPv4 | 0.0.0.0/0 | | egress | None | None | | ccf5dea0-755e-4337-9cba-7f8f8f282471 | None | IPv6 | ::/0 | | egress | None | None | | e8488851-7c9a-45a9-8652-288ebe7d4c87 | icmp | IPv4 | 0.0.0.0/0 | | ingress | None | None | +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ |
| [11] | It's possible to login to the Instance to connect to the floating IP address with SSH like follows. |
|
[cent@dlp ~(keystone)]$ openstack server list +--------------------------------------+----------+--------+-------------------------------------+----------------+----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+----------+--------+-------------------------------------+----------------+----------+ | c893d245-0cf0-4672-be6c-d073746d6851 | CentOS-9 | ACTIVE | private=10.0.0.225, 192.168.100.139 | CentOS-Stream9 | m1.small | +--------------------------------------+----------+--------+-------------------------------------+----------------+----------+[cent@dlp ~(keystone)]$ ssh centos@10.0.0.225 The authenticity of host '10.0.0.225 (10.0.0.225)' can't be established. ED25519 key fingerprint is SHA256:CAUiuAPTqDbVrPwJc85tgYJqb+nWY5dkMxYrexSVR8k. This key is not known by any other names Are you sure you want to continue connecting (yes/no/[fingerprint])? yes Warning: Permanently added '10.0.0.225' (ED25519) to the list of known hosts. [centos@centos-9 ~]$ # logined |
| Sponsored Link |
|
|