We use the similar lab infrastructure recommended by OPNFV project.
ONAP Lab Specification
The lab specification section provides information on hardware and network requirements
Hardware
A lab compliant test-bed provides:
- One CentOS 7 jump server on which the installer runs
- You may select a variety of deployment toolchains to deploy from the jump server.
- Minimal 5 compute / controller nodes
- A configured network topology allowing for LOM, Admin, Public, Private, and Storage Networks
- Remote access through VPN
Servers
CPU:
- Intel Xeon E5-2600v2 Series or newer
Firmware:
- BIOS/EFI compatible for x86-family servers
Local Storage:
Below describes the minimum for the spec, which is designed to provide enough capacity for a reasonably functional environment. Additional and/or faster disks are nice to have.
- Disks: 2 x 1TB HDD + 1 x 100GB SSD (or greater capacity)
- The first HDD should be used for OS & additional software/tool installation
- The second HDD is configured for CEPH object storage
- The SSD should be used as the CEPH journal
- Virtual ISO boot capabilities or a separate PXE boot server (DHCP/tftp or Cobbler)
Memory:
- 188G RAM Minimum
Power Supply
Single power supply acceptable (redundant power not required/nice to have)
Networking
Network Hardware
- 24 or 48 Port TOR Switch
- NICs - Combination of 1GE and 10GE based on network topology options (per server can be on-board or use PCI-e)
- Connectivity for each data/control network is through a separate NIC. This simplifies Switch Management however requires more NICs on the server and also more switch ports
- BMC (Baseboard Management Controller) for lights-out mangement network using IPMI (Intelligent Platform Management Interface)
Network Options
- Option I: 4x1G Control, 2x10G Data, 48 Port Switch
- 1 x 1G for lights-out Management
- 1 x 1G for Admin/PXE boot
- 1 x 1G for control-plane connectivity
- 1 x 1G for storage
- 2 x 10G for data network (redundancy, NIC bonding, High bandwidth testing)
- Option II: 1x1G Control, 2x 10G Data, 24 Port Switch
- Connectivity to networks is through VLANs on the Control NIC
- Data NIC used for VNF traffic and storage traffic segmented through VLANs
- Option III: 2x1G Control, 2x10G Data, 2x10G Storage, 24 Port Switch
- Data NIC used for VNF traffic
- Storage NIC used for control plane and Storage segmented through VLANs (separate host traffic from VNF)
- 1 x 1G for lights-out mangement
- 1 x 1G for Admin/PXE boot
- 2 x 10G for control-plane connectivity/storage
- 2 x 10G for data network
Documented configuration to include:
- Subnet, VLANs (may be constrained by existing lab setups or rules)
- IPs
- Types of NW - lights-out, public, private, admin, storage
- May be special NW requirements for performance related projects
- Default gateways
Remote Management
Remote access is required for …
- Developers to access deploy/test environments (credentials to be issued per POD / user)
- Connection of each environment to Jenkins master hosted by Linux Foundation for automated deployment and test
OpenVPN is generally used for remote however community hosted labs may vary due to company security rules. For POD access rules / restrictions refer to individual lab documentation as each company may have different access rules and acceptable usage policies.
Basic requirements:
- SSH sessions to be established (initially on the jump server)
- Packages to be installed on a system (tools or applications) by pulling from an external repo.
Firewall rules accommodate:
- SSH sessions
- Jenkins sessions
Lights-out management network requirements:
A Pod Example:
| Hostname | CPU | Memory | Storage | ipmi | Admin/PXE | Private | Public | Storage | 40GbE: NIC#, MAC,VLAN, IP, Network | 10GbE: NIC#, IP, MAC, VLAN, Network |
|---|---|---|---|---|---|---|---|---|---|---|
| jumpserver | Intel(R) Xeon(R) CPU E5-2658A V3 @ 2.20GHz | 188G | 1.7T | Mac 88:cf:98:db:ad:fb IP 172.30.8.64 root/Onap12#$ | Port Mac IP | Port Mac IP | Port Mac IP | Port Mac IP | p1p1:Mac:88:cf:98:e9:9a:bd,VLAN 31, p1p2:Mac:88:cf:98:e9:9a:be,VLAN 31, | p4p1:Mac:88:cf:98:61:66:e2, IP:192.168.30.2 p4p2:Mac:88:cf:98:61:66:e3, |
| Host1 | Intel(R) Xeon(R) CPU E5-2658A V3 @ 2.20GHz | 188G | 1.7T | Mac 88:cf:98:db:ad:db IP172.30.8.10 root/Onap12#$ | eth0:Mac:88:cf:98:e9:9a:99,VLAN 31, eth3:Mac:88:cf:98:e9:9a:9a,VLAN 31, | eth1:Mac:88:cf:98:83:31:d7,IP eth2:Mac:88:cf:98:83:31:d8, | ||||
| Host2 | Intel(R) Xeon(R) CPU E5-2658A V3 @ 2.20GHz | 188G | 1.7T | Mac 88:cf:98:db:ad:0b IP 172.30.8.11 root/Onap12#$ | eth0:Mac:88:cf:98:e9:9a:c3,VLAN 31, eth3:Mac:88:cf:98:e9:9a:c4,VLAN 31, | eth1:Mac:88:cf:98:61:67:0a, IP eth2:Mac:88:cf:98:61:66:0b | ||||
| Host3 | Intel(R) Xeon(R) CPU E5-2658A V3 @ 2.20GHz | 188G | 1.7T | Mac 88:cf:98:db:ad:dd IP 172.30.8.12 root/Onap12#$ | eth0:Mac:88:cf:98:e9:9a:b3,VLAN 31, eth3:Mac:88:cf:98:e9:9a:b4,VLAN 31, | eth1:Mac:88:cf:98:61:66:d8, IP eth2:Mac:88:cf:98:61:66:d9 | ||||
| Host4 | Intel(R) Xeon(R) CPU E5-2658A V3 @ 2.20GHz | 188G | 1.7T | Mac 88:cf:98:db:b1:d7 IP 172.30.8.13 root/Onap12#$ | eth0:Mac:88:cf:98:e9:9a:9b,VLAN 31, eth3:Mac:88:cf:98:e9:9a:9c,VLAN 31, | eth1:Mac:88:cf:98:83:30:b3, IP peth2:Mac:88:cf:98:83:30:b4, | ||||
| Host5 | Intel(R) Xeon(R) CPU E5-2658A V3 @ 2.20GHz | 188G | 1.7T | Mac 88:cf:98:db:ad:39 IP 172.30.8.14 root/Onap12#$ | eth0:Mac:88:cf:98:e9:9a:af,VLAN 31, eth3:Mac:88:cf:98:e9:9a:b0,VLAN 31, | eth1:Mac:88:cf:98:61:66:da, IP eth2:Mac:88:cf:98:61:66:db |
The network diagram for the above pod:
IPMI/Lights+out management Admin Private Public Storage
PXE
vlan 300
172.30.8.64/26 192.168.1.0/24 +
+ + 192.168.0.0/24| |
| | + + |
| | | 172.30.10.0/24 |
| +-----------------+ | | + |
| | | enp6 | | | |
+--------+ Jumpserver | 192.168.1.66 | | | |
| | CentOS 7 +-----------------------------+ | | |
| | | | | | |
| | | enp7 | | | |
| | | 192.168.0.66 | | | |
| | user/pass +---------------------------------------+ | |
| | | | | | |
| | | enp8 | | | |
| | | 172.30.10.72 | | | |
| | +-------------------------------------------------+ |
| | | | | | |
| | | enp9 | | | |
| | | | | | |
| | +----------------------------------------------------------+
| | | | | | |
| +-----------------+ | | | |
| | | | |
| | | | |
| | | | |
| +----------------+ | | | |
| | 1 | | | | |
+-------+ +--------------+-+ | | | |
| | | 2 | | | | |
| | | +--------------+-+ | | | |
| | | | 3 | | | | |
| | | | +--------------+-+ | | | |
| | | | | 4 | | | | |
| +-+ | | +--------------+-+ | | | |
| | | | | 5 +-----------------------+ | | |
| +-+ | | nodes for | | | | |
| | | | deploying +---------------------------------+ | |
| +-+ | ONAP | | | | |
| | | +-------------------------------------------+ |
| +-+ | | | | |
| | +----------------------------------------------------+
| +----------------+ | | | |
| | | | |
| | | | |
| + + + +