...
Beijing requires the following to run: Note there is a 110 pod limit per VM - we currently deploy 175+ pods - hence 2+ VMs for full deployment
- Full production/staging
- Minimum 2 VMs, 12vCores total, 96G total ram, 100G HD per VM
- Recommended 3-9 VMs, 24-64 vCores, 128+ total ram, 160G HD per VM + 1 8G/100G kubernetes master VM
- Developer:
- Minimum 1 VM at 4+ vCores, 16-64G ram, 100G HD - collocated kubernetes master, host and jumpbox (deploys a subset of ONAP)
- Recommended 3 VMs 1x8G kubernetes master and 2 x 64G hosts
Amazon AWS
...
Minimum Deployment costs
20190305: Dublin state
Cost is ~$10/day or $300/month per 128G deployment – (I happen to have 128G worth of VMs running on the 75% off spot market – including cost effective R4 instances, EBS store and EFS NFS) – 2 deployments and dev cost will run under $1k US. Based on the level of funding we will go with pure IaaS VMs up to the EKS PaaS for K8s – but that runs over $20/day. Ideally we should be running 160G+ clusters but 128G is ok for specific VNFs like the vFW - https://lf-onap.atlassian.net/wiki/display/DW/Cloud+Native+Deployment#CloudNativeDeployment-AmazonAWS
For details on ONAP deployment via OOM on Kubernetes see Cloud Native Deployment#AmazonAWS
Color coded costs are Required, Maximum, Medium, Minimum
Total US $/month (0*) | EBS cost (3*) | spot vm/hr Artifact75% off | # | vCoresvCore | Ram | HD (min) | Flavor | Use | Description | |||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| $66 | $0.06 | $0.032 | 1 | 2 | 15 | 100g | R4.large | DevOps | Jump box - cloudformation | |||||||||||||||||||||||||||
| $66 | $0.06 | $0.032 | 1 | 2 | 15 | 100g | R4.large | DevOps | Jenkins server | |||||||||||||||||||||||||||
| $66 | $0.06 | $0.032 | 1 | 2 | 15 | 100g | R4.large | DevOps | Kibana (ELK) server | |||||||||||||||||||||||||||
| $89 x 4 = $354 | $0.06 | $0.063 | 4 | 4 | 31 | 100g | R4.xlarge | DevOps | Minimum CD cluster 1* | |||||||||||||||||||||||||||
| $66 | $0.06 | $0.032 | 1 | 2 | 15 | 100g | R4.large | DevOps | Minimum CD master | |||||||||||||||||||||||||||
| $238 x 4 = $950 | $0.06 | $0.27 | 4 | 16 | 122 | 100g | R4.4xlarge | DevOps | production CD cluster 1* | |||||||||||||||||||||||||||
| $66 | $0.06 | $0.032 | 1 | 2 | 15 | 100g | R4.large | DevOps | production kubernetes master | |||||||||||||||||||||||||||
| $138 x 4 = $552 | $0.06 | $0.13 | 4 | 8 | 61 | 100g | R4.2xlarge | DevOps | staging cluster 2* | |||||||||||||||||||||||||||
| $66 | $0.06 | $0.032 | 1 | 2 | 15 | 100g | R4.large | staging kubernetes master | ||||||||||||||||||||||||||||
| $89 x 4 = | $527$354 | $0.12 | $0.063 | 4 | 4 | 31 | 320g | R4.xlarge | DevOps | long duration cluster | ||||||||||||||||||||||||||
| $110 | $0.12 | $0.032 | 1 | 2 | 15 | 320g | R4.large | long duration cluster k8s master | ||||||||||||||||||||||||||||
| $138 x 2 = $276 | $0.06 | $0.13 | 2 | 8 | 61 | 100g | R4.2xlarge | Dev | developer cluster | |||||||||||||||||||||||||||
| $66 | $0.06 | $0.032 | 1 | 2 | 15 | 100g | R4.large | developer cluster kubernetes master | ||||||||||||||||||||||||||||
| $138 | $0.06 | $0.13 | 1 | 8 | 61 | 100g | R4.2xlarge | Dev | developer onap subset collocated VM | |||||||||||||||||||||||||||
| $0 | $0 | $0 | Route53 DNS/EIP $2/month per unused EIP | |||||||||||||||||||||||||||||||||
$0 | $0 | $0 | VPC, NG, SG, IAM, (network costs) | |||||||||||||||||||||||||||||||||
| Total cost / month - SPOT (max CD prod cluster - max dev cluster x 1) | $66 + $66 + $66 + $950 + $66 + | $527 $354 + $110 + $276 + $66 = | $2200$2020/month = | $26k$24.2k/year US (4*) | ||||||||||||||||||||||||||||||||
| Total cost / month - SPOT (medium CD prod cluster - min dev cluster x 1) | $66 + $66 + $66 + $552 + $66 + | $527 $354 + $110 + $138 = | $1590$1418/month = | $19k$17k/year US (4*) | ||||||||||||||||||||||||||||||||
| Total cost / month - SPOT (minimum CD cluster - min dev cluster - collocated host) | $66 + $66 + $66 + $354 + $66 + $276 = $894/month = $11K US | |||||||||||||||||||||||||||||||||||
| Total cost / month - reserved | ||||||||||||||||||||||||||||||||||||
Notes:
0 - assumes us-east-1 region (us-east-2 region is cleaper (ohio) but the spot market there is more unstable) - if you use ohio - cut costs by about 40% for spot - ie: r4.2xlarg is 0.13 but 0.07 in ohio)
...
| Code Block |
|---|
SPOT only
{
"IamFleetRole": "arn:aws:iam::4532790942004.....:role/aws-ec2-spot-fleet-tagging-role",
"AllocationStrategy": "lowestPrice",
"TargetCapacity": 1,
"SpotPrice": "0.532",
"ValidFrom": "2018-01-31T20:31:16Z",
"ValidUntil": "2019-01-31T20:31:16Z",
"TerminateInstancesWithExpiration": true,
"LaunchSpecifications": [
{
"ImageId": "ami-aa2ea6d0",
"InstanceType": "r4.2xlarge",
"KeyName": "obrien_systems_aws_20141115obr...15",
"SpotPrice": "0.532",
"BlockDeviceMappings": [
{
"DeviceName": "/dev/sda1",
"Ebs": {
"DeleteOnTermination": true,
"VolumeType": "gp2",
"VolumeSize": 120,
"SnapshotId": "snap-0dcc947e7c10bed94"
}
}
],
"SecurityGroups": [
{
"GroupId": "sg-de2185a9"
}
]
}
],
"Type": "request"
} |
...