Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Document a Highly-Available K8s Cluster Deployment (RKE 0.2.1 / K8S 1.13.5 / Helm (2.12.3 - not 2.13.1) / Docker 18.09.5)

Description

code in https://gerrit.onap.org/r/#/c/79067/
RKE 2.0 out 26 March 2019

Kubernetes Cluster instability has been observed during integration testing in ONAP lab environments. The currently documented k8s cluster deployment is no longe sufficient. This story is deliver on a new documented mechanism for deploying a more stable H/A k8s cluster.
20190227 - preliminary video - all the way to tiller installation
https://wiki.onap.org/display/DW/OOM+RKE+Kubernetes+Deployment#OOMRKEKubernetesDeployment-AutomatedInstallationVideoofRKEinstall
moving code to this jira - https://gerrit.onap.org/r/#/c/79067/
20190224 test config
doc in https://wiki.onap.org/display/DW/OOM+RKE+Kubernetes+Deployment

  1. install docker
    curl https://releases.rancher.com/install-docker/17.03.sh | sh

  2. install rke
    sudo wget https://github.com/rancher/rke/releases/download/v0.1.15/rke_linux-amd64
    mv rke_linux-amd64 rke
    sudo mv ./rke /usr/local/bin/rke

  3. copy your private ssh key to the VMs

  4. provision a static EIP/VIP - optionally register a domain name

  5. edit cluster.yaml

  6. run rke up
    sudo rke up --config cluster2.yaml

  7. install kubectl
    https://git.onap.org/logging-analytics/tree/deploy/rancher/oom_rancher_setup.sh#n97

  8. test cluster

  1. RBAC lockdown cluster

The current proposal is to move away from the graphical Rancher UI, in favor of using the more modern RKE deployment tool.

20190219 Note: OOM-1508 may just use the default ingress controller that comes with RKE
also test domain key in dev.yaml - below openStackUserName
test inside a proxy

Attachments

5
100% Done
Loading...

blocks

duplicates

is duplicated by

relates to

Activity

Show:

Former user May 1, 2019 at 3:28 PM

k8s dashboard
rancher dashboard
cni

Former user April 30, 2019 at 3:12 PM
Edited

for cd.sh add same --recurse-submodules as gary
https://gerrit.onap.org/r/#/c/86638/1/deployment/heat/onap-rke/rancher_vm_entrypoint.sh

in cd.sh - also remove all the pv/pvc delete - as it will break rke now
https://git.onap.org/logging-analytics/tree/deploy/cd.sh

and adjust for overrides
helm deploy dev local/onap -f /root/oom/kubernetes/onap/resources/environments/public-cloud.yaml -f /root/oom/kubernetes/onap/resources/overrides/onap-all.yaml -f /root/integration-override.yaml --namespace onap

Former user April 29, 2019 at 8:43 PM

change for RKE 0.2.1, Kubernetes 1.13.5, helm 2.12.3, docker 18.09.5 in
https://gerrit.onap.org/r/#/c/86565/

Former user April 29, 2019 at 8:33 PM

verified script retrofit

Former user April 26, 2019 at 2:41 PM

We seem to be ok on the following config
RKE 0.2.1, Ubuntu 18.04 / Kubernetes/kubectl 1.13.5 / Helm 2.13.1 / Docker 18.09.5

Manual details to be retrofitted into an HA version of the rke script in
https://wiki.onap.org/display/DW/OOM+RKE+Kubernetes+Deployment#OOMRKEKubernetesDeployment-DI20190425:HARKEinstallTesting

Will need to retest on windriver using a heat template (had connection issues)
Will verify an onap deployment now

Done

Details

Assignee

Reporter

Labels

Fix versions

Priority

Parent

Created January 21, 2019 at 6:04 PM
Updated August 12, 2023 at 4:53 AM
Resolved May 15, 2019 at 7:47 PM