{"type":"doc","content":[{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"The aggregated logging framework (","type":"text"},{"text":"Logging Architecture","type":"text","marks":[{"type":"link","attrs":{"href":"https://lf-onap.atlassian.net/wiki/spaces/DW/pages/16240125"}}]},{"text":"), uses Filebeat to send logs from each pod to the ELK stack where they are processed and stored. This requires each pod to have an additional container which will run Filebeat, and for the necessary log files to be accessible between containers.","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"A reference log demon node project exists that can be used as a guideline for the suggested setup in OOM:","type":"text"}]},{"type":"paragraph","content":[{"text":"https://gerrit.onap.org/r/gitweb?p=logging-analytics.git;a=tree;f=reference/logging-kubernetes/logdemonode;h=8f84219f008e648d5ade5137dd3f6591863b1af2;hb=d882270162d56c55da339af8fb9384e1bdc0160d","type":"text","marks":[{"type":"link","attrs":{"href":"https://gerrit.onap.org/r/gitweb?p=logging-analytics.git;a=tree;f=reference/logging-kubernetes/logdemonode;h=8f84219f008e648d5ade5137dd3f6591863b1af2;hb=d882270162d56c55da339af8fb9384e1bdc0160d"}}]}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"logging directory (verified) example here","type":"text"}]},{"type":"paragraph","content":[{"text":"https://git.onap.org/logging-analytics/tree/reference/logging-kubernetes/logdemonode/charts/logdemonode/templates/deployment.yaml#n77","type":"text","marks":[{"type":"link","attrs":{"href":"https://git.onap.org/logging-analytics/tree/reference/logging-kubernetes/logdemonode/charts/logdemonode/templates/deployment.yaml#n77"}}]}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"For the setup, we will add two resource files:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"filebeat.yml. This is the filebeat configuration file which determines the path to find log files and any other configuration of Filebeat","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"logback.xml. This is the specification of the log format and location.","type":"text"}]}]}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"The deployment in OOM is done via Helm.","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add filebeat.yml to resources (e.g. oom/kubernetes//resources/config/log/filebeat","type":"text"},{"text":"/","type":"text","marks":[{"type":"textColor","attrs":{"color":"#353535"}}]},{"text":"filebeat.yml)","type":"text"}]},{"type":"paragraph","content":[{"text":"A sample filebeat.yml can be found in the log demon node project:","type":"text"},{"type":"hardBreak"},{"text":"https://gerrit.onap.org/r/gitweb?p=logging-analytics.git;a=tree;f=reference/logging-kubernetes/logdemonode/charts/logdemonode/resources/config/log/filebeat;h=abf4f0a84ae7a15ed99fc4776727e4333948b583;hb=d882270162d56c55da339af8fb9384e1bdc0160d","type":"text","marks":[{"type":"link","attrs":{"href":"https://gerrit.onap.org/r/gitweb?p=logging-analytics.git;a=tree;f=reference/logging-kubernetes/logdemonode/charts/logdemonode/resources/config/log/filebeat;h=abf4f0a84ae7a15ed99fc4776727e4333948b583;hb=d882270162d56c55da339af8fb9384e1bdc0160d"}}]}]},{"type":"paragraph","content":[{"type":"hardBreak"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add Filebeat container to deployment.yaml:","type":"text"},{"type":"hardBreak"},{"type":"hardBreak"}]},{"type":"codeBlock","content":[{"text":" # Filebeat sidecar container\n - name: {{ include \"common.name\" . }}-filebeat-onap\n image: \"{{ .Values.global.loggingRepository }}/{{ .Values.global.loggingImage }}\"\n imagePullPolicy: {{ .Values.global.pullPolicy | default .Values.pullPolicy }}\n volumeMounts:\n - name: {{ include \"common.fullname\" . }}-filebeat-conf\n mountPath: /usr/share/filebeat/filebeat.yml\n subPath: filebeat.yml\n - name: {{ include \"common.fullname\" . }}-data-filebeat\n mountPath: /usr/share/filebeat/data\n - name: {{ include \"common.fullname\" . }}-logs\n mountPath: /var/log/onap\n\n","type":"text"}]},{"type":"paragraph","content":[{"text":"Here the image and pull policy and based on global values. ","type":"text"},{"type":"hardBreak"},{"text":"The ","type":"text"},{"text":"{{ include \"common.fullname\" . }}-filebeat-conf","type":"text","marks":[{"type":"em"}]},{"text":" volume mount is used to share the filebeat.yml config resource. ","type":"text"}]},{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"{{ include \"common.fullname\" . }}-logs","type":"text","marks":[{"type":"em"}]},{"text":" volume mount is used to share the application logs for other containers in the pod","type":"text"}]},{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"{{ include \"common.fullname\" . }}-data-filebeat","type":"text","marks":[{"type":"em"}]},{"text":" volume mount is used to share filebeat logs","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add configmap to component to reference the filebeat.yml file that will be deployed to container (e.g. kubernetes//templates/configmap.yaml:","type":"text"}]},{"type":"codeBlock","content":[{"text":"apiVersion: v1\nkind: ConfigMap\nmetadata:\n name: {{ .Release.Name }}--filebeat-configmap\n namespace: {{ include \"common.namespace\" . }}\ndata:\n{{ tpl (.Files.Glob \"resources/config/log/filebeat/filebeat.yml\").AsConfig . | indent 2 }}","type":"text"}]},{"type":"paragraph","content":[{"text":"Replace with the component name ","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add filebeat repo and image specification to values.yaml and config of service name and port:","type":"text"},{"type":"hardBreak"},{"text":"In file, oom/kubernetes//values.yaml, add ","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"codeBlock","content":[{"text":"global:\n loggingRepository: docker.elastic.co\n loggingImage: beats/filebeat:5.5.0\n\n# application configuration\nconfig:\n logstashServiceName: log-ls\n logstashPort: 5044","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add logback.xml file to microservice resources:","type":"text"},{"type":"hardBreak"},{"text":"kubernetes//charts//resources/config/logback.xml","type":"text"}]},{"type":"paragraph","content":[{"text":"A sample logback can be found here:","type":"text"},{"type":"hardBreak"},{"text":"https://gerrit.onap.org/r/gitweb?p=logging-analytics.git;a=tree;f=reference/logging-kubernetes/logdemonode/charts/logdemonode/resources/config;hb=d882270162d56c55da339af8fb9384e1bdc0160d","type":"text","marks":[{"type":"link","attrs":{"href":"https://gerrit.onap.org/r/gitweb?p=logging-analytics.git;a=tree;f=reference/logging-kubernetes/logdemonode/charts/logdemonode/resources/config;hb=d882270162d56c55da339af8fb9384e1bdc0160d"}}]}]},{"type":"paragraph","content":[{"type":"hardBreak"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create configmap for microservice to share logback.xml with application container:","type":"text"}]},{"type":"paragraph","content":[{"text":"Create/modify file, oom/kubernetes//charts//templates/configmap.yaml","type":"text","marks":[{"type":"backgroundColor","attrs":{"color":"#f0f0f0"}}]}]},{"type":"codeBlock","content":[{"text":"apiVersion: v1\nkind: ConfigMap\nmetadata:\n name: {{ include \"common.fullname\" . }}-log\n namespace: {{ include \"common.namespace\" . }}\ndata:\n{{ tpl (.Files.Glob \"resources/config/logback.xml\").AsConfig . | indent 2 }}","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add volume mounts to microservice deployment.yaml to share logs and reference logback.xml:","type":"text"}]},{"type":"paragraph","content":[{"text":"Modify ","type":"text"},{"text":"container","type":"text","marks":[{"type":"em"}]},{"text":" section of file, oom/kubernetes//charts//templates/deployment.yaml","type":"text"}]},{"type":"codeBlock","content":[{"text":" volumeMounts:\n - name: {{ include \"common.fullname\" . }}-logs\n mountPath: /var/log/onap\n - mountPath: /opt/ajsc/etc/config/logback.xml\n name: {{ include \"common.fullname\" . }}-log-conf\n subPath: logback.xml","type":"text"}]},{"type":"paragraph","content":[{"text":"Note volumeMounts section may already exist. If so, just add new content to the existing section","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add volumes specification to microservice deployment.yaml to 1) share logback.xml via configmap, 2) share filebeat.yml via configmap, 3) share filebeat data via emptyDir 4) share application log data via emptyDir","type":"text"},{"type":"hardBreak"},{"text":"Add/modify ","type":"text"},{"text":"volumes","type":"text","marks":[{"type":"em"}]},{"text":" section of file, oom/kubernetes//charts//templates/deployment.yaml","type":"text"}]},{"type":"codeBlock","content":[{"text":" volumes:\n - name: {{ include \"common.fullname\" . }}-log-conf\n configMap:\n name: {{ include \"common.fullname\" . }}-log\n - name: {{ include \"common.fullname\" . }}-filebeat-conf\n configMap:\n name: {{ .Release.Name }}--filebeat-configmap\n - name: {{ include \"common.fullname\" . }}-data-filebeat\n emptyDir: {}\n - name: {{ include \"common.fullname\" . }}-logs\n emptyDir: {}","type":"text"}]},{"type":"paragraph","content":[{"text":"Replace with the component name","type":"text","marks":[{"type":"strong"}]},{"type":"hardBreak"},{"text":"If volumes section already exists, add content to existing section","type":"text"}]}]}]}],"version":1}

Browser not supported