Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: tcagen2 logs and deploy update

Table of Contents

Overview

Architecture Diagram

Artifacts

Βlueprint (deployment artifact) :

Input file (deployment input)    :

Docker image                            : nexus3.onap.org:10001/onap/<>

Deployment Prerequisite/dependencies

Deployment Steps

Deployment of Tca-gen2 can be done using Dashboard UI or CloudifyUI or via CLI. Below steps are based on CLI.

...

Validate blueprint

Code Block
languagebash
themeMidnight
titleValidate Blueprint
linenumberstrue
cfy blueprints validate /blueprints/k8s-tca-gen2.yaml

...

Verify Plugin versions in target Cloudify instance match to blueprint imports

Code Block
languagebash
themeMidnight
titleVerify Plugin version
linenumberstrue
cfy plugins list

If the version of plugin used are different, update the blueprint import to match.

Deploy Service

Code Block
languagebash
themeMidnight
titleUpload and deploy blueprint
linenumberstrue
cfy install -b tca-gen2 -d tca-gen2 -i /k8s-tca-gen2-inputs.yaml /blueprints/k8s-tca-gen2.yaml

To un-deploy

Uninstall running component and delete deployment

Code Block
languagebash
themeMidnight
titleUninstall component
linenumberstrue
cfy uninstall tca-gen2

Delete blueprint

Code Block
languagebash
themeMidnight
titleDelete blueprint
linenumberstrue
cfy blueprints delete tca-gen2

Initial Validation

After deployment, verify if tca-gen2 POD and mongoDB pod are running correctly

Table of Contents

Overview


The TCA-gen2 is docker based mS intended to replace TCA/cdap version, which was first delivered as part of ONAP R0. Functionality of TCA-gen2 is identical to that of TCA - where meaurement events are subscribed from DMAAP in VES structure, once events are recieved TCA-gen2 performs a comparison of an incoming performance metric(s) against both a high and low threshold defined and generates CL events when threshold are exceeded. When the original threshold defined are cleared, TCA-Gen2 will generate an ABATEMENT event to notify the downstream system on original problem being cleared.


Artifacts

Βlueprint (deployment artifact) :  https://git.onap.org/dcaegen2/platform/blueprints/tree/blueprints/k8s-tcagen2.yaml

Input file (deployment input)    :   https://git.onap.org/oom/tree/kubernetes/dcaegen2/components/dcae-bootstrap/resources/inputs/k8s-tcagen2-inputs.yaml

Docker image                            :   nexus3.onap.org:10001/onap/org.onap.dcaegen2.analytics.tca-gen2.dcae-analytics-tca-web:1.0.1



Deployment Prerequisite/dependencies

  • DCAE and DMaaP pods should be up and running.
  • MongoDB should be up and running


Code Block
languagetext
themeMidnight
titlemongodb
 root@onap2-nfs:~# kubectl get pods -n onap | grep mongo
 dev-dcae-mongo-0 1/1 Running 0 5d22h


Deployment Steps


Deployment of Tca-gen2 can be done using Dashboard UI or CloudifyUI or via CLI. Below steps are based on CLI.


  • Log-in to the DCAE bootstrap POD's main container
  • Update blueprint file in DCAE bootstrap POD under /blueprints directory if required
  • Update blueprint component inputs file in DCAE bootstrap POD under /inputs directory
  • Validate blueprint

    Code Block
    languagebash
    themeMidnight
    title

...

And then check the logs to see if it can connect to DMaaP, polling for events.

  • Validate Blueprint
    linenumberstrue

...

root@k8s-rancher:~# kubectl get pods -n onap | egrep "tca-gen2|mongoDB"
  • cfy blueprints validate /blueprints/k8s-tca-gen2.yaml


  • Verify Plugin versions in target Cloudify instance match to blueprint imports

    Code Block
    languagebash
    themeMidnight
    titleVerify Plugin version
    linenumberstrue
    cfy plugins list

    If the version of plugin used are different, update the blueprint import to match.

  • Deploy Service

    Code Block
    languagebash
    themeMidnight
    title

...

  • Upload and deploy blueprint
    linenumberstrue

...

  • cfy 

...

  • install -

...

  • -blueprint-

...

  • id 

...

  • tcagen2 

...

  • -

...

  • -

...

Functional tests

...

  • deployment-id tcagen2 -i /inputs/k8s-tcagen2-inputs.yaml /blueprints/k8s-tcagen2.yaml


To un-deploy

  • Uninstall running component and delete deployment

  • Correct DMaaP address
  • "eventName" field in VES input matches eventName configuration set in tca-gen2 Service
  • "lastEpochMicrosec" in reflecting current time stamp approximately
    Code Block
    languagebash
    themeMidnight
    title

...

To simulate the event flow and trigger missing tca-gen2 event, we can simulate a VES event into tca-gen2 subscription topic (using curl).

Generate tca-gen2 CL Onset

Send a triggering event to DMaaP topic unauthenticated.SEC_tca-gen2_OUTPUT

Before sending, validate following

  • Uninstall component
    linenumberstrue
    cfy uninstall tcagen2


  • Delete blueprint

    Code Block
    languagebash
    themeMidnight
    titleDelete blueprint
    linenumberstrue
    cfy blueprints delete tcagen2
    


Initial Validation

After deployment, verify if tcagen2 POD and mongoDB pod are running correctly

...

Code Block
languagebash
themeMidnight
titleTrigger a Verify Heartbeat is running
linenumberstrue
curl -X POST http://10.12.5.8:30227/events/unauthenticated.SEC_tca-gen2_OUTPUT -H 'Content-Type: application/json' -d '{
        "event": {
                "commonEventHeader": {
                        "startEpochMicrosec": 1556753402000,
                        "sourceId": "79e90d76-513a-4f79-886d-470a0037c5cf",
                        "eventId": "tca-gen2_vDNS_10.0.0.1",
                        "nfcNamingCode": "DNS",
                        "reportingEntityId": "79e90d76-513a-4f79-886d-470a0037c5cf",
                        "eventType": "applicationVnf",
                        "priority": "Normal",
                        "version": 3,
                        "reportingEntityName": "testcmd001",
                        "sequence": 36312,
                        "domain": "tca-gen2",
                        "lastEpochMicrosec": 1556753402000,
                        "eventName": "tca-gen2_vDNS",
                        "sourceName": "testnode001",
                        "nfNamingCode": "MDNS"
                }
        }
}'
Code Block
languagebash
themeMidnight
titleLogs showing VES heartbeat event being processed
linenumberstrue

We can check that a new DCAE_CL_OUTPUT event has been published (make sure you target the correct DMaaP IP address)

Code Block
languagebash
themeMidnight
titleFetch events from DCAE_CL_OUTPUT topic
linenumberstrue
curl http://10.12.5.8:30227/events/unauthenticated.DCAE_CL_OUTPUT/vv/1
Code Block
languagebash
themeMidnight
titlePublished event
linenumberstrue

["{\"closedLoopEventClient\": \"DCAE_tca-gen2_MS\", \"policyVersion\": \"1.0.0.5\", \"policyName\": \"vFireWall\", \"policyScope\": \"resource=sampleResource,type=sampletype,CLName=sampleCLName\", \"target_type\": \"VNF\", \"AAI\": {\"generic-vnf.vnf-name\": \"testnode001\"}, \"closedLoopAlarmStart\": 1556768124419, \"closedLoopEventStatus\": \"ONSET\", \"closedLoopControlName\": \"ControlLoopEvent1\", \"version\": \"1.0\", \"target\": \"genVnfName\", \"requestID\": \"8c1b8bd8-06f7-493f-8ed7-daaa4cc481bc\", \"from\": \"DCAE\"}"]

Generate tca-gen2 CL Abatement Event

Send a triggering event to DMaaP topic unauthenticated.SEC_tca-gen2_OUTPUT

Before sending, validate following

  • Correct DMaaP address
  • "eventName" field in VES input matches eventName configuration set in tca-gen2 Service
  • "lastEpochMicrosec" in reflecting current time stamp approximately
  •  Ensure the event is on the same "sourceName" as original event sent
Code Block
languagebash
themeMidnight
titleResend heartbeat with new timestamp
linenumberstrue
curl -X POST http://10.12.5.8:30227/events/unauthenticated.SEC_tca-gen2_OUTPUT -H 'Content-Type: application/json' -d '{
        "event": {
                "commonEventHeader": {
                        "startEpochMicrosec": 1556768319000,
                        "sourceId": "79e90d76-513a-4f79-886d-470a0037c5cf",
                        "eventId": "tca-gen2_vDNS_10.0.0.1",
                        "nfcNamingCode": "DNS",
                        "reportingEntityId": "79e90d76-513a-4f79-886d-470a0037c5cf",
                        "eventType": "applicationVnf",
                        "priority": "Normal",
                        "version": 3,
                        "reportingEntityName": "testcmd001",
                        "sequence": 36312,
                        "domain": "tca-gen2",
                        "lastEpochMicrosec": 1556768319000,
                        "eventName": "tca-gen2_vDNS",
                        "sourceName": "testnode001",
                        "nfNamingCode": "MDNS"
                }
        }
}'

...

languagebash
themeMidnight
titleLogs showing CL abatement event generation
linenumberstrue

We can check that a new DCAE_CL_OUTPUT event has been published (make sure you target the correct DMaaP IP address)

Code Block
languagebash
themeMidnight
titleFetch events from DCAE_CL_OUTPUT topic
linenumberstrue
curl http://10.12.5.8:30227/events/unauthenticated.DCAE_CL_OUTPUT/vv/1
Code Block
languagebash
themeMidnight
titleCL Abatement Published event
linenumberstrue
["{\"closedLoopEventClient\": \"DCAE_tca-gen2_MS\", \"policyVersion\": \"1.0.0.5\", \"policyName\": \"vFireWall\", \"policyScope\": \"resource=sampleResource,type=sampletype,CLName=sampleCLName\", \"target_type\": \"VNF\", \"AAI\": {\"generic-vnf.vnf-name\": \"testnode001\"}, \"closedLoopAlarmStart\": 1556768386209, \"closedLoopEventStatus\": \"ABATED\", \"closedLoopControlName\": \"ControlLoopEvent1\", \"version\": \"1.0\", \"target\": \"genVnfName\", \"requestID\": \"8c1b8bd8-06f7-493f-8ed7-daaa4cc481bc\", \"from\": \"DCAE\"}"]

Dynamic Configuration Update

As the tca-gen2 service periodically polls Consul KV using configbindingService api's - the run time configuration of tca-gen2 service can be updated dynamically without having to redeploy/restart the service. The updates to configuration can be triggered either from Policy (or CLAMP) or made directly in Consul.

Locate the servicename by executing into tca-gen2 Service pod and getting env HOSTNAME value

Code Block
themeMidnight
titleServiceName of Heartbeat Service

root@k8s-rancher:~# kubectl exec -it -n onap dep-s78f36f2daf0843518f2e25184769eb8b-dcae-tca-gen2-servithzx2 /bin/bash
Defaulting container name to s78f36f2daf0843518f2e25184769eb8b-dcae-tca-gen2-service.
Use 'kubectl describe pod/dep-s78f36f2daf0843518f2e25184769eb8b-dcae-tca-gen2-servithzx2 -n onap' to see all of the containers in this pod.

misshtbt@s78f36f2daf0843518f2e25184769eb8b-dcae-tca-gen2-service:~/bin$ env | grep HOSTNAME
HOSTNAME=s78f36f2daf0843518f2e25184769eb8b-dcae-tca-gen2-service

Change the configuration for Service in KV-store through UI

Code Block
languagebash
themeMidnight
titleConsul URL
http://<k8snodeip>:30270/ui/#/dc1/kv/
root@k8s-rancher:~# kubectl get pods -n onap | egrep "tcagen2|mongoDB"


And then check the logs to see if it can connect to DMaaP, polling for events.

Code Block
languagebash
themeMidnight
titleVerify Logs for Dmaap poll
linenumberstrue
kubectl logs -f -n onap dep-dcae-tca-gen2-service-5ff7558fd-4nt6z  dcae-tcagen2
.


Functional tests

Following default configuration is loaded into tcagen2 (set in blueprint configuration)


Code Block
languagebash
themeMidnight
titleConfiguration
{
	"spring.data.mongodb.uri": "mongodb://dcae-mongohost/dcae-tcagen2",
	"streams_subscribes": {
		"tca_handle_in": {
			"type": "message_router",
			"dmaap_info": {
				"topic_url": "http://message-router:3904/events/unauthenticated.VES_MEASUREMENT_OUTPUT/"
			}
		}
	},
	"tca.enable_ecomp_logging": true,
	"tca.enable_abatement": true,
	"tca.aai.password": "DCAE",
	"streams_subscribes.tca_handle_in.consumer_group": "cg1",
	"streams_subscribes.tca_handle_in.polling.auto_adjusting.step_up": 10000,
	"tca.aai.node_query_path": "aai/v11/search/nodes-query",
	"streams_publishes": {
		"tca_handle_out": {
			"type": "message_router",
			"dmaap_info": {
				"topic_url": "http://message-router:3904/events/unauthenticated.TCAGEN2_OUTPUT/"
			}
		}
	},
	"streams_subscribes.tca_handle_in.consumer_ids[1]": "c1",
	"tca.aai.generic_vnf_path": "aai/v11/network/generic-vnfs/generic-vnf",
	"streams_subscribes.tca_handle_in.polling.auto_adjusting.step_down": 30000,
	"streams_subscribes.tca_handle_in.polling.auto_adjusting.max": 60000,
	"tca.aai.username": "DCAE",
	"streams_subscribes.tca_handle_in.polling.auto_adjusting.min": 30000,
	"tca.aai.url": "http://aai.onap.svc.cluster.local",
	"streams_subscribes.tca_handle_in.timeout": -1,
	"tca.aai.enable_enrichment": true,
	"tca.policy": "{\"domain\":\"measurementsForVfScaling\",\"metricsPerEventName\":[{\"eventName\":\"vFirewallBroadcastPackets\",\"controlLoopSchemaType\":\"VM\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":300,\"direction\":\"LESS_OR_EQUAL\",\"severity\":\"MAJOR\",\"closedLoopEventStatus\":\"ONSET\"},{\"closedLoopControlName\":\"ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":700,\"direction\":\"GREATER_OR_EQUAL\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]},{\"eventName\":\"vLoadBalancer\",\"controlLoopSchemaType\":\"VM\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vDNS-6f37f56d-a87d-4b85-b6a9-cc953cf779b3\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":300,\"direction\":\"GREATER_OR_EQUAL\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]},{\"eventName\":\"Measurement_vGMUX\",\"controlLoopSchemaType\":\"VNF\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vCPE-48f0c2c3-a172-4192-9ae3-052274181b6e\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.additionalMeasurements[*].arrayOfFields[0].value\",\"thresholdValue\":0,\"direction\":\"EQUAL\",\"severity\":\"MAJOR\",\"closedLoopEventStatus\":\"ABATED\"},{\"closedLoopControlName\":\"ControlLoop-vCPE-48f0c2c3-a172-4192-9ae3-052274181b6e\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.additionalMeasurements[*].arrayOfFields[0].value\",\"thresholdValue\":0,\"direction\":\"GREATER\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]}]}",
	"tca.processing_batch_size": 10000,
	"streams_subscribes.tca_handle_in.polling.fixed_rate": 0,
	"streams_subscribes.tca_handle_in.message_limit": 50000,
	"service_calls": [],
	"streams_subscribes.tca_handle_in.consumer_ids[0]": "c0"
}


To simulate the event flow and trigger missing tca-gen2 event, we can simulate a VES event into tca-gen2 subscription topic (using curl).

Generate tca-gen2 CL Onset

Send a triggering event to VES Collector; the output gets published to DMaaP topic unauthenticated.VES_MEASUREMENT_OUTPUT

Before sending, validate following

  • "eventName" field in VES input matches eventName configuration set in tca-gen2 Service
  • "lastEpochMicrosec" in reflecting current time stamp approximately


Code Block
languagebash
themeMidnight
titleTrigger a Heartbeat
linenumberstrue
curl -i -u 'sample1:sample1' -X POST -d @f5-cl.txt --header "Content-Type: application/json" https://10.12.7.116:30417/eventListener/v5 -k
HTTP/1.1 202
Content-Type: application/json
Content-Length: 8
Date: Tue, 14 Apr 2020 16:36:43 GMT


Where f5-cl.txt contains below VES event

{
	"event": {
		"commonEventHeader": {
			"startEpochMicrosec": 1507750704126521,
			"sourceId": "4c32fa09-83e7-43cf-8bba-c72557afe408",
			"eventId": "TrafficStats_1.2.3.4",
			"nfcNamingCode": "vVNF",
			"reportingEntityId": "No UUID available",
			"eventType": "HTTP request rate",
			"priority": "Normal",
			"version": 1.2,
			"reportingEntityName": "fwll",
			"sequence": 85,
			"domain": "measurementsForVfScaling",
			"lastEpochMicrosec": 1507750714317473,
			"eventName": "vFirewallBroadcastPackets",
			"sourceName": "zdfw1fwl01fwl01",
			"nfNamingCode": "vVNF"
		},
		"measurementsForVfScalingFields": {
			"cpuUsageArray": [{
				"percentUsage": 0,
				"cpuIdentifier": "cpu1",
				"cpuIdle": 100,
				"cpuUsageSystem": 0,
				"cpuUsageUser": 0
			}],
			"measurementInterval": 10,
			"requestRate": 2256,
			"vNicPerformanceArray": [{
				"transmittedOctetsDelta": 0,
				"receivedTotalPacketsDelta": 1002,
				"vNicIdentifier": "eth0",
				"valuesAreSuspect": "true",
				"transmittedTotalPacketsDelta": 0,
				"receivedOctetsDelta": 61200
			}],
			"measurementsForVfScalingVersion": 2.1
		}
	}
}


Code Block
languagebash
themeMidnight
titleVES output
linenumberstrue
curl  https://10.12.7.116:30226/events/unauthenticated.VES_MEASUREMENT_OUTPUT/vv/1 -k

["{\"event\":{\"commonEventHeader\":{\"startEpochMicrosec\":1507750704126521,\"sourceId\":\"4c32fa09-83e7-43cf-8bba-c72557afe408\",\"eventId\":\"TrafficStats_1.2.3.4\",\"nfcNamingCode\":\"vVNF\",\"reportingEntityId\":\"No UUID available\",\"internalHeaderFields\":{\"collectorTimeStamp\":\"Tue, 04 14 2020 04:39:02 UTC\"},\"eventType\":\"HTTP request rate\",\"priority\":\"Normal\",\"version\":1.2,\"reportingEntityName\":\"fwll\",\"sequence\":85,\"domain\":\"measurementsForVfScaling\",\"lastEpochMicrosec\":1507750714317473,\"eventName\":\"vFirewallBroadcastPackets\",\"sourceName\":\"zdfw1fwl01fwl01\",\"nfNamingCode\":\"vVNF\"},\"measurementsForVfScalingFields\":{\"cpuUsageArray\":[{\"percentUsage\":0,\"cpuIdentifier\":\"cpu1\",\"cpuIdle\":100,\"cpuUsageSystem\":0,\"cpuUsageUser\":0}],\"measurementInterval\":10,\"requestRate\":2256,\"measurementsForVfScalingVersion\":2.1,\"vNicPerformanceArray\":[{\"transmittedOctetsDelta\":0,\"receivedTotalPacketsDelta\":1002,\"vNicIdentifier\":\"eth0\",\"valuesAreSuspect\":\"true\",\"transmittedTotalPacketsDelta\":0,\"receivedOctetsDelta\":61200}]}}}"]


We can check that a new  TCAGEN2 output topic if CL event has been published (make sure you target the correct DMaaP IP address)

Code Block
languagebash
themeMidnight
titleCL output
linenumberstrue

curl  https://10.12.7.116:30226/events/unauthenticated.TCAGEN2_OUTPUT/vv/1 -k
["{\"closedLoopEventClient\":\"dcae-tcagen2\",\"policyVersion\":\"v0.0.1\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyScope\":\"DCAE\",\"target_type\":\"VM\",\"AAI\":{\"vserver.vserver-name\":\"zdfw1fwl01fwl01\"},\"closedLoopAlarmStart\":1507750704126521,\"closedLoopEventStatus\":\"ONSET\",\"closedLoopControlName\":\"ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a\",\"version\":\"1.0.2\",\"target\":\"vserver.vserver-name\",\"requestID\":\"e727df74-07e8-4711-b31c-7c28adf721b2:0:0\",\"from\":\"DCAE\"}"]


Code Block
languagebash
themeMidnight
titleTCA processing logs
linenumberstrue
TCA


83-9f1e-4942-8ebe-73900e8af929, Transaction Id: US2MQ, Elapsed Time: 621 ms, REST Endpoint Call: OK-GET-/events/unauthenticated.VES_MEASUREMENT_OUTPUT/cg1/c1
2020-04-14 16:37:11.468  INFO 1 --- [ask-scheduler-9] o.o.d.a.w.http.EelfAuditLogInterceptor   : Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929, Transaction Id: US2MQ, Elapsed Time: 621 ms, REST Endpoint Call: OK-GET-/events/unauthenticated.VES_MEASUREMENT_OUTPUT/cg1/c1
2020-04-14T16:37:11.470+0000|f4a06883-9f1e-4942-8ebe-73900e8af929|Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929, Transaction Id: US2MQ, Messages Present: true, Next Polling Interval will be: 30000
2020-04-14 16:37:11.470 DEBUG 1 --- [ask-scheduler-9] o.o.d.a.w.d.MrSubscriberPollingAdvice    : Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929, Transaction Id: US2MQ, Messages Present: true, Next Polling Interval will be: 30000
2020-04-14 16:37:11.471 DEBUG 1 --- [ask-scheduler-9] o.o.d.a.web.dmaap.MrMessageSplitter      : mrMessageSplitter received message: GenericMessage [payload=["{\"event\":{\"commonEventHeader\":{\"startEpochMicrosec\":1507750704126521,\"sourceId\":\"4c32fa09-83e7-43cf-8bba-c72557afe408\",\"eventId\":\"TrafficStats_1.2.3.4\",\"nfcNamingCode\":\"vVNF\",\"reportingEntityId\":\"No UUID available\",\"internalHeaderFields\":{\"collectorTimeStamp\":\"Tue, 04 14 2020 04:36:43 UTC\"},\"eventType\":\"HTTP request rate\",\"priority\":\"Normal\",\"version\":1.2,\"reportingEntityName\":\"fwll\",\"sequence\":85,\"domain\":\"measurementsForVfScaling\",\"lastEpochMicrosec\":1507750714317473,\"eventName\":\"vFirewallBroadcastPackets\",\"sourceName\":\"zdfw1fwl01fwl01\",\"nfNamingCode\":\"vVNF\"},\"measurementsForVfScalingFields\":{\"cpuUsageArray\":[{\"percentUsage\":0,\"cpuIdentifier\":\"cpu1\",\"cpuIdle\":100,\"cpuUsageSystem\":0,\"cpuUsageUser\":0}],\"measurementInterval\":10,\"requestRate\":2256,\"measurementsForVfScalingVersion\":2.1,\"vNicPerformanceArray\":[{\"transmittedOctetsDelta\":0,\"receivedTotalPacketsDelta\":1002,\"vNicIdentifier\":\"eth0\",\"valuesAreSuspect\":\"true\",\"transmittedTotalPacketsDelta\":0,\"receivedOctetsDelta\":61200}]}}}"], headers={Cache-Control=no-store, no-cache, must-revalidate, Server=Jetty(9.4.z-SNAPSHOT), X-ECOMP-RequestID=f4a06883-9f1e-4942-8ebe-73900e8af929, X-ECOMP-TransactionID=US2MQ, X-Begin-Timestamp=2020-04-14T16:37:10.845+0000, Pragma=no-cache, id=7be9866a-c058-12e5-ed8b-4c115af62663, Content-Length=1100, contentType=application/json, http_statusCode=200, Date=1586882230000, timestamp=1586882231470}]
2020-04-14T16:37:10.845+0000|2020-04-14T16:37:11.498+0000|f4a06883-9f1e-4942-8ebe-73900e8af929|UNKNOWN_INSTANCE_ID|task-scheduler-9||dcae-tcagen2|tca-gen2|COMPLETE|0|||INFO|0|10.42.1.198|653|dcae-tcagen2||org.onap.dcae.analytics.web.dmaap.MrMessageSplitter|||||||Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929, Transaction Id: US2MQ, dmaapMessages: [{"event":{"commonEventHeader":{"startEpochMicrosec":1507750704126521,"sourceId":"4c32fa09-83e7-43cf-8bba-c72557afe408","eventId":"TrafficStats_1.2.3.4","nfcNamingCode":"vVNF","reportingEntityId":"No UUID available","internalHeaderFields":{"collectorTimeStamp":"Tue, 04 14 2020 04:36:43 UTC"},"eventType":"HTTP request rate","priority":"Normal","version":1.2,"reportingEntityName":"fwll","sequence":85,"domain":"measurementsForVfScaling","lastEpochMicrosec":1507750714317473,"eventName":"vFirewallBroadcastPackets","sourceName":"zdfw1fwl01fwl01","nfNamingCode":"vVNF"},"measurementsForVfScalingFields":{"cpuUsageArray":[{"percentUsage":0,"cpuIdentifier":"cpu1","cpuIdle":100,"cpuUsageSystem":0,"cpuUsageUser":0}],"measurementInterval":10,"requestRate":2256,"measurementsForVfScalingVersion":2.1,"vNicPerformanceArray":[{"transmittedOctetsDelta":0,"receivedTotalPacketsDelta":1002,"vNicIdentifier":"eth0","valuesAreSuspect":"true","transmittedTotalPacketsDelta":0,"receivedOctetsDelta":61200}]}}}], Received new messages from DMaaP MR. Count: 1
2020-04-14 16:37:11.500  INFO 1 --- [ask-scheduler-9] o.o.d.a.web.dmaap.MrMessageSplitter      : Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929, Transaction Id: US2MQ, dmaapMessages: [{"event":{"commonEventHeader":{"startEpochMicrosec":1507750704126521,"sourceId":"4c32fa09-83e7-43cf-8bba-c72557afe408","eventId":"TrafficStats_1.2.3.4","nfcNamingCode":"vVNF","reportingEntityId":"No UUID available","internalHeaderFields":{"collectorTimeStamp":"Tue, 04 14 2020 04:36:43 UTC"},"eventType":"HTTP request rate","priority":"Normal","version":1.2,"reportingEntityName":"fwll","sequence":85,"domain":"measurementsForVfScaling","lastEpochMicrosec":1507750714317473,"eventName":"vFirewallBroadcastPackets","sourceName":"zdfw1fwl01fwl01","nfNamingCode":"vVNF"},"measurementsForVfScalingFields":{"cpuUsageArray":[{"percentUsage":0,"cpuIdentifier":"cpu1","cpuIdle":100,"cpuUsageSystem":0,"cpuUsageUser":0}],"measurementInterval":10,"requestRate":2256,"measurementsForVfScalingVersion":2.1,"vNicPerformanceArray":[{"transmittedOctetsDelta":0,"receivedTotalPacketsDelta":1002,"vNicIdentifier":"eth0","valuesAreSuspect":"true","transmittedTotalPacketsDelta":0,"receivedOctetsDelta":61200}]}}}], Received new messages from DMaaP MR. Count: 1
2020-04-14T16:37:10.845+0000|2020-04-14T16:37:11.498+0000|f4a06883-9f1e-4942-8ebe-73900e8af929|UNKNOWN_INSTANCE_ID|task-scheduler-9||dcae-tcagen2|tca-gen2|COMPLETE|0|||INFO|0|10.42.1.198|653|dcae-tcagen2||org.onap.dcae.analytics.web.dmaap.MrMessageSplitter|||||||Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929, Transaction Id: US2MQ,  Max allowed messages per batch: 10000. No of batches created: 1
2020-04-14 16:37:11.501  INFO 1 --- [ask-scheduler-9] o.o.d.a.web.dmaap.MrMessageSplitter      : Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929, Transaction Id: US2MQ,  Max allowed messages per batch: 10000. No of batches created: 1
2020-04-14T16:37:11.719+0000|f4a06883-9f1e-4942-8ebe-73900e8af929:0:0|Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929:0:0. Alert ClosedLoop Status is ONSET. Saving abatement Entity to repository with lookupKey: vFirewallBroadcastPackets:zdfw1fwl01fwl01:fwll:ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a:$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta
2020-04-14 16:37:11.719 DEBUG 1 --- [ask-scheduler-5] o.o.d.a.t.c.u.f.c.TcaAbatementCalculator : Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929:0:0. Alert ClosedLoop Status is ONSET. Saving abatement Entity to repository with lookupKey: vFirewallBroadcastPackets:zdfw1fwl01fwl01:fwll:ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a:$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta
2020-04-14 16:37:11.771 DEBUG 1 --- [ask-scheduler-5] .d.a.w.h.HttpClientPreferencesCustomizer : Customizing Rest Template for Http Client Id: aai-rest-client
2020-04-14 16:37:11.771  INFO 1 --- [ask-scheduler-5] .d.a.w.h.HttpClientPreferencesCustomizer : Setting basic Authentication credentials for Http Client Id: aai-rest-client with username: DCAE
2020-04-14 16:37:11.773 DEBUG 1 --- [ask-scheduler-5] .d.a.w.h.HttpClientPreferencesCustomizer : Proxy not Enabled - bypassing setting Proxy settings for Http Client Id: aai-rest-client
2020-04-14 16:37:11.773  INFO 1 --- [ask-scheduler-5] .d.a.w.h.HttpClientPreferencesCustomizer : Ignore SSL Certificate Errors attributed is set to: false for Http Client Id: aai-rest-client
2020-04-14 16:37:11.773  INFO 1 --- [ask-scheduler-5] .d.a.w.h.HttpClientPreferencesCustomizer : SSL Validation will be enforced for Http Client Id: aai-rest-client
2020-04-14T16:37:11.781+0000|2020-04-14T16:37:11.785+0000|f4a06883-9f1e-4942-8ebe-73900e8af929:0:0|UNKNOWN_INSTANCE_ID|task-scheduler-5||dcae-tcagen2|DCAE|AAI_ENRICHMENT|GET-/aai/v11/search/nodes-query|ERROR|200|Timeout Error||ERROR|2|10.42.1.198|4|dcae-tcagen2||org.onap.dcae.analytics.web.http.EelfAuditLogInterceptor|||aai.onap.svc.cluster.local|||||Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929:0:0, Transaction Id: US2MQ, Elapsed Time: 4 ms, Error Message: java.net.UnknownHostException: aai.onap.svc.cluster.local: Name does not resolve
2020-04-14 16:37:11.785 ERROR 1 --- [ask-scheduler-5] o.o.d.a.w.http.EelfAuditLogInterceptor   : Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929:0:0, Transaction Id: US2MQ, Elapsed Time: 4 ms, Error Message: java.net.UnknownHostException: aai.onap.svc.cluster.local: Name does not resolve
2020-04-14T16:37:11.789+0000|f4a06883-9f1e-4942-8ebe-73900e8af929:0:0|task-scheduler-5|dcae-tcagen2|tca-gen2|DCAE-TCA|dcae-tcagen2|ERROR|400|Schema Error|Request id: f4a06883-9f1e-4942-8ebe-73900e8af929:0:0. Unable to get A&AI enrichment details
2020-04-14 16:37:11.789 ERROR 1 --- [ask-scheduler-5] .o.d.a.t.w.a.TcaAaiEnrichmentServiceImpl : Request id: f4a06883-9f1e-4942-8ebe-73900e8af929:0:0. Unable to get A&AI enrichment details
2020-04-14T16:37:10.845+0000|2020-04-14T16:37:11.790+0000|f4a06883-9f1e-4942-8ebe-73900e8af929:0|UNKNOWN_INSTANCE_ID|task-scheduler-5||dcae-tcagen2|tca-gen2|COMPLETE|0|||INFO|0|10.42.1.198|945|dcae-tcagen2||org.onap.dcae.analytics.tca.web.integration.TcaAlertTransformer|||||||Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929:0, Transaction Id: US2MQ, Message counts - Received: 1, Errors: 0, Terminated Early: 0, Abated: [TcaAlert(aai=Aai(genericVNFName=null, genericServerName=zdfw1fwl01fwl01), closedLoopAlarmEnd=null, closedLoopAlarmStart=1507750704126521, closedLoopControlName=ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a, closedLoopEventClient=dcae-tcagen2, closedLoopEventStatus=ONSET, from=DCAE, policyName=DCAE.Config_tca-hi-lo, policyScope=DCAE, policyVersion=v0.0.1, requestId=f4a06883-9f1e-4942-8ebe-73900e8af929:0:0, target=vserver.vserver-name, targetType=VM, version=1.0.2)], Alerts: 0, Alerts size: 1
2020-04-14 16:37:11.790  INFO 1 --- [ask-scheduler-5] o.o.d.a.t.w.i.TcaAlertTransformer        : Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929:0, Transaction Id: US2MQ, Message counts - Received: 1, Errors: 0, Terminated Early: 0, Abated: [TcaAlert(aai=Aai(genericVNFName=null, genericServerName=zdfw1fwl01fwl01), closedLoopAlarmEnd=null, closedLoopAlarmStart=1507750704126521, closedLoopControlName=ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a, closedLoopEventClient=dcae-tcagen2, closedLoopEventStatus=ONSET, from=DCAE, policyName=DCAE.Config_tca-hi-lo, policyScope=DCAE, policyVersion=v0.0.1, requestId=f4a06883-9f1e-4942-8ebe-73900e8af929:0:0, target=vserver.vserver-name, targetType=VM, version=1.0.2)], Alerts: 0, Alerts size: 1
2020-04-14T16:37:11.796+0000|2020-04-14T16:37:12.165+0000|f4a06883-9f1e-4942-8ebe-73900e8af929:0|UNKNOWN_INSTANCE_ID|task-scheduler-5||dcae-tcagen2||DMAAP_MR_PUBLISHER|POST-/events/unauthenticated.TCAGEN2_OUTPUT/|COMPLETE|0|OK||INFO|0|10.42.1.198|369|dcae-tcagen2||org.onap.dcae.analytics.web.http.EelfAuditLogInterceptor|||message-router:3904|||||Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929:0, Transaction Id: US2MQ, Elapsed Time: 369 ms, REST Endpoint Call: OK-POST-/events/unauthenticated.TCAGEN2_OUTPUT/
2020-04-14 16:37:12.165  INFO 1 --- [ask-scheduler-5] o.o.d.a.w.http.EelfAuditLogInterceptor   : Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929:0, Transaction Id: US2MQ, Elapsed Time: 369 ms, REST Endpoint Call: OK-POST-/events/unauthenticated.TCAGEN2_OUTPUT/
2020-04-14T16:37:10.845+0000|2020-04-14T16:37:12.168+0000|f4a06883-9f1e-4942-8ebe-73900e8af929:0|UNKNOWN_INSTANCE_ID|task-scheduler-5||dcae-tcagen2|tca-gen2|COMPLETE|0|||INFO|0|10.42.1.198|1323|dcae-tcagen2||org.onap.dcae.analytics.tca.web.integration.TcaPublisherResponseHandler|||||||Request Id: f4a06883-9f1e-4942-8ebe-73900e8af929:0, Transaction Id: US2MQ, Transaction completion Time: 1323 ms, DMaaP MR Publisher Response: {
    "serverTimeMs": 362,
    "count": 1
}


Generate TCAGEN2 CL Abatement Event


Send a triggering event to VESCollector. VESCollector publishes the event into unauthenticated.VES_MEASUREMENT_OUTPUT

Before sending, validate following

  • "eventName" field in VES input matches eventName configuration set in tca-gen2 Service
  • "lastEpochMicrosec" in reflecting current time stamp approximately
  •  Ensure the event is on the same "sourceName" as original event sent


Code Block
languagebash
themeMidnight
titleResend heartbeat with new timestamp
linenumberstrue
curl -i -u 'sample1:sample1' -X POST -d @f5-cl-abate.txt  --header "Content-Type: application/json" https://10.12.7.116:30417/eventListener/v5 -k
HTTP/1.1 202
Content-Type: application/json
Content-Length: 8
Date: Tue, 14 Apr 2020 16:57:30 GMT

Where f5-cl-abate.txt containes below event

{"event":{"commonEventHeader":{"startEpochMicrosec":1507750704126521,"sourceId":"4c32fa09-83e7-43cf-8bba-c72557afe408","eventId":"TrafficStats_1.2.3.4","nfcNamingCode":"vVNF","reportingEntityId":"No UUID available","eventType":"HTTP request rate","priority":"Normal","version":1.2,"reportingEntityName":"fwll","sequence":85,"domain":"measurementsForVfScaling","lastEpochMicrosec":1507750714317473,"eventName":"vFirewallBroadcastPackets","sourceName":"zdfw1fwl01fwl01","nfNamingCode":"vVNF"},"measurementsForVfScalingFields":{"cpuUsageArray":[{"percentUsage":0,"cpuIdentifier":"cpu1","cpuIdle":100,"cpuUsageSystem":0,"cpuUsageUser":0}],"measurementInterval":10,"requestRate":2256,"vNicPerformanceArray":[{"transmittedOctetsDelta":0,"receivedTotalPacketsDelta":100,"vNicIdentifier":"eth0","valuesAreSuspect":"true","transmittedTotalPacketsDelta":0,"receivedOctetsDelta":61200}],"measurementsForVfScalingVersion":2.1}}}


Code Block
languagebash
themeMidnight
titleLogs showing CL abatement event generation
linenumberstrue
2020-04-14 16:58:11.459  INFO 1 --- [ask-scheduler-8] o.o.d.a.web.dmaap.MrMessageSplitter      : Request Id: a75f69ca-8d30-4f38-b72b-0a1def672ce6, Transaction Id: INWFH, dmaapMessages: [{"event":{"commonEventHeader":{"startEpochMicrosec":1507750704126521,"sourceId":"4c32fa09-83e7-43cf-8bba-c72557afe408","eventId":"TrafficStats_1.2.3.4","nfcNamingCode":"vVNF","reportingEntityId":"No UUID available","internalHeaderFields":{"collectorTimeStamp":"Tue, 04 14 2020 04:57:31 UTC"},"eventType":"HTTP request rate","priority":"Normal","version":1.2,"reportingEntityName":"fwll","sequence":85,"domain":"measurementsForVfScaling","lastEpochMicrosec":1507750714317473,"eventName":"vFirewallBroadcastPackets","sourceName":"zdfw1fwl01fwl01","nfNamingCode":"vVNF"},"measurementsForVfScalingFields":{"cpuUsageArray":[{"percentUsage":0,"cpuIdentifier":"cpu1","cpuIdle":100,"cpuUsageSystem":0,"cpuUsageUser":0}],"measurementInterval":10,"requestRate":2256,"measurementsForVfScalingVersion":2.1,"vNicPerformanceArray":[{"transmittedOctetsDelta":0,"receivedTotalPacketsDelta":100,"vNicIdentifier":"eth0","valuesAreSuspect":"true","transmittedTotalPacketsDelta":0,"receivedOctetsDelta":61200}]}}}], Received new messages from DMaaP MR. Count: 1
2020-04-14T16:58:10.845+0000|2020-04-14T16:58:11.459+0000|a75f69ca-8d30-4f38-b72b-0a1def672ce6|UNKNOWN_INSTANCE_ID|task-scheduler-8||dcae-tcagen2|tca-gen2|COMPLETE|0|||INFO|0|10.42.1.198|614|dcae-tcagen2||org.onap.dcae.analytics.web.dmaap.MrMessageSplitter|||||||Request Id: a75f69ca-8d30-4f38-b72b-0a1def672ce6, Transaction Id: INWFH,  Max allowed messages per batch: 10000. No of batches created: 1
2020-04-14 16:58:11.459  INFO 1 --- [ask-scheduler-8] o.o.d.a.web.dmaap.MrMessageSplitter      : Request Id: a75f69ca-8d30-4f38-b72b-0a1def672ce6, Transaction Id: INWFH,  Max allowed messages per batch: 10000. No of batches created: 1
2020-04-14T16:58:11.498+0000|a75f69ca-8d30-4f38-b72b-0a1def672ce6:0:0|Request Id: a75f69ca-8d30-4f38-b72b-0a1def672ce6:0:0. Found previous Abatement Entity with lookupKey: vFirewallBroadcastPackets:zdfw1fwl01fwl01:fwll:ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a:$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta
2020-04-14 16:58:11.498 DEBUG 1 --- [ask-scheduler-3] o.o.d.a.t.c.u.f.c.TcaAbatementCalculator : Request Id: a75f69ca-8d30-4f38-b72b-0a1def672ce6:0:0. Found previous Abatement Entity with lookupKey: vFirewallBroadcastPackets:zdfw1fwl01fwl01:fwll:ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a:$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta
2020-04-14T16:58:11.498+0000|a75f69ca-8d30-4f38-b72b-0a1def672ce6:0:0|Request Id: a75f69ca-8d30-4f38-b72b-0a1def672ce6:0:0. No previous abated alert was sent. Setting previous request id: e727df74-07e8-4711-b31c-7c28adf721b2:0:0
2020-04-14 16:58:11.498 DEBUG 1 --- [ask-scheduler-3] o.o.d.a.t.c.u.f.c.TcaAbatementCalculator : Request Id: a75f69ca-8d30-4f38-b72b-0a1def672ce6:0:0. No previous abated alert was sent. Setting previous request id: e727df74-07e8-4711-b31c-7c28adf721b2:0:0
2020-04-14T16:58:11.498+0000|a75f69ca-8d30-4f38-b72b-0a1def672ce6:0:0|Request Id: a75f69ca-8d30-4f38-b72b-0a1def672ce6:0:0. Saving new entity with alert as sent with lookupKey: vFirewallBroadcastPackets:zdfw1fwl01fwl01:fwll:ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a:$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta
2020-04-14 16:58:11.498 DEBUG 1 --- [ask-scheduler-3] o.o.d.a.t.c.u.f.c.TcaAbatementCalculator : Request Id: a75f69ca-8d30-4f38-b72b-0a1def672ce6:0:0. Saving new entity with alert as sent with lookupKey: vFirewallBroadcastPackets:zdfw1fwl01fwl01:fwll:ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a:$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta
2020-04-14T16:58:10.845+0000|2020-04-14T16:58:11.502+0000|a75f69ca-8d30-4f38-b72b-0a1def672ce6:0|UNKNOWN_INSTANCE_ID|task-scheduler-3||dcae-tcagen2|tca-gen2|COMPLETE|0|||INFO|0|10.42.1.198|657|dcae-tcagen2||org.onap.dcae.analytics.tca.web.integration.TcaAlertTransformer|||||||Request Id: a75f69ca-8d30-4f38-b72b-0a1def672ce6:0, Transaction Id: INWFH, Message counts - Received: 1, Errors: 0, Terminated Early: 0, Abated: [TcaAlert(aai=Aai(genericVNFName=null, genericServerName=zdfw1fwl01fwl01), closedLoopAlarmEnd=1507750714317473, closedLoopAlarmStart=1507750704126521, closedLoopControlName=ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a, closedLoopEventClient=dcae-tcagen2, closedLoopEventStatus=ABATED, from=DCAE, policyName=DCAE.Config_tca-hi-lo, policyScope=DCAE, policyVersion=v0.0.1, requestId=e727df74-07e8-4711-b31c-7c28adf721b2:0:0, target=vserver.vserver-name, targetType=VM, version=1.0.2)], Alerts: 1, Alerts size: 1
2020-04-14 16:58:11.502  INFO 1 --- [ask-scheduler-3] o.o.d.a.t.w.i.TcaAlertTransformer        : Request Id: a75f69ca-8d30-4f38-b72b-0a1def672ce6:0, Transaction Id: INWFH, Message counts - Received: 1, Errors: 0, Terminated Early: 0, Abated: [TcaAlert(aai=Aai(genericVNFName=null, genericServerName=zdfw1fwl01fwl01), closedLoopAlarmEnd=1507750714317473, closedLoopAlarmStart=1507750704126521, closedLoopControlName=ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a, closedLoopEventClient=dcae-tcagen2, closedLoopEventStatus=ABATED, from=DCAE, policyName=DCAE.Config_tca-hi-lo, policyScope=DCAE, policyVersion=v0.0.1, requestId=e727df74-07e8-4711-b31c-7c28adf721b2:0:0, target=vserver.vserver-name, targetType=VM, version=1.0.2)], Alerts: 1, Alerts size: 1
2020-04-14T16:58:11.502+0000|2020-04-14T16:58:11.507+0000|a75f69ca-8d30-4f38-b72b-0a1def672ce6:0|UNKNOWN_INSTANCE_ID|task-scheduler-3||dcae-tcagen2||DMAAP_MR_PUBLISHER|POST-/events/unauthenticated.TCAGEN2_OUTPUT/|COMPLETE|0|OK||INFO|0|10.42.1.198|5|dcae-tcagen2||org.onap.dcae.analytics.web.http.EelfAuditLogInterceptor|||message-router:3904|||||Request Id: a75f69ca-8d30-4f38-b72b-0a1def672ce6:0, Transaction Id: INWFH, Elapsed Time: 5 ms, REST Endpoint Call: OK-POST-/events/unauthenticated.TCAGEN2_OUTPUT/
2020-04-14 16:58:11.507  INFO 1 --- [ask-scheduler-3] o.o.d.a.w.http.EelfAuditLogInterceptor   : Request Id: a75f69ca-8d30-4f38-b72b-0a1def672ce6:0, Transaction Id: INWFH, Elapsed Time: 5 ms, REST Endpoint Call: OK-POST-/events/unauthenticated.TCAGEN2_OUTPUT/
2020-04-14T16:58:10.845+0000|2020-04-14T16:58:11.508+0000|a75f69ca-8d30-4f38-b72b-0a1def672ce6:0|UNKNOWN_INSTANCE_ID|task-scheduler-3||dcae-tcagen2|tca-gen2|COMPLETE|0|||INFO|0|10.42.1.198|663|dcae-tcagen2||org.onap.dcae.analytics.tca.web.integration.TcaPublisherResponseHandler|||||||Request Id: a75f69ca-8d30-4f38-b72b-0a1def672ce6:0, Transaction Id: INWFH, Transaction completion Time: 663 ms, DMaaP MR Publisher Response: {
    "serverTimeMs": 0,
    "count": 1
}


We can check that a new DCAE_CL_OUTPUT event has been published (make sure you target the correct DMaaP IP address)


Code Block
languagebash
themeMidnight
titleCL Abatement Published event
linenumberstrue
curl  https://10.12.7.116:30226/events/unauthenticated.TCAGEN2_OUTPUT/vv/1 -k
["{\"closedLoopEventClient\":\"dcae-tcagen2\",\"policyVersion\":\"v0.0.1\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyScope\":\"DCAE\",\"target_type\":\"VM\",\"AAI\":{\"vserver.vserver-name\":\"zdfw1fwl01fwl01\"},\"closedLoopAlarmStart\":1507750704126521,\"closedLoopEventStatus\":\"ABATED\",\"closedLoopControlName\":\"ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a\",\"version\":\"1.0.2\",\"target\":\"vserver.vserver-name\",\"closedLoopAlarmEnd\":1507750714317473,\"requestID\":\"e727df74-07e8-4711-b31c-7c28adf721b2:0:0\",\"from\":\"DCAE\"}"]


Dynamic Configuration Update

As the tcagen2 service periodically polls Consul KV using configbindingService api's - the run time configuration of tca-gen2 service can be updated dynamically without having to redeploy/restart the service. The updates to configuration can be made directly in Consul.


Locate the servicename by executing into tcagen2 Service pod and getting env HOSTNAME value

Code Block
themeMidnight
titleServiceName
root@onap2-nfs:~# kubectl get pods -n onap | grep tcagen2
dep-dcae-tcagen2-6647bc55b9-z25tr                  2/2     Running     0          19m

root@onap2-nfs:~# kubectl exec -it -n onap dep-dcae-tcagen2-6647bc55b9-z25tr /bin/sh
Defaulting container name to dcae-tcagen2.
Use 'kubectl describe pod/dep-dcae-tcagen2-6647bc55b9-z25tr -n onap' to see all of the containers in this pod.
/opt $ env | grep -i hostname
HOSTNAME=dcae-tcagen2


Change the configuration for Service in KV-store through UI


Code Block
languagebash
themeMidnight
titleConsul URL
http://<k8snodeip>:30270/ui/#/dc1/kv/

Example: http://10.12.7.116:30270/ui/#/dc1/kv/dcae-tcagen2/ is modified for vFw rule to trigger an ABATED event when thresholdValue is less or equal to 300


{"spring.data.mongodb.uri": "mongodb://dcae-mongohost/dcae-tcagen2", "streams_subscribes": {"tca_handle_in": {"type": "message_router", "dmaap_info": {"topic_url": "http://message-router:3904/events/unauthenticated.VES_MEASUREMENT_OUTPUT/"}}}, "tca.enable_ecomp_logging": true, "tca.enable_abatement": true, "tca.aai.password": "DCAE", "streams_subscribes.tca_handle_in.consumer_group": "cg1", "streams_subscribes.tca_handle_in.polling.auto_adjusting.step_up": 10000, "tca.aai.node_query_path": "aai/v11/search/nodes-query", "streams_publishes": {"tca_handle_out": {"type": "message_router", "dmaap_info": {"topic_url": "http://message-router:3904/events/unauthenticated.TCAGEN2_OUTPUT/"}}}, "streams_subscribes.tca_handle_in.consumer_ids[1]": "c1", "tca.aai.generic_vnf_path": "aai/v11/network/generic-vnfs/generic-vnf", "streams_subscribes.tca_handle_in.polling.auto_adjusting.step_down": 30000, "streams_subscribes.tca_handle_in.polling.auto_adjusting.max": 60000, "tca.aai.username": "DCAE", "streams_subscribes.tca_handle_in.polling.auto_adjusting.min": 30000, "tca.aai.url": "http://aai.onap.svc.cluster.local", "streams_subscribes.tca_handle_in.timeout": -1, "tca.aai.enable_enrichment": true, "tca.policy": "{\"domain\":\"measurementsForVfScaling\",\"metricsPerEventName\":[{\"eventName\":\"vFirewallBroadcastPackets\",\"controlLoopSchemaType\":\"VM\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":300,\"direction\":\"LESS_OR_EQUAL\",\"severity\":\"MAJOR\",\"closedLoopEventStatus\":\"ABATED\"},{\"closedLoopControlName\":\"ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":700,\"direction\":\"GREATER_OR_EQUAL\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]},{\"eventName\":\"vLoadBalancer\",\"controlLoopSchemaType\":\"VM\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vDNS-6f37f56d-a87d-4b85-b6a9-cc953cf779b3\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":300,\"direction\":\"GREATER_OR_EQUAL\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]},{\"eventName\":\"Measurement_vGMUX\",\"controlLoopSchemaType\":\"VNF\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vCPE-48f0c2c3-a172-4192-9ae3-052274181b6e\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.additionalMeasurements[*].arrayOfFields[0].value\",\"thresholdValue\":0,\"direction\":\"EQUAL\",\"severity\":\"MAJOR\",\"closedLoopEventStatus\":\"ABATED\"},{\"closedLoopControlName\":\"ControlLoop-vCPE-48f0c2c3-a172-4192-9ae3-052274181b6e\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.additionalMeasurements[*].arrayOfFields[0].value\",\"thresholdValue\":0,\"direction\":\"GREATER\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]}]}", "tca.processing_batch_size": 10000, "streams_subscribes.tca_handle_in.polling.fixed_rate": 0, "streams_subscribes.tca_handle_in.message_limit": 50000, "service_calls": [], "streams_subscribes.tca_handle_in.consumer_ids[0]": "c0"}


Configuration Refresh from TCA-Gen2

Code Block
themeMidnight
titletca config refresh log
2020-04-14 16:50:32.653 DEBUG 1 --- [ctor-http-nio-4] r.n.http.client.HttpClientOperations     : [id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443] Received last HTTP packet
2020-04-14 16:50:32.653  INFO 1 --- [ctor-http-nio-4] o.o.d.s.s.r.s.c.c.impl.CbsClientImpl     : Got successful response from Config Binding Service
2020-04-14 16:50:32.653 DEBUG 1 --- [ctor-http-nio-4] o.o.d.s.s.r.s.c.c.impl.CbsClientImpl     : CBS response: {"config":{"spring.data.mongodb.uri":"mongodb://dcae-mongohost/dcae-tcagen2","streams_subscribes":{"tca_handle_in":{"type":"message_router","dmaap_info":{"topic_url":"http://message-router:3904/events/unauthenticated.VES_MEASUREMENT_OUTPUT/"}}},"tca.enable_ecomp_logging":true,"tca.enable_abatement":true,"tca.aai.password":"DCAE","streams_subscribes.tca_handle_in.consumer_group":"cg1","streams_subscribes.tca_handle_in.polling.auto_adjusting.step_up":10000,"tca.aai.node_query_path":"aai/v11/search/nodes-query","streams_publishes":{"tca_handle_out":{"type":"message_router","dmaap_info":{"topic_url":"http://message-router:3904/events/unauthenticated.TCAGEN2_OUTPUT/"}}},"streams_subscribes.tca_handle_in.consumer_ids[1]":"c1","tca.aai.generic_vnf_path":"aai/v11/network/generic-vnfs/generic-vnf","streams_subscribes.tca_handle_in.polling.auto_adjusting.step_down":30000,"streams_subscribes.tca_handle_in.polling.auto_adjusting.max":60000,"tca.aai.username":"DCAE","streams_subscribes.tca_handle_in.polling.auto_adjusting.min":30000,"tca.aai.url":"http://aai.onap.svc.cluster.local","streams_subscribes.tca_handle_in.timeout":-1,"tca.aai.enable_enrichment":true,"tca.policy":"{\"domain\":\"measurementsForVfScaling\",\"metricsPerEventName\":[{\"eventName\":\"vFirewallBroadcastPackets\",\"controlLoopSchemaType\":\"VM\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":300,\"direction\":\"LESS_OR_EQUAL\",\"severity\":\"MAJOR\",\"closedLoopEventStatus\":\"ABATED\"},{\"closedLoopControlName\":\"ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":700,\"direction\":\"GREATER_OR_EQUAL\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]},{\"eventName\":\"vLoadBalancer\",\"controlLoopSchemaType\":\"VM\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vDNS-6f37f56d-a87d-4b85-b6a9-cc953cf779b3\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":300,\"direction\":\"GREATER_OR_EQUAL\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]},{\"eventName\":\"Measurement_vGMUX\",\"controlLoopSchemaType\":\"VNF\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vCPE-48f0c2c3-a172-4192-9ae3-052274181b6e\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.additionalMeasurements[*].arrayOfFields[0].value\",\"thresholdValue\":0,\"direction\":\"EQUAL\",\"severity\":\"MAJOR\",\"closedLoopEventStatus\":\"ABATED\"},{\"closedLoopControlName\":\"ControlLoop-vCPE-48f0c2c3-a172-4192-9ae3-052274181b6e\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.additionalMeasurements[*].arrayOfFields[0].value\",\"thresholdValue\":0,\"direction\":\"GREATER\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]}]}","tca.processing_batch_size":10000,"streams_subscribes.tca_handle_in.polling.fixed_rate":0,"streams_subscribes.tca_handle_in.message_limit":50000,"service_calls":[],"streams_subscribes.tca_handle_in.consumer_ids[0]":"c0"}}
2020-04-14 16:50:32.654 DEBUG 1 --- [ctor-http-nio-4] r.n.resources.PooledConnectionProvider   : [id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443] onStateChange(GET{uri=/service_component_all/dcae-tcagen2, connection=PooledConnection{channel=[id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443]}}, [disconnecting])
2020-04-14 16:50:32.654 DEBUG 1 --- [ctor-http-nio-4] r.n.resources.PooledConnectionProvider   : [id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443] Releasing channel
2020-04-14 16:50:32.654 DEBUG 1 --- [ctor-http-nio-4] r.n.resources.PooledConnectionProvider   : [id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443] Channel cleaned, now 0 active connections and 1 inactive connections
2020-04-14T16:51:10.845+0000|a73be204-5ba7-4bbb-964c-b6f7260841c9|Request Id: a73be204-5ba7-4bbb-964c-b6f7260841c9. Transaction Id: ZMTUT. Begin TS: 2020-04-14T16:51:10.845+0000. Starting new DMaaP MR Subscriber poll.
2020-04-14 16:51:10.845 DEBUG 1 --- [ask-scheduler-1] o.o.d.a.w.d.MrTriggerMessageProvider     : Request Id: a73be204-5ba7-4bbb-964c-b6f7260841c9. Transaction Id: ZMTUT. Begin TS: 2020-04-14T16:51:10.845+0000. Starting new DMaaP MR Subscriber poll.
2020-04-14T16:51:10.846+0000|2020-04-14T16:51:20.380+0000|a73be204-5ba7-4bbb-964c-b6f7260841c9|UNKNOWN_INSTANCE_ID|task-scheduler-1||dcae-tcagen2||DMAAP_MR_SUBSCRIBER|GET-/events/unauthenticated.VES_MEASUREMENT_OUTPUT/cg1/c1|COMPLETE|0|OK||INFO|0|10.42.1.198|9534|dcae-tcagen2||org.onap.dcae.analytics.web.http.EelfAuditLogInterceptor|||message-router:3904|||||Request Id: a73be204-5ba7-4bbb-964c-b6f7260841c9, Transaction Id: ZMTUT, Elapsed Time: 9534 ms, REST Endpoint Call: OK-GET-/events/unauthenticated.VES_MEASUREMENT_OUTPUT/cg1/c1
2020-04-14 16:51:20.380  INFO 1 --- [ask-scheduler-1] o.o.d.a.w.http.EelfAuditLogInterceptor   : Request Id: a73be204-5ba7-4bbb-964c-b6f7260841c9, Transaction Id: ZMTUT, Elapsed Time: 9534 ms, REST Endpoint Call: OK-GET-/events/unauthenticated.VES_MEASUREMENT_OUTPUT/cg1/c1
2020-04-14T16:51:20.381+0000|a73be204-5ba7-4bbb-964c-b6f7260841c9|Request Id: a73be204-5ba7-4bbb-964c-b6f7260841c9, Transaction Id: ZMTUT, Messages Present: false, Next Polling Interval will be: 60000
2020-04-14 16:51:20.381 DEBUG 1 --- [ask-scheduler-1] o.o.d.a.w.d.MrSubscriberPollingAdvice    : Request Id: a73be204-5ba7-4bbb-964c-b6f7260841c9, Transaction Id: ZMTUT, Messages Present: false, Next Polling Interval will be: 60000
2020-04-14T16:51:20.382+0000|a73be204-5ba7-4bbb-964c-b6f7260841c9|Request Id: a73be204-5ba7-4bbb-964c-b6f7260841c9, Transaction Id: ZMTUT, No new messages found in DMaaP MR Response. No further processing required
2020-04-14 16:51:20.382 DEBUG 1 --- [ask-scheduler-1] o.o.d.a.w.d.MrSubscriberPollingAdvice    : Request Id: a73be204-5ba7-4bbb-964c-b6f7260841c9, Transaction Id: ZMTUT, No new messages found in DMaaP MR Response. No further processing required
2020-04-14 16:51:32.632 DEBUG 1 --- [     parallel-1] o.o.d.s.s.r.s.c.c.impl.CbsClientImpl     : Calling https://config-binding-service:10443/service_component_all/dcae-tcagen2 for configuration
2020-04-14 16:51:32.633 DEBUG 1 --- [ctor-http-nio-4] r.n.resources.PooledConnectionProvider   : [id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443] Channel acquired, now 1 active connections and 0 inactive connections
2020-04-14 16:51:32.633 DEBUG 1 --- [ctor-http-nio-4] o.o.d.s.s.r.s.a.http.RxHttpClient        : Request: GET / DefaultHttpHeaders[]
2020-04-14 16:51:32.633 DEBUG 1 --- [ctor-http-nio-4] r.netty.http.client.HttpClientConnect    : [id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443] Handler is being applied: {uri=https://config-binding-service:10443/service_component_all/dcae-tcagen2, method=GET}
2020-04-14 16:51:32.634 DEBUG 1 --- [ctor-http-nio-4] r.n.resources.PooledConnectionProvider   : [id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443] onStateChange(GET{uri=/service_component_all/dcae-tcagen2, connection=PooledConnection{channel=[id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443]}}, [request_sent])
2020-04-14 16:51:32.650 DEBUG 1 --- [ctor-http-nio-4] r.n.http.client.HttpClientOperations     : [id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443] Received response (auto-read:false) : [x-onap-requestid=ddd22db8-76c6-4a4f-8d01-ee4729cef690, Content-Type=application/json, Content-Length=3733, Date=Tue, 14 Apr 2020 16:51:32 GMT]
2020-04-14 16:51:32.650 DEBUG 1 --- [ctor-http-nio-4] r.n.resources.PooledConnectionProvider   : [id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443] onStateChange(GET{uri=/service_component_all/dcae-tcagen2, connection=PooledConnection{channel=[id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443]}}, [response_received])
2020-04-14 16:51:32.650 DEBUG 1 --- [ctor-http-nio-4] reactor.netty.channel.FluxReceive        : [id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443] Subscribing inbound receiver [pending: 0, cancelled:false, inboundDone: false]
2020-04-14 16:51:32.651 DEBUG 1 --- [ctor-http-nio-4] o.o.d.s.s.r.s.a.http.RxHttpClient        : Response status: 200 OK
2020-04-14 16:51:32.651 DEBUG 1 --- [ctor-http-nio-4] r.n.http.client.HttpClientOperations     : [id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443] Received last HTTP packet
2020-04-14 16:51:32.651  INFO 1 --- [ctor-http-nio-4] o.o.d.s.s.r.s.c.c.impl.CbsClientImpl     : Got successful response from Config Binding Service
2020-04-14 16:51:32.651 DEBUG 1 --- [ctor-http-nio-4] o.o.d.s.s.r.s.c.c.impl.CbsClientImpl     : CBS response: {"config":{"spring.data.mongodb.uri":"mongodb://dcae-mongohost/dcae-tcagen2","streams_subscribes":{"tca_handle_in":{"type":"message_router","dmaap_info":{"topic_url":"http://message-router:3904/events/unauthenticated.VES_MEASUREMENT_OUTPUT/"}}},"tca.enable_ecomp_logging":true,"tca.enable_abatement":true,"tca.aai.password":"DCAE","streams_subscribes.tca_handle_in.consumer_group":"cg1","streams_subscribes.tca_handle_in.polling.auto_adjusting.step_up":10000,"tca.aai.node_query_path":"aai/v11/search/nodes-query","streams_publishes":{"tca_handle_out":{"type":"message_router","dmaap_info":{"topic_url":"http://message-router:3904/events/unauthenticated.TCAGEN2_OUTPUT/"}}},"streams_subscribes.tca_handle_in.consumer_ids[1]":"c1","tca.aai.generic_vnf_path":"aai/v11/network/generic-vnfs/generic-vnf","streams_subscribes.tca_handle_in.polling.auto_adjusting.step_down":30000,"streams_subscribes.tca_handle_in.polling.auto_adjusting.max":60000,"tca.aai.username":"DCAE","streams_subscribes.tca_handle_in.polling.auto_adjusting.min":30000,"tca.aai.url":"http://aai.onap.svc.cluster.local","streams_subscribes.tca_handle_in.timeout":-1,"tca.aai.enable_enrichment":true,"tca.policy":"{\"domain\":\"measurementsForVfScaling\",\"metricsPerEventName\":[{\"eventName\":\"vFirewallBroadcastPackets\",\"controlLoopSchemaType\":\"VM\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":300,\"direction\":\"LESS_OR_EQUAL\",\"severity\":\"MAJOR\",\"closedLoopEventStatus\":\"ABATED\"},{\"closedLoopControlName\":\"ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":700,\"direction\":\"GREATER_OR_EQUAL\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]},{\"eventName\":\"vLoadBalancer\",\"controlLoopSchemaType\":\"VM\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vDNS-6f37f56d-a87d-4b85-b6a9-cc953cf779b3\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":300,\"direction\":\"GREATER_OR_EQUAL\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]},{\"eventName\":\"Measurement_vGMUX\",\"controlLoopSchemaType\":\"VNF\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vCPE-48f0c2c3-a172-4192-9ae3-052274181b6e\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.additionalMeasurements[*].arrayOfFields[0].value\",\"thresholdValue\":0,\"direction\":\"EQUAL\",\"severity\":\"MAJOR\",\"closedLoopEventStatus\":\"ABATED\"},{\"closedLoopControlName\":\"ControlLoop-vCPE-48f0c2c3-a172-4192-9ae3-052274181b6e\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.additionalMeasurements[*].arrayOfFields[0].value\",\"thresholdValue\":0,\"direction\":\"GREATER\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]}]}","tca.processing_batch_size":10000,"streams_subscribes.tca_handle_in.polling.fixed_rate":0,"streams_subscribes.tca_handle_in.message_limit":50000,"service_calls":[],"streams_subscribes.tca_handle_in.consumer_ids[0]":"c0"}}
2020-04-14 16:51:32.652 DEBUG 1 --- [ctor-http-nio-4] r.n.resources.PooledConnectionProvider   : [id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443] onStateChange(GET{uri=/service_component_all/dcae-tcagen2, connection=PooledConnection{channel=[id: 0x1b86fb8d, L:/10.42.1.198:57454 - R:config-binding-service/10.43.165.135:10443]}}, [disconnecting])