...
In London release the Kafka ports are exposed through ingress.
Istio and Istio-Ingress is used
- In the istio-ingress configuration the required ports (9010, 9000,9001, 9002) need to be exposed → see ONAP on ServiceMesh setup guide
- Helm settings are configured to enable the Ingress exposure of Kafka Interfaces by:
global values (global.ingress.enable_all)
Code Block global: ingress: enabled: true # enable all component's Ingress interfaces enable_all: true
or local setting in onap-strimzi (ingress.enabled)
Code Block ingress: enabled: true service: - baseaddr: "kafka-bootstrap-api" name: "onap-strimzi-kafka-external-bootstrap" port: 9094 exposedPort: 9010 exposedProtocol: TLS
...
Code Block |
---|
kafka-bootstrap-api.simpledemo.onap.org:9010 kafka-0-api.simpledemo.onap.org:9000 kafka-1-api.simpledemo.onap.org:9001 kafka-2-api.simpledemo.onap.org:9002 |
...
Code Block | ||||
---|---|---|---|---|
| ||||
sudo vi /etc/hosts ---- 10.32.242.56 kafka-bootstrap-api.simpledemo.onap.org 10.32.242.56 kafka-0-api.simpledemo.onap.org 10.32.242.56 kafka-1-api.simpledemo.onap.org 10.32.242.56 kafka-2-api.simpledemo.onap.org |
- Install KafkaCat
Code Block | ||||
---|---|---|---|---|
| ||||
sudo apt install |
- Install KafkaCat
Code Block | ||||
---|---|---|---|---|
| ||||
sudo apt install kafkacat |
- Get the Metadata (use an existing Kafka User, here "external-strimzi-kafka-user") using the sasl.password exported above:
Code Block | ||||||
---|---|---|---|---|---|---|
| ||||||
kafkacat -L -b kafka-bootstrap-api.simpledemo.onap.org:9010 -X security.protocol=sasl_ssl -X enable.ssl.certificate.verification=false -X sasl.mechmechanisms=SCRAM-SHA-512 -X sasl.username=external-strimzi-kafka-user -X sasl.password=hCv4IZ3Q6XLR -v Metadata for all topics (from broker -1: sasl_ssl://kafka-bootstrap-api.simpledemo.onap.org:9003/bootstrap): 3 brokers: broker 0 at kafka-api.simpledemo.onap.org:9000 (controller) broker 2 at kafka-api.simpledemo.onap.org:9002 broker 1 at kafka-api.simpledemo.onap.org:9001 33 topics: topic "org.onap.dmaap.mr.PNF_REGISTRATION" with 2 partitions: partition 0, leader 2, replicas: 2, isrs: 2 partition 1, leader 1, replicas: 1, isrs: 1 ... |
- Check the parameters of the installed kafkacat release:
...
- Get Metadata (use an existing Kafka User, here "external-strimzi-kafka-user"):
Code Block | ||||||
---|---|---|---|---|---|---|
| ||||||
kafkacat -XlistL ## Global configuration properties Property | C/P | Range | Default | Description -----------------------------------------|-----|-----------------|--------------:|-------------------------- builtin.features | * | | gzip, snappy, ssl, sasl, regex, lz4, sasl_gssapi, sasl_plain, sasl_scram, plugins | Indicates the builtin features for this build of libr... |
...
-b kafka-bootstrap-api.simpledemo.onap.org:9010 -X security.protocol=sasl_ssl -X enable.ssl.certificate.verification=false -X sasl.mechanisms=SCRAM-SHA-512 -X sasl.username=external-strimzi-kafka-user -X sasl.password=e8ILJRai43LT -v
Metadata for all topics (from broker -1: sasl_ssl://kafka-bootstrap-api.simpledemo.onap.org:9010/bootstrap):
3 brokers:
broker 0 at kafka-api.simpledemo.onap.org:9000
broker 2 at kafka-api.simpledemo.onap.org:9002
broker 1 at kafka-api.simpledemo.onap.org:9001 (controller)
2 topics:
topic "unauthenticated.VES_NOTIFICATION_OUTPUT" with 6 partitions:
partition 0, leader 1, replicas: 1,0,2, isrs: 0,1,2
partition 1, leader 0, replicas: 0,2,1, isrs: 0,1,2
partition 2, leader 2, replicas: 2,1,0, isrs: 0,1,2
partition 3, leader 1, replicas: 1,2,0, isrs: 0,1,2
partition 4, leader 0, replicas: 0,1,2, isrs: 0,1,2
partition 5, leader 2, replicas: 2,0,1, isrs: 0,1,2
topic "unauthenticated.SEC_3GPP_HEARTBEAT_OUTPUT" with 6 partitions:
partition 0, leader 2, replicas: 2,1,0, isrs: 0,1,2
partition 1, leader 1, replicas: 1,0,2, isrs: 0,1,2
partition 2, leader 0, replicas: 0,2,1, isrs: 0,1,2
partition 3, leader 2, replicas: 2,0,1, isrs: 0,1,2
partition 4, leader 1, replicas: 1,2,0, isrs: 0,1,2
partition 5, leader 0, replicas: 0,1,2, isrs: 0,1,2
|
- Get Topic Data (use an existing Kafka User, here "external-strimzi-kafka-user"):
Code Block | ||||||
---|---|---|---|---|---|---|
| ||||||
kafkacat -b kafka-bootstrap-api.simpledemo.onap.org:90039000 -X security.protocol=sasl_ssl -X enable.ssl.certificate.verification=false -X sasl.mechanisms=SCRAM-SHA-512 -X sasl.username=external-strimzi-kafka-user -X sasl.password=hCv4IZ3Q6XLRe8ILJRai43LT -C -t unauthenticated.VES_NOTIFICATION_OUTPUT -v {"event":{"commonEventHeader":{"startEpochMicrosec":8745745764578,"eventId":"FileReady_1797490e-10ae-4d48-9ea7-3d7d790b25e1","timeZoneOffset":"UTC+05.30","internalHeaderFields":{"collectorTimeStamp":"Tue, 12 06 2022 01:35:59 GMT"},"priority":"Normal","version":"4.0.1","reportingEntityName":"otenb5309","sequence":0,"domain":"notification","lastEpochMicrosec":8745745764578,"eventName":"Noti_RnNode-Ericsson_FileReady","vesEventListenerVersion":"7.0.1","sourceName":"oteNB5309"},"notificationFields":{"notificationFieldsVersion":"2.0","changeType":"FileReady","changeIdentifier":"PM_MEAS_FILES","arrayOfNamedHashMap":[{"name":"test.xml.gz","hashMap":{"location":"sftp://sftp:22/test.xml.gz","fileFormatType":"org.3GPP.32.435#measCollec","fileFormatVersion":"V10","compression":"gzip"}}]}}} ... |
...