Problem Statement:
ONAP architecture requires capability to scale and to enable flexibility to work in a geo-distributed deployment scenario. This may further require proper mechanisms and technologies incorporated to synchronize state, ensure consistency across distributed deployments while providing capability for real time processing of data.
Key Ideas:
- Concept of a Real Time Data Event Stream Platform (RTDESP)- A bottom up approach with a RT Data Event Stream Collection, Aggregation, Transformation, Filtering
- Declarative model based approach for defining the end point
- A comparison of existing Kafka based DMaaP and new approach highlighting some of the limitations of DMaaP approach which is expected to be fixed by the new proposal or RTDESP
- DMaaP system does not support data synchronization
- DMaaP provides a Pub/Sub MOM with JSON payload and not tuned for polyglot environment
- In DMaaP Client/Server interaction is over TCP which is relatively slow in nature for message delivery
- Real Time nature of DMaaP is not clear
- A toolset for realizing the RTDESP consisting of – A DDS based Data Distribution Bus, Akka/Kafka based Collection FW, Beam and Flink for Transformation and Analytics, DDS based Cache/persistent storage
- RTDESP has two parts – a design time function which is used for defining workflow/pipe line stitching, a run time environment forming part of common service. There will also be some resources maintained in A&AI.
Benefits
- End point API independent message and data handling
- Real time message handling
- Geo distributed data synchronization for components in ONAP
- In-built storage for modelled data