DMaaP Dublin M3 Architecture Review

• Brief Project Overview (brief as it should be known)

•  

  • DMaaP is a premier platform for high performing and cost effective data movement services that transports and processes data from any source to any target with the format, quality, security, and concurrency required to serve the business and customer needs.

  • DMaaP has three components

  •  

    • Message Router (MR): Message Router is a reliable, high-volume pub/sub messaging service with a RESTful HTTP API. It is intended to be deployed by Platform Service providers so that it is available to Platform clients as a web service. The service is initially built over Apache Kafka.

    • Data Router (DR): The Data Routing System project is intended to provide a common framework by which data producers can make data available to data consumers and a way for potential consumers to find feeds with the data they require. The interface to DR is exposed as a RESTful web service known as the DR Publishing and Delivery API

    • Data Bus Controller (BC): Provisioning API of the Data Movement Platform.

  • For a more detailed overview - https://lf-onap.atlassian.net/wiki/pages/viewpage.action?pageId=16223923

• New component capabilities for Dublin, i.e. the functional enhancements.

•  

  • DMaaP - Message Router

  •  

    • Upgrade Kafka to v1.1.1

    • Support for Authenticated topics

    • Add Scaling support

    • Support for multi-site applications

    • Add MirrorMaker to allow for message replication across Kafka clusters

  • DMaaP - Data Router

  •  

    • Data Router updates to support 5G Bulk PM use cases

    • Common role-based access control and authorization using CADI framework

  • DMaaP - Bus Controller

  •  

    • DMaaP Provisioning via Bus Controller

• New or modified interfaces

•  

  • New - Mirror Maker between two Kafka clusters for replicating messages between the clusters.

• If they are modified, are the backwards compatible?

•  

  • N/A

• Interface naming (point to an example)

•  

  • REST interfaces with various APIs for the three DMaaP components. Details of the API signatures at the links below

• Reference to the interfaces.

•  

  • MR: https://docs.onap.org/en/casablanca/submodules/dmaap/messagerouter/messageservice.git/docs/offeredapis/offeredapis.html

  • BC: https://docs.onap.org/en/casablanca/submodules/dmaap/dbcapi.git/docs/api.html

  • DR: https://docs.onap.org/en/casablanca/submodules/dmaap/datarouter.git/docs/index.html

• What are the system limits?

•  

  • None so far. Application redundancy and scaling depends on Kubernetes.
    
    

  • Persistent volume used for storing Zookeeper and Kafka log files.
    
    

  • Kafka log files can get larger depending on the log retention policy on the Kafka topics.

  • Retention policy can be adjusted upon negotiating with the topic owners
    
    

• Involved use cases, architectural capabilities or functional requirements.

  • 5G Use Case (Dublin)

• Listing of new or impacted models used by the project (for information only).

•  

  • None

AT&T Proprietary (Internal Use Only)
Not for use or disclosure outside the AT&T companies except under written agreement