...

Architecture

POC Scope

• DataLake Feeder and DLAdmin delivery as service services under DCAE  (dcaegen2/services repository)
   

  • dcaegen2/services

    └── components

        ├── dl-handler

  /

  •     │   ├── dl-admin
        │   └── dl-feeder

  )

• DLFeeder will support pluggable sources and datastore support
  • DMAAP/Kafka as primary source (option to poll kafka broker for new topic?)
  • Druid/Couchbase/Elasticsearch/Hadoop datastore support
• ConfigBingingService integration to fetch deployment/run-time configuration
• Alternate option will be to leverage k8s Configmap
DLAdmin delivery as service under DCAE (dcaegen2/services/dl-handler/dl-admin).  Will integrate
• .  
• Integrate the DL Admin UI into DCAE dashboard, which is built on portal SDK and serves as UAM for DCAE users/operation.
• Integrate DLAdmin into DCAE-Dashboard

...

Other extension cases (stretch goal)

...

• Karl Chiang
• Kate Hsuan
• Ekko Chang
• May Lin

IBM

• Driptaroop Das