Skip to main content

Product Requirements Document

Mission​

We want to develop queue interactive Spark clusters to optimize resource utilization to improve efficiency and speed during (applicable) data extraction, ingestion, modeling, and publishing.

Background​

Currently, ADF does not efficiently utilize available resources and lacks a queuing mechanism for maintaining continuous operation for multiple independent jobs to be completed in parallel. Implementing queue-interactive clusters for spark-connector extraction will address this limitation, increasing overall processing efficiency and resource utilization.

Targeted Personas​

  • Dario Data Professional
  • Debbie Delivery Engineer

Current Behavior​

Extraction​

Ingestion​

Modeling​

Publishing​

Outcomes / Goals​

  • Provide desired end product/workflow.
  • Will this be a singular effort or phased release?

User Stories​

Name/Descr​

  • story

Use cases​

Case group name​

  1. Case / user name
    1. Primary Actor:
    2. Description:
    3. Preconditions:
    4. Postconditions:
    5. Flow:
      1. Steps...
      2. Outcome

Requirements​

Functional​

  • List of functional description of the feature

Non-functional requirements​

  • List of NFRs to focus on

Out of Scope​

  • Funtionality and cases out of scope for planned feature
  • Might be treated as future updates that not yet planned and refined

Dependencies & Constraints​

  • Any kind of dependency

Assumptions​

Risks​

Timeline and Milestones​

Phase I​

  • Release #.##
  • Components, other deliverables

Questions?​