Skip to content

Demo Client Data Consolidation System - Requirements Document #1

@ShantoieT57

Description

@ShantoieT57

Overview

This document outlines the requirements for a demo system designed to centralise client data from multiple disparate systems into a single, unified repository. The system will facilitate data reconciliation, ensure data integrity, and provide access to consolidated client records for all participating systems.

Functional Requirements

1. API-Based Data Reception

  • The system must provide a secure API endpoint to receive client records from external systems.
  • Incoming client data should be validated for structure and completeness before processing.

2. Temporary Data Storage

  • Incoming client records must be stored in a temporary staging area.
  • The staging area should support tracking of source system and timestamp for each record.

3. Data Reconciliation

  • The system must automatically reconcile data by comparing incoming records against existing records in the central store.
  • Discrepancies between records must be detected and flagged for user review.

4. Discrepancy Resolution (Front End)

  • Discrepant records must be presented to a user via a front end interface.
  • The user must be able to review all conflicting fields and select which values to keep.
  • Upon user confirmation, the selected fields should be merged into the main data store, with all changes logged.

5. Central Data Store Management

  • Successfully reconciled and merged records should be stored in the central data store.
  • The system must maintain full change history and audit logs for all client records.

6. Data Provisioning for External Systems

  • The system must expose APIs for other systems to retrieve up-to-date, consolidated client data.
  • Data retrieval should be secure and support filtering/searching by client attributes.

Technical Architecture

  • Backend functionality to be implemented using Linx.
  • Front end components to be built using Stadium.
  • MS SQL will be used as the database.

Front End Components

1. Data View Page

  • Displays all client records in the central store.
  • Each record includes a 'View Detail' link to a detail page showing record fields and change logs (who changed what and when).

2. Reconciliation View Page

  • Lists all records with reconciliation discrepancies.
  • Each entry includes a 'Details' link to a page where the user can view conflicting fields and choose which values to merge.

Audit & Logging

  • Every change to client records must be logged, including user actions during reconciliation.
  • Logs should be accessible from the front end for review.

Security

  • APIs do not need to be secure for the demo.
  • During the presentation, security requirements and options must be discussed (e.g., authentication, access control).

Demo Presentation

  • Data will be pushed to the system via PostMan.
  • Key discussion points for the demo presentation:
    • API security can be changed depending on organizational needs.
    • Data can be pushed back to other systems by calling their APIs, or by providing an API/webhook for other systems to fetch data from.

This requirements document forms the foundation for the development and implementation of the demo client data consolidation system.

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions