CSD Consulting

Your Conversion Specialists for Data

They are

Consultants Serious about Data

Data Analysis and Data Profiling

This phase involves analysing and profiling the potential source systems.

Data analysis (also called Data Discovery) involves:

  • Analysing and documenting the data structures (databases, tables, columns, primary keys, foreign keys) - Note there are tools that can automate this activity.
  • Identifying data volumes
  • Identifying Data Custodians, Data Stewards and Data Owners
  • Identifying data standards and data governance approach.
  • Identifying the Infrastructure and technologies which the system uses
  • Identifying software which used such as COTS solution, Data Management tools and custom software.
  • Analysing the data being passed to and from interfacing systems
  • Identifying the Source of Truth for data elements
  • Identifying peak usage times 
  • Identifying times when backups and interfaces are run (to identify a window to run regular data extracts and potential access issues during trial migrations and at go-live)
  • Identifying any data retention requirements
  • Analysing the archiving approach and the location of historical data  
  • Identifying Potential Data Migration Issues, Risks, Constraints and Dependencies.

Data Profiling (also called Data Quality Analysis) involves analysing the quality of the data by applying the applicable Data Quality Dimensions:

  • Correctness
  • Validity
  • Duplication
  • Consistency
  • Non-standard values
  • Obsolete Data
  • Timeliness
  • Completeness
  • Missing values
  • Integrity
  • Precision

A Data Analysis and Data Profiling report should be done for each source system. Generally a single report is done for each source system. Alternately a separate Data Analysis Report and Data Profiling Report can be done for each system. In order to keep the explanation simple separate reports will be assumed.

Links:

Key Features

Key Features of the CSD Consulting Services offering which sets it apart from other organisations are as follows

laughing

Data Migration Specialists who focus of best practice data migration processes, tools and techniques

cool

Experts in Commercial ETL tools but can deliver cost effect ETL services using Open Source tools

money-mouth

Specializing in Data Migration for Operational Systems

sealed

Publicly available easy to understand Data Migration Methodology with processes, templates and checklists

Publish the Menu module to "offcanvas" position. Here you can publish other modules as well.
Learn More.