Organizations use their Data warehouses to drive analytics and generate insights. To aid this process, data warehouses are designed to hold historic data in de-normalized structures. These de-normalized structures help simplify querying from these large structures. Netezza, Teradata, Exadata are some of the most common on-premise data warehouses. Typical problems customers face with on-premise data warehouses include scalability, high degree of management and expensive upfront compute and storage costs. These factors have contributed to customers shifting to Cloud based Data warehouse solutions.
AWS Redshift is the Cloud Data warehouse offering from AWS. This is a petabyte scale fully managed data warehouse on Cloud, which in conjunction with other services on AWS, enables organizations to gleam new insights of their data. Redshift uses the familiar ANSI SQL, enabling users to seamlessly migrate and integrate with the AWS ecosystem.
The Infosys Redshift migration strategy couples our expertise in implementing data warehouse and Infosys accelerators, to help enterprises accelerate the journey to Cloud data warehouse.
Cloud Data Warehouse – Migration Strategies:
Strategies for migration to Redshift Cloud Data Warehouse.
Fig 1: Data Warehouse Migration to AWS Redshift - Patterns
Components in a Data Warehouse migration:
A Data Warehouse migration consists of migrating/rebuilding several components such as Schemas (Tables, Views), Historic data Migration and Delta data append, building ETL components and rewiring consumption components to the new Data warehouse.
Schema & Data Migration
AWS SCT / AWS Database Migration Service/ Accelerators
Database Code Migration
AWS SCT / Partners Solution / Internal Tool/ Manual
Database Jobs / ETL Migration
AWS SCT / Partners Solution / Internal Tool / Manual
Reporting / Downstream Migration
Custom Tools / Manual
Fig 2: Components in a Data Warehouse Migration
AWS Services that help in migrating to Redshift Data Warehouse:
Infosys Data Wizard:
Infosys data wizard is a comprehensive framework with a set of accelerators for seamless Data Migration.
Fig 3: Infosys Data Wizard unboxed
Infosys Redshift migration bags expertise in implementing data warehouse and Infosys accelerators to help enterprises accelerate their journey to cloud data warehouse.
Infosys migration strategy helps customers accelerate Data Warehouse migration to Redshift:
Infosys Data Wizard helps achieve 50-55% effort savings. Key value-adds of solution include:
Blog: Enabling Data Analytics on Cloud using Amazon Redshift
Infosys Data Wizard provides UI and CLI-based utilities for automated Source & Destination Inventory collection
Infosys Data Wizard provides multiple validations & reporting, includes 8-point Data Certification - UI and CLI based Validation
Infosys Data Wizard helps with automated migration execution and monitoring. Seamless integration with third party vendors like ADF, WANdisco to support live data migration and replication