On–premise Hadoop based ecosystem help enterprises process varied data sets and build actionable analytics. However, as these platforms are adopted at large scale, enterprise face challenges with provisioning clusters, increased costs, governance and performance. Analytical, Sandbox type of environments require provisioning On-demand compute needs which are difficult with on-prem Hadoop architecture as it does not support decoupling compute and storage.
Enterprises can address these problems by migrating to a stable, secure, governed cloud platform like AWS that can scale-on-demand, effectively manage costs, facilitate Pay-per-use features and meet compliance requirements. Analytical users can also tap into on-demand provisioning of infrastructure and leverage large base of prebuilt library components. Hadoop Migration to AWS EMR can play a key role in Data Landscape Modernization and can help capitalize opportunities provided by the data economy.
Infosys and AWS partnered together to fortify AWS practice for our Data & Analytics capabilities, along with Hadoop migration strategy and accelerators that can help enterprises accelerate the migration journey to AWS cloud efficiently.
Infosys data and analytics team has built solution through well-defined strategy and suite of tools to accelerate the Hadoop migration journey to AWS EMR.
We have identified different approaches for efficient migration to AWS cloud:
Of the three Hadoop migration patterns, migration to AWS EMR provides below advantages –
We have designed accelerators and processes, to help migrating on-premise data lake objects and applications by any of the above patterns followed by an implementation strategy to help clients in achieving scaled and predictable outcomes.
By LOB (Horizontal)
By Architecture Layer
By New Capabilities / Workloads
Hadoop Platform on cloud
Hadoop to AWS EMR
Hadoop to Next-gen services
Fig 2: Implementation Strategy
Accelerated AWS cloud migration journey by 50% with capabilities -
The Infosys Data Wizard can help accelerate the migration process. The solution consists of below components:
We have varied approaches to meet client specific needs to migrate the workflows/code that are compatible with tools across different platforms.
Migration from Hadoop to AWS can be enabled in the below way:
Construct the right migration team with clear RACI (Responsible, Accountable, Consulted and Informed)
Split the data domains by timestamp, business lines, workload and convert it into an apt MVP (Minimal Viable Product)