AWS DMS Processor

About

AWS Database Migration Service (AWS DMS) is a managed migration and replication service that helps move your database and analytics workloads quickly, securely, and with minimal downtime and zero data loss.

The data migration pipeline supports one-shot full-load operations, and continuous replication based on change data capture (CDC). For a good introduction to AWS DMS, please refer to Migrating Databases to AWS: A Deep Dive into AWS DMS.

Details

A full-load-and-CDC pipeline using AWS DMS and CrateDB will use Amazon Kinesis Data Streams as a DMS target, combined with a CrateDB-specific downstream processor element.

Coverage

AWS DMS supports migration between 20-plus database and analytics engines, either on-premises, or per EC2 instance databases.

  • Amazon Aurora

  • Amazon DocumentDB

  • Amazon RDS databases

  • Amazon S3

  • Google Cloud MySQL and PostgreSQL databases

  • IBM Db2 for Linux, UNIX, and Windows versions 9.7 and higher

  • IBM Db2 for z/OS version 12

  • MariaDB versions 10.0 and higher

  • Microsoft Azure SQL, PostgreSQL, and MySQL databases

  • Microsoft SQL Server versions 2005 and higher

  • MongoDB versions 3.x and higher

  • MySQL versions 5.5 and higher

  • Oracle Database versions 10.2 and higher

  • Oracle HeatWave MySQL versions 8.0 and higher

  • PostgreSQL versions 9.4 and higher

  • SAP Adaptive Server Enterprise (ASE) versions 12.5 and higher

AWS DMS also supports the MySQL/MariaDB and PostgreSQL variants on AWS RDS, Microsoft Azure, and Google Cloud. Sources for AWS DMS displays all the compatibility details on one page.

Usage

Depending on your needs and requirements, CrateDB and CrateDB Cloud support different ways to configure AMS DMS using CrateDB as a CDC consolidation database.