DAT405

SQL Server to Amazon Aurora

Migration, Step by Step
Ramya Kaushik Arun Thiagarajan
Database Engineer Product Manager
AWS Database Migration Service/Schema AWS Database Migration Service/Schema
Conversion Tool Conversion Tool

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda

• An overview of AWS Database Migration Tool (AWS DMS)

and AWS Schema Conversion Tool (AWS SCT)

• The steps to migrate

• How to read an SCT assessment report

• SQL Server to Aurora MySQL playbook

• Top Aurora MySQL features our customers migrating

from SQL Server are excited about
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What are AWS DMS and AWS SCT?

AWS Schema Conversion Tool converts your commercial

database and data warehouse schemas to open-source
engines or AWS-native services, such as Amazon Aurora
and Amazon Redshift

AWS Database Migration Service easily and securely

migrates and/or replicate your databases and data
warehouses to AWS

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Migration process
AWS SCT
Convert or copy your schema

Source database Destination database

or data warehouse or data warehouse
Native tool

Move your data

AWS DMS

Source database Destination database

or data warehouse or data warehouse

AWS SCT

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS SCT product highlights

Assess Plan Convert schema

and code

Optimize Migrate
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DMS product highlights

Secure Verify Validate Ship with

Snowball

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DMS—Endpoint support expansion

MongoDB Cassandra Oracle SQL Server Netezza

Amazon S3 AWS Snowball
Amazon
Edge
Aurora

Greenplum Vertica Teradata

Amazon Amazon Amazon Amazon Amazon Kinesis

Aurora DynamoDB Redshift Elasticsearch

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon S3
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS SCT Migration Assessment Report

• Assessment of migration
compatibility of source
databases with open-source
database engines – Amazon RDS
MySQL, Amazon RDS PostgreSQL
and Aurora
• Recommends best target engine
• Provides details level of efforts
to complete migration

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Keep your apps running during the migration
AWS
DMS

Customer
premises VPN AWS

Internet

Start a replication instance Let AWS DMS load data and keep
Connect to source and target databases them in sync
Select tables, schemas, or databases Switch applications over to the target
at your convenience
Application users

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Migration Steps
Migration Steps Required Resources
1. Envisioning/Assessment Identify SMEs and stakeholders

2. Database schema conversion Assign DBAs/DB developers for schema conversion efforts
Assign application developers to identify and convert database calls to support target
3. Application conversion/remediation DB
4. Script conversion Assign DBAs/DB developers for db scripts conversion efforts

5. Integration with 3rd party applications Assign application developers or DBAs for integration efforts
Assign DBAs to migrate test/stage data; plan data migration for an actual migration to
6. Data migration production environment
Assign QA, DBA and Application Developers to work through testing process of a
7. Functional testing of the entire system migrated system
8. Performance tuning Assign DBAs, developers and testers for performance tuning work

9. Integration and deployment Assign DBAs, DevOps and developers support team to deploy the system.

10. Training and knowledge transfer Assign the Lead of the migrated team to drive the process

11. Documentation and version support Document migrated application for the rest of the application team
Assign migration team (DBAs, application developers, testers) to watch the migrated
12. Post production support application in production

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Amazon Aurora
MySQL and PostgreSQL compatible relational database built for the cloud

Performance and availability of commercial-grade databases at 1/10th the cost

Performance & Availability &

Highly secure Fully managed
scalability durability

5x throughput of standard Fault-tolerant, self-healing Network isolation, Managed by RDS: no

MySQL and 3x of standard storage; six copies of data encryption at hardware provisioning,
PostgreSQL; scale-out up across three AZs; rest/transit software patching,
to 15 read replicas continuous backup to S3 setup, configuration or
backups
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 What is Amazon Aurora?
Leverages a scale-out, distributed architecture

Availability Availability Availability

Zone 1 Zone 2 Zone 3
 Purpose-built log-structured
distributed storage system designed
for databases SQL SQL SQL

Transactions Transactions Transactions

 Storage volume is striped across Master Replica
hundreds of storage nodes distributed Caching Caching Caching

over 3 different availability zones Replica Replica

 Six copies of data, two copies in each

availability zone to protect against Shared storage volume
AZ+1 failures

 Plan to apply same principles to other

layers of the stack

Storage nodes with SSDs

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Old World to Aurora Migration Playbooks
• Topic-by-topic overview of SQL Server to
Aurora MySQL migrations and “hands-on”
best practices
• How to migrate from proprietary features
and the different database objects
• Migration best practices

Schema Data Best Practices

SCT DMS Playbook

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Top features in SQL Server - How to migrate to
Aurora MySQL
1. Emulate SQL Server DB Mail
DBMail is an email client solution for sending messages directly from SQL Server
For alerting purposes, use the Event Notification Subscription feature
Use LAMBDA integration.

2. Migrate from SQL Server Maintenance Plans

Set of automated tasks used to optimize a database, performs regular backups
Backups in Aurora via Snapshots

Backup and restore compared to Aurora

3. Database options
compare the replication in SQL and MySQL
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 SQL Server vs MySQL feature comparison
Migrate from Task SQL Server Aurora MySQL

SQL Server maintenance Rebuild or reorganize indexes ALTER INDEX / ALTER TABLE OPTIMIZE TABLE / ALTER TABLE
Plans

Decrease data file size by DBCC SHRINKDATABASE Files are per table; not per database.
removing empty pages / DBCC SHRINKFILE Rebuilding a table optimizes
file size.

Update statistics to help the UPDATE Set innodb_stats_auto_recalc to

query optimizer get updated STATISTICS / sp_updatestats ON in the instance global parameter
data distribution group.

Back up the database and BACKUPDATABASE /BACKUP Automated backups + snapshots

transaction log files LOG

SQL Server Database Mail Email client solution for Database Mail No Native support. Use LAMBDA
sending messages directly integration
From the database

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SQL Server vs MySQL feature comparison
Migrate from Task SQL Server Aurora MySQL
Replication and Log replication Log Shipping Not applicable. Aurora
Disaster Recovery MySQL
handles data
replication at the
storage
level.
Database level failure Always On Availability Aurora Replicas
protection Groups
Maximum Read 8 + Primary 15 + Primary
Only replicas
High Availability Always On Failover Multi replica, scale out
Cluster Instances (FCI), solution using
Always On Availability Amazon Aurora clusters
Groups, Database and Availability
Mirroring, Zones
and Log Shipping
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SQL Server vs MySQL feature comparison
Migrate from Task SQL Server Aurora MySQL
Backup and Restore Backups self managed backup Automatic and continuous
policy BACKUP DATABASE
Recovery Model SIMPLE, BULK functionality of Aurora
LOGGED, FULL MySQL
backups is equivalent to
the FULL
recovery model.
Log Backup BACKUP LOG Backup is at the storage
level
Migrate from SQL Server Database level options to ALTER DATABASE ... A database is
Database Options set database features SET command synonymous with a
schema. So, the notion of
database options is not
applicable to Aurora
MySQL.

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.