SlideShare a Scribd company logo

MySQL Features & Implementation

Download as PPT, PDF
••
OSSCube, profile picture
OSSCube

The document presents an overview of MySQL, highlighting its features, including MySQL Enterprise and Community servers, backup solutions, high availability options, and network monitoring services. It emphasizes MySQL's status as a leading open-source database with extensive support and tools for monitoring and performance optimization. Additionally, it discusses replication techniques, clustering, and the importance of high availability in database management, particularly for enterprise applications.

Technology
1 of 67
Downloaded 312 times
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
MySQL Features By Rakesh Kumar OSSCube , Delhi rakesh@osscube.com
Introduction
What we will discuss in next 1 hour • General Info. • MySql Enterprise • Other Features of MySQL > MySQL Network Monitoring and Advisory services > Backup and Recovery > Audit Trail > High Availability > Migration Tool Kit
General Info - Overview of MySQL AB • Founded in 1995 • Operations in 24 countries • World’s Most Popular Open Source Database > Over 10 million installations > 50,000 downloads each day • Reduces TCO of database management > Reliable, high performance, easy to use • Bundled by over 100 software & hardware companies • Partners and Telecom Service Integrators HP, Dell, Novell, Red Hat, Unisys, Accenture, LogicaCMG, T-Systems and IPL
Key Features • Written in C, C++ • Multilayered design with Independent modules • Fully multi-threaded using Kernel Threads • Provides Transactional and Non-transactional storage engines
Key Features Cont… • In memory heap table support • Server available in client server model, or embedded DB. • Security and privilege management • Supports connection over SSL • Large database, large tables (default up to 256 TB)
Key features contd… • Connectors for application connectivity • 64 Index per table, 1-16 columns per index • Built-in tools for query analysis and space analysis • Localization • Many more…
What is MySQL Enterprise? MySQL Enterprise is the leading open source database solution behind today’s modern enterprise applications. It includes: • The MySQL Enterprise Server – the most reliable, secure, and up-to-date version of the world’s most popular open source database. • MySQL Network Monitoring and Advisory Services – services to ensure the maximum quality, uptime, and performance of MySQL Enterprise systems. • Production Support – around-the-clock support for the MySQL Enterprise server, along with consultative services and self-help knowledge aids. Designed for production use and web businesses / enteprise customers relying on MySQL for key business applications.
MySQL Enterprise vs. Community Server Open Source Benefits from testing by worldwide Community Feature Releases Experimental Mature Monthly Rapid Update Service Pack Program Quarterly Service Pack Program Hot Fix Program Bug Escalation Privilege 24x7 Production Support Platform / Application / Training Certified Extended End-of-Life Policy Enterprise Installer and Configuration Manager Out-of-the-Box Configured for Enterprise use Monitoring and Advisory Service Automated Software Update and Alert Service Online Knowledge Base Extensive internal/external (Coverity, KLOCwork) testing Benchmarked with 2,000+ connections Legal indemnification
What is the MySQL Community Server? The MySQL Community Server is the rapidly evolving, leading edge and non- commercially supported version of the MySQL server. • Leading edge: new and experimental features with every release. • Open source development and innovation. GPL license. • High community participation. Contributions encouraged! • Great for open source developers, technology enthusiasts, and those wanting to experiment and try out MySQL. • Serves as the foundation & proving ground for MySQL Enterprise. • No formal QA, support, or certifications Recommended for non-production applications and those wishing to try out MySQL. Supported by the large MySQL open source community.
Other Features of MySQL • MySql Network Monitoring and Advisory services • Audit Trail • Backup and Recovery • High Availability – Replication and Clusters • Data migration from other RDBMS to MySQL
MySQL Network Monitoring and Advisory Service • Single, consolidated view into entire MySQL environment • Customizable rules-based monitoring and alerts • Identifies problems before they occur • Reduces risk of downtime • Makes it easier to scale-out without requiring more DBAs “Virtual MySQL DBA” Assistant
Top Features & Benefits Enterprise Dashboard Primary benefits • Provides “at a glance” view into health, security, availability and performance of all MySQL servers. • Saves DBA time writing, maintaining and monitoring scripts that collect, compile, and report similar metrics. • Assists DBAs in determining “where” and “how” to spend their limited time. Why it’s important • Makes it easy to scale-out on MySQL without adding more DBAs.
Top Features & Benefits MySQL Network Advisors Security Schema Administration Performance Replication Custom • Protects MySQL • Helps DBA • Helps DBA • Makes •Makes • Allows customer Servers design better better manage suggestions for to create their • Uncovers databases database improving •Identifies own Advisor Security • Uncovers processes database speed collection loopholes • Suggests • Identifies • Provides for Security improvements potential custom best loopholes for smoother performance practice operations bottlenecks enforcement Each contains a set of Advisor Rules designed to enforce MySQL Best Practices for the specific Advisor category. Provide “Virtual MySQL DBA” expertise
Top Features & Benefits MySQL Network Advisors and Rules Primary benefits • 100+ Advisor Rules proactively monitor 600+ MySQL and OS specific metrics for problems before they occur. • Extend DBA skill set to include MySQL expertise. • Find problems/tuning opportunities DBAs cannot find themselves. Why they are important • Reduce downtime and performance issues by identifying problems and corrective actions before costly outages occur. Provide “Virtual MySQL DBA” expertise
Top Features & Benefits Customizable Monitors & Alerts Primary Benefits • Saves DBA time and effort by allowing DBAs to group and monitor many servers as single entity. • User defined Advisor rules allow for Enterprise specific monitoring and alerts. • Notifications (SMTP/SNMP) can be tailored for individual or group recipients. Why it’s important • Allows for customized SLAs across large MySQL deployments.
Value Prop of MySQL Enterprise Gold Silver Silver + Basic + • Monitors and • Monitors all servers Optimizes Memory G • Proactive Usage Notifications • Replication • Expert Advice Monitoring Basic • Optimizes MySQL • Ensures proper r e m t s uC ot e u a V • Enterprise Server Configuration Replication • Ensures settings configuration •Ensures Performance l Uptime/Reliability • Ensures • Rapid Problem • Regular Service Packs Recoverability Resolution •Guards against • Self-help Support • Tightens Security • (Hot Fix builds) • Production Support • Extends Support •Optimizes/Tunes • Support! Support! • Custom o Queries • Database Design
MySQL Network Monitoring and Advisory Service How it works Automated Data Collection Automated Data Collection “Query Cache Hit Rate” 600 + MySQL and OS specific metrics Data Evaluation • Metrics from all SHOW commands -Default or custom expression evaluation “Query Cache Has Sub-optimal Hit Rate” • Metrics from MySQL provided Thresholds scripts -Violation? “Query Cache Hit Ratio < 95%” • OS Metrics from SIGAR library Events and Alerts • MySQL/ OS Metrics from custom -Graphically seen in console scripts “Rule Violation Appears on Dashboard” Notifications -Requires notification? (SMTP/SNMP) “Notification Sent” Expert Advice and Assistance -Advice on alert/problem and how to fix it “Increase the query_cache_variable value” Specific User Action “Virtual MySQL DBA” - Problem resolved by user intervention
MySQL Network Monitoring and Advisory Service Architecture MySQL AB Corporate Data Center Individual Enterprise Software Databases & Updates Advisor Rules Server Updates MySQL Enterprise Web Service Manager Browser Master-Slave Enterprise Dashboard Replication Profiles & Alerts Knowledge Base Production Support MySQL Enterprise Repository Multi-vendor Support, IP Protection Cluster
MySql Backup • Dump or Raw Backup • On-line or Off-line • Table Types and Consistency • Storage Requirements • Replication
Dump or Raw Backup • Dumps – Can be performed remotely – Take a lot of space – CPU intensive and slower – Are plain SQL, so easy to use later – Can do selective restore – Works for any table type • Raw Backups – Faster, there is no translation – Restore “instantly” – Works for ISAM/MyISAM only
On-line or Off-line • On-line – May Impacts running applications (can’t write) – Must deal with data consistency issues – Slower than off-line because of I/O contention • Off-line – Very simple – Speed is not an issue – Can use normal backup software
Table Types & Consistency • All tables need to flushed to disk – FLUSH TABLES • Tables can’t be updated during backup – LOCK TABLES... • Related tables treated as a group, lock all – FLUSH TABLES WITH READ LOCK • Transactional tables have logs to backup
Storage Requirements • How long can you store backups? – Consider staggering older backups – Never know when you’ll want old data • Raw backups take less space – You can keep just the .MYI header – Rebuild indexes later if need be • All forms of backup can be compressed
Replication • Backup your slave instead of your master – Master won’t be interrupted – Slave can probably be shut down – Or at least you can hold read locks for a long time and nobody will care • It may be worth setting up a slave just for doing backups • Remember to backup the master.info file
Tools and Techniques • mysqldump • mysqlhotcopy • InnoDB on-line backup • Off-line backups • Filesystem snapshots • Roll your own
mysqldump • Comes with MySQL • Dumps local or remote tables/databases • Variety of output formats • Handles locking if you need it • Works best for small and medium installations
mysqlhotcopy • Comes with MySQL – Written by Tim Bunce of Perl DBI fame • Raw backups of MyISAM tables • Handles locking • Regular expression support – Match certain databases or tables • Can truncate indexes to save space
mysqlsnapshot • Separate download – http://jeremy.zawodny.com/mysql/ • Used for setting up replication snapshots • Or backing up a running server • Always backs up everything – Either one big tar file or one per database • Very quick to restore
InnoDB on-line Backup • Separate download – http://www.innodb.com/ • Costs extra $$$ • The only good solution for InnoDB backups without replication • Only does InnoDB tables
Off-line Backups • Very easy • Hard to screw up • Use any backup tool you like – Just remember to backup all the MySQL stuff – You wouldn’t want compatibility problems after an upgrade • Restores can be quick
Filesystem Snapshot • Most “expensive” solution • Need hardware/software support – Veritas, Network Appliance, LVM, EMC, etc. • Fastest option available • Uses least disk space • Doesn’t guard against all failures
MySql Auditing • Various logs that help in auditing: • General Query Log • Binary Logs • Error Logs • Slow query log
MySQL HA Solutions Overview • Introduction to MySQL • HA Terms and Concepts • HA Requirements and Considerations • HA Solutions from MySQL • Third-Party HA Solutions for MySQL • Additional HA Resources plus Q & A
What is High Availability? • High Availability (HA) refers to the availability of resources in a computer system despite component failures • Two major categories > Customized/redundant software and hardware > Software-based solutions leveraging COTS components • Continuous Availability > Non-stop service > No disruption of service even during a fail over > Very high standard of availability, often unnecessary
What is Replication? • The duplication of data to more then one location • The use of additional hardware or software for… > Availability > Reliability > Fault tolerance > Performance • Asynchronous vs. Synchronous > Safeguarding data loss • MySQL Replication > Statement vs Row-based Replication • Block-level Replication (DRBD)
What is Replication? • The duplication of data changes to more than one location Asynchronous Replication update customer Synchronous Replication update customer
What is Clustering? • Clusters are often used for: > Operating systems > Databases > Application servers > Load balancers > Web servers > Just about any “service” that needs to be highly available • Redundant nodes provide service when components fail • Eliminate single points of failure > Multiple network connections > Redundant data storage (SAN, RAID) • Shared-Nothing vs. Shared-Disk
MySQL High Availability Solutions • MySQL Replication • MySQL Replication and Linux Heartbeat • MySQL, DRBD and Linux Heartbeat • MySQL Cluster • MySQL Cluster Carrier Grade Edition • MySQL w/ Shared-Storage & Clustering Agents • Other HA Solutions for MySQL
MySQL Replication • Asynchronous Requirements Support > Statement Availability > Row-based (5.1) Automated IP Fail Over No > Mixed (5.1) Automated DB Fail Over No • Read vs. Write Typical Fail Over Time Varies > Response times Resynchronization of Data No > Load balancing Geographic Redundancy Yes > Scale Out Scalability • Administration Built-in Load Balancing Scale-Out > Backups Read Intensive Yes > Upgrades Write Intensive No > Testing Dozens for • # of Nodes Geographic Redundancy Reads
MySQL Replication Topologies Master > Slave Master > Slaves Masters > Slave (Multi-Source) Master > Slave > Slaves Circular (Multi-Master) Master < > Master (Multi-Master)
Inside MySQL Replication Writes & Reads Web/App Server Writes relay binlog mysqld I/O SQL Thread Thread index & binlogs data Replication binlog data mysqld MySQL Master MySQL Slave
MySQL Replication - Scale Out • Write to one master • Read from many slaves • Perfect for read intensive apps Load Balancer Writes & Reads Reads Reads MySQL Replication
MySQL, Heartbeat & DRBD Cluster IP Management Active Passive DRBD DRBD Server Server Synchronous Block Replication
Managing Failures IP Management Passive X Active DRBD DRBD Server Server X X X
Data Resynchronization after Host Failure IP Management Passive Active DRBD DRBD Server Server Resynchronization Active Server is still able to process transactions during a resynchronization operation
DRBD Basics • When the failed node comes up > Becomes a secondary node > Must synchronize its data to the primary > Synching happens in the background without service interruption > Only the parts of the device which have changed since the failure will be resynchronized. • Total resynchronization in just several minutes > Regardless of device size > Even after the hard crash of an active node > Resynch rates may be configured per device • Device sizes currently limited to 4 TB
MySQL Cluster • Requirements Support In-Memory Database > Disk Data (5.1) Availability • Shared-nothing storage Automated IP Fail Over No • Synchronous replication Automated DB Fail Over Yes • Fast-automatic data fail over Typical Fail Over Time < 3 Secs • High performance Resynchronization of Data Yes > NDB API Yes • No special hardware Geographic Redundancy (w/ Replication) • Best for primary key lookups Scalability • Transactional Load Balancing Scale-Out • Online backup Read Intensive Yes (Look ups) Write Intensive Yes 5.0: 64 # of Nodes 5.1: 255
MySQL Cluster Carrier Grade Edition • An advanced version of MySQL Cluster for the telecom industry • Ideally suited for the telecom industry's top carriers, operators and equipment manufactures • Used by industry leaders for real-time, scalable data management
MySQL Cluster Carrier Grade Edition Characteristic Benefits • Separate development tree from MySQL Server Stability • Permits prioritized bug fixes & enhancements for customers • Developed & tested with major TEMs Quality & Reliability • Stricter patch and bug acceptance • Backup and restore status/monitoring • Support for larger clusters, up to 255 Nodes • Optimizations to communication protocol enabling API to Data Node over WAN • Circular replication support Scalability • Batched slave replication • Support for user-defined partitioning • Multiple connections to NDB from a single MySQL Server • Optimizations to communication protocol enabling API to Data Node over WAN • More efficient Client/Server data handling and transfers Performance • Other optimizations (Memory, BLOBs, Disk-based data, etc.) • Micro Global Checkpoints • Setting threads to real-time priority • Online Add Column • Support for mixed (x86, SPARC, PowerPC) environments Adaptability • Time-stamp based conflict detection/resolution support in replication • Locking threads to a CPU
MySQL Cluster System Requirements System Component Requirement Hosts Maximum of 255 total nodes (48 Data Nodes) COTS – Advanced TCA Hardware 32 & 64-bit x86, PowerPC & SPARC Memory Varies on size of database, # of hosts, # of replicas Shared-Nothing - Memory & Disk Data Storage SCSI or RAID for I/O performance 100 Mbps or better Network (Gigabit recommended, SCI supported) Operating System Linux (Red Hat, SuSE), Solaris, HP-UX, Mac OSX, others…
Cluster Components • Standard SQL Interface SQL Node • Scale-out for Performance (MySQL) • Enables Replication • High Performance NDB API • C++ API (Application) • Developer’s Guide • Data Storage (Memory/Disk) • Automatic & User-Defined Partitioning Data Node (NDB Storage Engine) • Local & Global Checkpoints • Scale-out for Capacity & Redundancy • Configuration Management • Arbitration Node • Use Two for Redundancy
2 Data Node MySQL Cluster Clients Application/SQL Nodes (NDB API and/or MySQL Server) Management Nodes Data Nodes NDB Storage Engine
4 Data Node MySQL Cluster Clients Application/SQL Nodes (NDB API and/or MySQL Server) Management Nodes Data Nodes NDB Storage Engine
Cluster uses Synchronous Replication Update: UPDATE author Two-phase SET country = ‘Cuba’ commit protocol WHERE authid = 2; Node Group authid (PK) fname lname country authid (PK) fname lname country 1 Albert Camus France 1 Albert Camus France 2 Ernest Hemingway Cuba 2 Ernest Hemingway Cuba 3 Johan Goethe Germany 3 Johan Goethe Germany 4 Junichiro Tanizaki Japan 4 Junichiro Tanizaki Japan
Geographic Redundancy • As of 5.1, support for asynchronous replication between Clusters • Enables a higher degree of availability and continuity Asynchronous MySQL Replication NDB API NDB API NDB Storage Engine NDB Storage Engine Cluster 1 Cluster 2
Distribution & Partitioning: 4 Data Nodes Four Data Nodes (Physical) authid (PK) fname lname country * Half of database on each node 1 Albert Camus France 2 Ernest Hemingway USA Two Replicas (Logical) * Two copies of each partition 3 Johan Goethe Germany 4 Junichiro Tanizaki Japan Two Node Groups * Two sets of identical Data Nodes Node Group 1 Node Group 2 authid (PK) fname lname country authid (PK) fname lname country 1 Albert Camus France 2 Ernest Hemingway USA 3 Johan Goethe Germany 4 Junichiro Tanizaki Japan
Distribution & Partitioning: 4 Data Nodes Query: SELECT fname, lname FROM author The query can only be satisfied by a WHERE authid = 2; Data Node belonging to Node Group 2 Result: because the data is not stored within Node Group 1 Ernest Hemingway Node Group 1 Node Group 2 authid (PK) fname lname country authid (PK) fname lname country 1 Albert Camus France 2 Ernest Hemingway USA 3 Johan Goethe Germany 4 Junichiro Tanizaki Japan
Distribution & Partitioning: 4 Data Nodes Query: SELECT fname, lname FROM author In a four node cluster, even if we WHERE authid BETWEEN 1 AND 3; loose a Data Node in each Node Result: Group, we can still satisfy any query Albert Camus Ernest Hemingway Johan Goethe Node Group 1 Node Group 2 authid (PK) fname X lname country X authid (PK) fname lname country 1 Albert Camus France 2 Ernest Hemingway USA 3 Johan Goethe Germany 4 Junichiro Tanizaki Japan
Data Node Failure & Recovery • Server 3 failure is detected • Server 4 handles Server 3 requests 1 2 3 4 Node Group 1 Node Group 2
Data Node Failure & Recovery • Server 3 begins copying data from Server 4 • Complete or just changes since failure 1 2 3 4 Node Group 1 Node Group 2
Data Node Failure & Recovery • Once data is fully restored, Server 3 rejoins the cluster 1 2 3 4 Node Group 1 Node Group 2
Network Partitioning – Avoiding “Split Brain” • By default, the Management Node acts as arbitrator • In the event of a network failure, arbitration determines which set of nodes should continue while shutting down the rest NDB API Application Nodes (NDB API and/or MySQL Server) Management Nodes Data Nodes X
MySQL MySQL Replication MySQL, Heartbeat Requirements MySQL Cluster Replication + Heartbeat + DRBD Availability Automated IP Fail Over No Yes Yes No Automated DB Fail Over No No Yes Yes Typical Fail Over Time Varies Varies < 30 secs < 3 secs Auto Resynch of Data No No Yes Yes Geographic Redundancy Yes Yes MySQL Replication MySQL Replication Scalability MySQL Built-in Load Balancing MySQL Replication MySQL Replication Yes Replication Read Intensive Yes Yes MySQL Replication Yes Write Intensive No No If configured correctly Yes # of Nodes per Cluster Master/Slave(s) Master/Slave(s) Active/Passive 255 # of Slaves Dozens for Reads Dozens for Reads Dozens for Reads Dozens for Reads
MySQL Migration Toolkit • Wizard Interface. Supports... • Oracle • Microsoft SQL Server • Microsoft Access • Sybase • MySQL
Questions...
Thank you for your Time and Attention! For more information visit http://www.osscube.com Or drop-in an email to mysql@osscube.com

More Related Content

PPTX
SQL Server High Availability and Disaster Recovery
Michael Poremba
 
PPT
Unit 2 -Cloud Computing Architecture
MonishaNehkal
 
PDF
Object Storage 1: The Fundamentals of Objects and Object Storage
Hitachi Vantara
 
PPTX
High Availability in Microsoft Azure
Krunal Trivedi
 
PPTX
Azure Data Factory for Azure Data Week
Mark Kromer
 
PPT
MySQL Atchitecture and Concepts
Tuyen Vuong
 
PPTX
Azure Synapse Analytics Overview (r1)
James Serra
 
PDF
SQLServer Database Structures
Antonios Chatzipavlis
 
SQL Server High Availability and Disaster Recovery
Michael Poremba
 
Unit 2 -Cloud Computing Architecture
MonishaNehkal
 
Object Storage 1: The Fundamentals of Objects and Object Storage
Hitachi Vantara
 
High Availability in Microsoft Azure
Krunal Trivedi
 
Azure Data Factory for Azure Data Week
Mark Kromer
 
MySQL Atchitecture and Concepts
Tuyen Vuong
 
Azure Synapse Analytics Overview (r1)
James Serra
 
SQLServer Database Structures
Antonios Chatzipavlis
 

What's hot (20)

PPTX
ADF Demo_ppt.pptx
vamsytaurus
 
PPTX
Microsoft Active Directory.pptx
masbulosoke
 
PDF
Architectural patterns for high performance microservices in kubernetes
Rafał Leszko
 
PPTX
Introducing Oracle Audit Vault and Database Firewall
Troy Kitch
 
PPTX
Azure storage
Adam Skibicki
 
PPTX
Azure Synapse Analytics Overview (r2)
James Serra
 
PPTX
SQL Database on Azure
Thurupathan Vijayakumar
 
PPTX
Non relational databases-no sql
Ram kumar
 
PPTX
Integration Success with AWS and Boomi
AaronLieberman5
 
PPTX
Azure Storage
Mustafa
 
PPTX
Data Guard Architecture & Setup
Satishbabu Gunukula
 
PPTX
Cloud Computing Design Considerations
Mike Kavis
 
PDF
SQL Server High Availability Solutions (Pros & Cons)
Hamid J. Fard
 
PPT
Data preparation
Tony Nguyen
 
PDF
AWS Glue - let's get stuck in!
Chris Taylor
 
PDF
Azure Cosmos DB
Mohamed Tawfik
 
PPTX
NOVA SQL User Group - Azure Synapse Analytics Overview - May 2020
Timothy McAliley
 
PDF
Microsoft Azure Security Overview
Alert Logic
 
PPT
A complete guide to azure storage
Himanshu Sahu
 
PPTX
Introduction to Azure Cloud Storage
Ganga R Jaiswal
 
ADF Demo_ppt.pptx
vamsytaurus
 
Microsoft Active Directory.pptx
masbulosoke
 
Architectural patterns for high performance microservices in kubernetes
Rafał Leszko
 
Introducing Oracle Audit Vault and Database Firewall
Troy Kitch
 
Azure storage
Adam Skibicki
 
Azure Synapse Analytics Overview (r2)
James Serra
 
SQL Database on Azure
Thurupathan Vijayakumar
 
Non relational databases-no sql
Ram kumar
 
Integration Success with AWS and Boomi
AaronLieberman5
 
Azure Storage
Mustafa
 
Data Guard Architecture & Setup
Satishbabu Gunukula
 
Cloud Computing Design Considerations
Mike Kavis
 
SQL Server High Availability Solutions (Pros & Cons)
Hamid J. Fard
 
Data preparation
Tony Nguyen
 
AWS Glue - let's get stuck in!
Chris Taylor
 
Azure Cosmos DB
Mohamed Tawfik
 
NOVA SQL User Group - Azure Synapse Analytics Overview - May 2020
Timothy McAliley
 
Microsoft Azure Security Overview
Alert Logic
 
A complete guide to azure storage
Himanshu Sahu
 
Introduction to Azure Cloud Storage
Ganga R Jaiswal
 
Ad

Viewers also liked (20)

PDF
MySQL Features
Great Wide Open
 
PPTX
Oracle mysql comparison
Arun Sharma
 
PPS
Introduction to Mysql
Tushar Chauhan
 
DOC
Oracle vs. MS SQL Server
Teresa Rothaar
 
PPTX
Oracle & sql server comparison 2
Mohsen B
 
PPTX
Oracle R12.1.2 and R12.1.3 features
ravisagaram
 
PDF
web programming UNIT VIII python by Bhavsingh Maloth
Bhavsingh Maloth
 
PPT
Linux
Hema Prasanth
 
PDF
Build and deploy scientific Python Applications
Ramakrishna Reddy
 
PDF
PythonIntro_pycon2010
Kannappan Sirchabesan
 
PDF
Tutorial on-python-programming
Chetan Giridhar
 
PPTX
MySQL database
lalit choudhary
 
PPT
Web 2 0 Ppt
Hema Prasanth
 
PPT
Php Ppt
Hema Prasanth
 
PPT
Mysql Ppt
Hema Prasanth
 
PPTX
Difference Between Sql - MySql and Oracle
Steve Johnson
 
PPT
Abstract of Library Management System
Md Mudassir
 
PPT
Linux basic commands
MohanKumar Palanichamy
 
PPTX
Mysql an introduction
Mohd yasin Karim
 
PPTX
MySQL DBA
lalit choudhary
 
MySQL Features
Great Wide Open
 
Oracle mysql comparison
Arun Sharma
 
Introduction to Mysql
Tushar Chauhan
 
Oracle vs. MS SQL Server
Teresa Rothaar
 
Oracle & sql server comparison 2
Mohsen B
 
Oracle R12.1.2 and R12.1.3 features
ravisagaram
 
web programming UNIT VIII python by Bhavsingh Maloth
Bhavsingh Maloth
 
Linux
Hema Prasanth
 
Build and deploy scientific Python Applications
Ramakrishna Reddy
 
PythonIntro_pycon2010
Kannappan Sirchabesan
 
Tutorial on-python-programming
Chetan Giridhar
 
MySQL database
lalit choudhary
 
Web 2 0 Ppt
Hema Prasanth
 
Php Ppt
Hema Prasanth
 
Mysql Ppt
Hema Prasanth
 
Difference Between Sql - MySql and Oracle
Steve Johnson
 
Abstract of Library Management System
Md Mudassir
 
Linux basic commands
MohanKumar Palanichamy
 
Mysql an introduction
Mohd yasin Karim
 
MySQL DBA
lalit choudhary
 
Ad

Similar to MySQL Features & Implementation (20)

PDF
02 -my_sql_roma-may2011
testfank
 
PPT
MySQL Strategy&Roadmap
slidethanks
 
PPT
My sqlstrategyroadmap
slidethanks
 
PDF
MySQL Enterprise Edition - Complete Guide (2019)
Keith Hollman
 
PDF
MySQL Enterprise Edition Overview
Mario Beck
 
PDF
MySQL 简要介绍
YUCHENG HU
 
PPT
My sql
Waseem Sakka
 
PDF
Seminar : &quot;The Future of MySQL - Roadmap to Success&quot; session MySQL ...
Software Park Thailand
 
PDF
20111121 osi keynote
OpenSourceIndia
 
PDF
MySQL - powering the web economy v1.0
IDG Romania
 
PDF
My sql roadmap 2008 2009
xKinAnx
 
PDF
Efficient Performance Analysis and Tuning with MySQL Enterprise Monitor
Mark Matthews
 
PDF
MySQL State of the Dolphin - Rich Mason
MySQL Brasil
 
PDF
Modern Data Security with MySQL
Vittorio Cioe
 
PDF
MySQL Enterprise Monitor
Mario Beck
 
ODP
MySQL Enterprise Portfolio
Abel Flórez
 
PPTX
MySQL enterprise edition
Mark Swarbrick
 
PDF
MySQL overview
Mark Swarbrick
 
PDF
MySQL for Oracle DBA -- Rocky Mountain Oracle User Group Training Days '15
Dave Stokes
 
PPT
MySQL 5.6 Updates
Dave Stokes
 
02 -my_sql_roma-may2011
testfank
 
MySQL Strategy&Roadmap
slidethanks
 
My sqlstrategyroadmap
slidethanks
 
MySQL Enterprise Edition - Complete Guide (2019)
Keith Hollman
 
MySQL Enterprise Edition Overview
Mario Beck
 
MySQL 简要介绍
YUCHENG HU
 
My sql
Waseem Sakka
 
Seminar : &quot;The Future of MySQL - Roadmap to Success&quot; session MySQL ...
Software Park Thailand
 
20111121 osi keynote
OpenSourceIndia
 
MySQL - powering the web economy v1.0
IDG Romania
 
My sql roadmap 2008 2009
xKinAnx
 
Efficient Performance Analysis and Tuning with MySQL Enterprise Monitor
Mark Matthews
 
MySQL State of the Dolphin - Rich Mason
MySQL Brasil
 
Modern Data Security with MySQL
Vittorio Cioe
 
MySQL Enterprise Monitor
Mario Beck
 
MySQL Enterprise Portfolio
Abel Flórez
 
MySQL enterprise edition
Mark Swarbrick
 
MySQL overview
Mark Swarbrick
 
MySQL for Oracle DBA -- Rocky Mountain Oracle User Group Training Days '15
Dave Stokes
 
MySQL 5.6 Updates
Dave Stokes
 

More from OSSCube (20)

PPTX
High Availability Using MySQL Group Replication
OSSCube
 
PPTX
Accelerate Your Digital Transformation Journey with Pimcore
OSSCube
 
PPTX
Migrating Legacy Applications to AWS Cloud: Strategies and Challenges
OSSCube
 
PPTX
Why Does Omnichannel Experience Matter to Your Customers
OSSCube
 
PPTX
Using MySQL Fabric for High Availability and Scaling Out
OSSCube
 
PPTX
Webinar: Five Ways a Technology Refresh Strategy Can Help Make Your Digital T...
OSSCube
 
PPTX
Cutting Through the Disruption
OSSCube
 
PPTX
Legacy to industry leader: a modernization case study
OSSCube
 
PPTX
Marketing and Sales together at last
OSSCube
 
PPTX
Using pim to maximize revenue and improve customer satisfaction
OSSCube
 
PPTX
Talend for the Enterprise
OSSCube
 
PPTX
Ahead of the Curve
OSSCube
 
PPTX
Non functional requirements. do we really care…?
OSSCube
 
PPTX
Learning from experience: Collaborative Journey towards CMMI
OSSCube
 
PPTX
Exploiting JXL using Selenium
OSSCube
 
PPTX
Introduction to AWS
OSSCube
 
PPTX
Maria DB Galera Cluster for High Availability
OSSCube
 
PDF
Talend Open Studio Introduction - OSSCamp 2014
OSSCube
 
PDF
Performance Testing Session - OSSCamp 2014
OSSCube
 
PDF
Job Queue Presentation - OSSCamp 2014
OSSCube
 
High Availability Using MySQL Group Replication
OSSCube
 
Accelerate Your Digital Transformation Journey with Pimcore
OSSCube
 
Migrating Legacy Applications to AWS Cloud: Strategies and Challenges
OSSCube
 
Why Does Omnichannel Experience Matter to Your Customers
OSSCube
 
Using MySQL Fabric for High Availability and Scaling Out
OSSCube
 
Webinar: Five Ways a Technology Refresh Strategy Can Help Make Your Digital T...
OSSCube
 
Cutting Through the Disruption
OSSCube
 
Legacy to industry leader: a modernization case study
OSSCube
 
Marketing and Sales together at last
OSSCube
 
Using pim to maximize revenue and improve customer satisfaction
OSSCube
 
Talend for the Enterprise
OSSCube
 
Ahead of the Curve
OSSCube
 
Non functional requirements. do we really care…?
OSSCube
 
Learning from experience: Collaborative Journey towards CMMI
OSSCube
 
Exploiting JXL using Selenium
OSSCube
 
Introduction to AWS
OSSCube
 
Maria DB Galera Cluster for High Availability
OSSCube
 
Talend Open Studio Introduction - OSSCamp 2014
OSSCube
 
Performance Testing Session - OSSCamp 2014
OSSCube
 
Job Queue Presentation - OSSCamp 2014
OSSCube
 

Recently uploaded (20)

PDF
SparkLabs Primer on Artificial Intelligence 2025
SparkLabs Group
 
PDF
Unlocking the Future- AI Agents Meet Oracle Database 23ai - AIOUG Yatra 2025.pdf
Sandesh Rao
 
PDF
Presentation about Hardware and Software in Computer
snehamodhawadiya
 
PDF
REPORT: Heating appliances market in Poland 2024
SPIUG
 
PDF
How-Cloud-Computing-Impacts-Businesses-in-2025-and-Beyond.pdf
Artjoker Software Development Company
 
PDF
Accelerating Oracle Database 23ai Troubleshooting with Oracle AHF Fleet Insig...
Sandesh Rao
 
PDF
How Open Source Changed My Career by abdelrahman ismail
a0m0rajab1
 
PPTX
New ThousandEyes Product Innovations: Cisco Live June 2025
ThousandEyes
 
PPT
Coupa-Kickoff-Meeting-Template presentai
annapureddyn
 
PPTX
OA presentation.pptx OA presentation.pptx
pateldhruv002338
 
PDF
Why Your AI & Cybersecurity Hiring Still Misses the Mark in 2025
Virtual Employee Pvt. Ltd.
 
PDF
Google I/O Extended 2025 Baku - all ppts
HusseinMalikMammadli
 
PDF
Best ERP System for Manufacturing in India | Elite Mindz
Elite Mindz
 
PDF
DevOps & Developer Experience Summer BBQ
AUGNYC
 
PDF
BLW VOCATIONAL TRAINING SUMMER INTERNSHIP REPORT
codernjn73
 
PDF
Software Development Methodologies in 2025
KodekX
 
PDF
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
PDF
Chapter 1 Introduction to CV and IP Lecture Note.pdf
Getnet Tigabie Askale -(GM)
 
PPTX
How to Build a Scalable Micro-Investing Platform in 2025 - A Founder’s Guide ...
Third Rock Techkno
 
PPTX
What-is-the-World-Wide-Web -- Introduction
tonifi9488
 
SparkLabs Primer on Artificial Intelligence 2025
SparkLabs Group
 
Unlocking the Future- AI Agents Meet Oracle Database 23ai - AIOUG Yatra 2025.pdf
Sandesh Rao
 
Presentation about Hardware and Software in Computer
snehamodhawadiya
 
REPORT: Heating appliances market in Poland 2024
SPIUG
 
How-Cloud-Computing-Impacts-Businesses-in-2025-and-Beyond.pdf
Artjoker Software Development Company
 
Accelerating Oracle Database 23ai Troubleshooting with Oracle AHF Fleet Insig...
Sandesh Rao
 
How Open Source Changed My Career by abdelrahman ismail
a0m0rajab1
 
New ThousandEyes Product Innovations: Cisco Live June 2025
ThousandEyes
 
Coupa-Kickoff-Meeting-Template presentai
annapureddyn
 
OA presentation.pptx OA presentation.pptx
pateldhruv002338
 
Why Your AI & Cybersecurity Hiring Still Misses the Mark in 2025
Virtual Employee Pvt. Ltd.
 
Google I/O Extended 2025 Baku - all ppts
HusseinMalikMammadli
 
Best ERP System for Manufacturing in India | Elite Mindz
Elite Mindz
 
DevOps & Developer Experience Summer BBQ
AUGNYC
 
BLW VOCATIONAL TRAINING SUMMER INTERNSHIP REPORT
codernjn73
 
Software Development Methodologies in 2025
KodekX
 
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
Chapter 1 Introduction to CV and IP Lecture Note.pdf
Getnet Tigabie Askale -(GM)
 
How to Build a Scalable Micro-Investing Platform in 2025 - A Founder’s Guide ...
Third Rock Techkno
 
What-is-the-World-Wide-Web -- Introduction
tonifi9488
 

MySQL Features & Implementation

  • 3. What we will discuss in next 1 hour • General Info. • MySql Enterprise • Other Features of MySQL > MySQL Network Monitoring and Advisory services > Backup and Recovery > Audit Trail > High Availability > Migration Tool Kit
  • 4. General Info - Overview of MySQL AB • Founded in 1995 • Operations in 24 countries • World’s Most Popular Open Source Database > Over 10 million installations > 50,000 downloads each day • Reduces TCO of database management > Reliable, high performance, easy to use • Bundled by over 100 software & hardware companies • Partners and Telecom Service Integrators HP, Dell, Novell, Red Hat, Unisys, Accenture, LogicaCMG, T-Systems and IPL
  • 5. Key Features • Written in C, C++ • Multilayered design with Independent modules • Fully multi-threaded using Kernel Threads • Provides Transactional and Non-transactional storage engines
  • 6. Key Features Cont… • In memory heap table support • Server available in client server model, or embedded DB. • Security and privilege management • Supports connection over SSL • Large database, large tables (default up to 256 TB)
  • 7. Key features contd… • Connectors for application connectivity • 64 Index per table, 1-16 columns per index • Built-in tools for query analysis and space analysis • Localization • Many more…
  • 8. What is MySQL Enterprise? MySQL Enterprise is the leading open source database solution behind today’s modern enterprise applications. It includes: • The MySQL Enterprise Server – the most reliable, secure, and up-to-date version of the world’s most popular open source database. • MySQL Network Monitoring and Advisory Services – services to ensure the maximum quality, uptime, and performance of MySQL Enterprise systems. • Production Support – around-the-clock support for the MySQL Enterprise server, along with consultative services and self-help knowledge aids. Designed for production use and web businesses / enteprise customers relying on MySQL for key business applications.
  • 9. MySQL Enterprise vs. Community Server Open Source Benefits from testing by worldwide Community Feature Releases Experimental Mature Monthly Rapid Update Service Pack Program Quarterly Service Pack Program Hot Fix Program Bug Escalation Privilege 24x7 Production Support Platform / Application / Training Certified Extended End-of-Life Policy Enterprise Installer and Configuration Manager Out-of-the-Box Configured for Enterprise use Monitoring and Advisory Service Automated Software Update and Alert Service Online Knowledge Base Extensive internal/external (Coverity, KLOCwork) testing Benchmarked with 2,000+ connections Legal indemnification
  • 10. What is the MySQL Community Server? The MySQL Community Server is the rapidly evolving, leading edge and non- commercially supported version of the MySQL server. • Leading edge: new and experimental features with every release. • Open source development and innovation. GPL license. • High community participation. Contributions encouraged! • Great for open source developers, technology enthusiasts, and those wanting to experiment and try out MySQL. • Serves as the foundation & proving ground for MySQL Enterprise. • No formal QA, support, or certifications Recommended for non-production applications and those wishing to try out MySQL. Supported by the large MySQL open source community.
  • 11. Other Features of MySQL • MySql Network Monitoring and Advisory services • Audit Trail • Backup and Recovery • High Availability – Replication and Clusters • Data migration from other RDBMS to MySQL
  • 12. MySQL Network Monitoring and Advisory Service • Single, consolidated view into entire MySQL environment • Customizable rules-based monitoring and alerts • Identifies problems before they occur • Reduces risk of downtime • Makes it easier to scale-out without requiring more DBAs “Virtual MySQL DBA” Assistant
  • 13. Top Features & Benefits Enterprise Dashboard Primary benefits • Provides “at a glance” view into health, security, availability and performance of all MySQL servers. • Saves DBA time writing, maintaining and monitoring scripts that collect, compile, and report similar metrics. • Assists DBAs in determining “where” and “how” to spend their limited time. Why it’s important • Makes it easy to scale-out on MySQL without adding more DBAs.
  • 14. Top Features & Benefits MySQL Network Advisors Security Schema Administration Performance Replication Custom • Protects MySQL • Helps DBA • Helps DBA • Makes •Makes • Allows customer Servers design better better manage suggestions for to create their • Uncovers databases database improving •Identifies own Advisor Security • Uncovers processes database speed collection loopholes • Suggests • Identifies • Provides for Security improvements potential custom best loopholes for smoother performance practice operations bottlenecks enforcement Each contains a set of Advisor Rules designed to enforce MySQL Best Practices for the specific Advisor category. Provide “Virtual MySQL DBA” expertise
  • 15. Top Features & Benefits MySQL Network Advisors and Rules Primary benefits • 100+ Advisor Rules proactively monitor 600+ MySQL and OS specific metrics for problems before they occur. • Extend DBA skill set to include MySQL expertise. • Find problems/tuning opportunities DBAs cannot find themselves. Why they are important • Reduce downtime and performance issues by identifying problems and corrective actions before costly outages occur. Provide “Virtual MySQL DBA” expertise
  • 16. Top Features & Benefits Customizable Monitors & Alerts Primary Benefits • Saves DBA time and effort by allowing DBAs to group and monitor many servers as single entity. • User defined Advisor rules allow for Enterprise specific monitoring and alerts. • Notifications (SMTP/SNMP) can be tailored for individual or group recipients. Why it’s important • Allows for customized SLAs across large MySQL deployments.
  • 17. Value Prop of MySQL Enterprise Gold Silver Silver + Basic + • Monitors and • Monitors all servers Optimizes Memory G • Proactive Usage Notifications • Replication • Expert Advice Monitoring Basic • Optimizes MySQL • Ensures proper r e m t s uC ot e u a V • Enterprise Server Configuration Replication • Ensures settings configuration •Ensures Performance l Uptime/Reliability • Ensures • Rapid Problem • Regular Service Packs Recoverability Resolution •Guards against • Self-help Support • Tightens Security • (Hot Fix builds) • Production Support • Extends Support •Optimizes/Tunes • Support! Support! • Custom o Queries • Database Design
  • 18. MySQL Network Monitoring and Advisory Service How it works Automated Data Collection Automated Data Collection “Query Cache Hit Rate” 600 + MySQL and OS specific metrics Data Evaluation • Metrics from all SHOW commands -Default or custom expression evaluation “Query Cache Has Sub-optimal Hit Rate” • Metrics from MySQL provided Thresholds scripts -Violation? “Query Cache Hit Ratio < 95%” • OS Metrics from SIGAR library Events and Alerts • MySQL/ OS Metrics from custom -Graphically seen in console scripts “Rule Violation Appears on Dashboard” Notifications -Requires notification? (SMTP/SNMP) “Notification Sent” Expert Advice and Assistance -Advice on alert/problem and how to fix it “Increase the query_cache_variable value” Specific User Action “Virtual MySQL DBA” - Problem resolved by user intervention
  • 19. MySQL Network Monitoring and Advisory Service Architecture MySQL AB Corporate Data Center Individual Enterprise Software Databases & Updates Advisor Rules Server Updates MySQL Enterprise Web Service Manager Browser Master-Slave Enterprise Dashboard Replication Profiles & Alerts Knowledge Base Production Support MySQL Enterprise Repository Multi-vendor Support, IP Protection Cluster
  • 20. MySql Backup • Dump or Raw Backup • On-line or Off-line • Table Types and Consistency • Storage Requirements • Replication
  • 21. Dump or Raw Backup • Dumps – Can be performed remotely – Take a lot of space – CPU intensive and slower – Are plain SQL, so easy to use later – Can do selective restore – Works for any table type • Raw Backups – Faster, there is no translation – Restore “instantly” – Works for ISAM/MyISAM only
  • 22. On-line or Off-line • On-line – May Impacts running applications (can’t write) – Must deal with data consistency issues – Slower than off-line because of I/O contention • Off-line – Very simple – Speed is not an issue – Can use normal backup software
  • 23. Table Types & Consistency • All tables need to flushed to disk – FLUSH TABLES • Tables can’t be updated during backup – LOCK TABLES... • Related tables treated as a group, lock all – FLUSH TABLES WITH READ LOCK • Transactional tables have logs to backup
  • 24. Storage Requirements • How long can you store backups? – Consider staggering older backups – Never know when you’ll want old data • Raw backups take less space – You can keep just the .MYI header – Rebuild indexes later if need be • All forms of backup can be compressed
  • 25. Replication • Backup your slave instead of your master – Master won’t be interrupted – Slave can probably be shut down – Or at least you can hold read locks for a long time and nobody will care • It may be worth setting up a slave just for doing backups • Remember to backup the master.info file
  • 26. Tools and Techniques • mysqldump • mysqlhotcopy • InnoDB on-line backup • Off-line backups • Filesystem snapshots • Roll your own
  • 27. mysqldump • Comes with MySQL • Dumps local or remote tables/databases • Variety of output formats • Handles locking if you need it • Works best for small and medium installations
  • 28. mysqlhotcopy • Comes with MySQL – Written by Tim Bunce of Perl DBI fame • Raw backups of MyISAM tables • Handles locking • Regular expression support – Match certain databases or tables • Can truncate indexes to save space
  • 29. mysqlsnapshot • Separate download – http://jeremy.zawodny.com/mysql/ • Used for setting up replication snapshots • Or backing up a running server • Always backs up everything – Either one big tar file or one per database • Very quick to restore
  • 30. InnoDB on-line Backup • Separate download – http://www.innodb.com/ • Costs extra $$$ • The only good solution for InnoDB backups without replication • Only does InnoDB tables
  • 31. Off-line Backups • Very easy • Hard to screw up • Use any backup tool you like – Just remember to backup all the MySQL stuff – You wouldn’t want compatibility problems after an upgrade • Restores can be quick
  • 32. Filesystem Snapshot • Most “expensive” solution • Need hardware/software support – Veritas, Network Appliance, LVM, EMC, etc. • Fastest option available • Uses least disk space • Doesn’t guard against all failures
  • 33. MySql Auditing • Various logs that help in auditing: • General Query Log • Binary Logs • Error Logs • Slow query log
  • 34. MySQL HA Solutions Overview • Introduction to MySQL • HA Terms and Concepts • HA Requirements and Considerations • HA Solutions from MySQL • Third-Party HA Solutions for MySQL • Additional HA Resources plus Q & A
  • 35. What is High Availability? • High Availability (HA) refers to the availability of resources in a computer system despite component failures • Two major categories > Customized/redundant software and hardware > Software-based solutions leveraging COTS components • Continuous Availability > Non-stop service > No disruption of service even during a fail over > Very high standard of availability, often unnecessary
  • 36. What is Replication? • The duplication of data to more then one location • The use of additional hardware or software for… > Availability > Reliability > Fault tolerance > Performance • Asynchronous vs. Synchronous > Safeguarding data loss • MySQL Replication > Statement vs Row-based Replication • Block-level Replication (DRBD)
  • 37. What is Replication? • The duplication of data changes to more than one location Asynchronous Replication update customer Synchronous Replication update customer
  • 38. What is Clustering? • Clusters are often used for: > Operating systems > Databases > Application servers > Load balancers > Web servers > Just about any “service” that needs to be highly available • Redundant nodes provide service when components fail • Eliminate single points of failure > Multiple network connections > Redundant data storage (SAN, RAID) • Shared-Nothing vs. Shared-Disk
  • 39. MySQL High Availability Solutions • MySQL Replication • MySQL Replication and Linux Heartbeat • MySQL, DRBD and Linux Heartbeat • MySQL Cluster • MySQL Cluster Carrier Grade Edition • MySQL w/ Shared-Storage & Clustering Agents • Other HA Solutions for MySQL
  • 40. MySQL Replication • Asynchronous Requirements Support > Statement Availability > Row-based (5.1) Automated IP Fail Over No > Mixed (5.1) Automated DB Fail Over No • Read vs. Write Typical Fail Over Time Varies > Response times Resynchronization of Data No > Load balancing Geographic Redundancy Yes > Scale Out Scalability • Administration Built-in Load Balancing Scale-Out > Backups Read Intensive Yes > Upgrades Write Intensive No > Testing Dozens for • # of Nodes Geographic Redundancy Reads
  • 41. MySQL Replication Topologies Master > Slave Master > Slaves Masters > Slave (Multi-Source) Master > Slave > Slaves Circular (Multi-Master) Master < > Master (Multi-Master)
  • 42. Inside MySQL Replication Writes & Reads Web/App Server Writes relay binlog mysqld I/O SQL Thread Thread index & binlogs data Replication binlog data mysqld MySQL Master MySQL Slave
  • 43. MySQL Replication - Scale Out • Write to one master • Read from many slaves • Perfect for read intensive apps Load Balancer Writes & Reads Reads Reads MySQL Replication
  • 44. MySQL, Heartbeat & DRBD Cluster IP Management Active Passive DRBD DRBD Server Server Synchronous Block Replication
  • 45. Managing Failures IP Management Passive X Active DRBD DRBD Server Server X X X
  • 46. Data Resynchronization after Host Failure IP Management Passive Active DRBD DRBD Server Server Resynchronization Active Server is still able to process transactions during a resynchronization operation
  • 47. DRBD Basics • When the failed node comes up > Becomes a secondary node > Must synchronize its data to the primary > Synching happens in the background without service interruption > Only the parts of the device which have changed since the failure will be resynchronized. • Total resynchronization in just several minutes > Regardless of device size > Even after the hard crash of an active node > Resynch rates may be configured per device • Device sizes currently limited to 4 TB
  • 48. MySQL Cluster • Requirements Support In-Memory Database > Disk Data (5.1) Availability • Shared-nothing storage Automated IP Fail Over No • Synchronous replication Automated DB Fail Over Yes • Fast-automatic data fail over Typical Fail Over Time < 3 Secs • High performance Resynchronization of Data Yes > NDB API Yes • No special hardware Geographic Redundancy (w/ Replication) • Best for primary key lookups Scalability • Transactional Load Balancing Scale-Out • Online backup Read Intensive Yes (Look ups) Write Intensive Yes 5.0: 64 # of Nodes 5.1: 255
  • 49. MySQL Cluster Carrier Grade Edition • An advanced version of MySQL Cluster for the telecom industry • Ideally suited for the telecom industry's top carriers, operators and equipment manufactures • Used by industry leaders for real-time, scalable data management
  • 50. MySQL Cluster Carrier Grade Edition Characteristic Benefits • Separate development tree from MySQL Server Stability • Permits prioritized bug fixes & enhancements for customers • Developed & tested with major TEMs Quality & Reliability • Stricter patch and bug acceptance • Backup and restore status/monitoring • Support for larger clusters, up to 255 Nodes • Optimizations to communication protocol enabling API to Data Node over WAN • Circular replication support Scalability • Batched slave replication • Support for user-defined partitioning • Multiple connections to NDB from a single MySQL Server • Optimizations to communication protocol enabling API to Data Node over WAN • More efficient Client/Server data handling and transfers Performance • Other optimizations (Memory, BLOBs, Disk-based data, etc.) • Micro Global Checkpoints • Setting threads to real-time priority • Online Add Column • Support for mixed (x86, SPARC, PowerPC) environments Adaptability • Time-stamp based conflict detection/resolution support in replication • Locking threads to a CPU
  • 51. MySQL Cluster System Requirements System Component Requirement Hosts Maximum of 255 total nodes (48 Data Nodes) COTS – Advanced TCA Hardware 32 & 64-bit x86, PowerPC & SPARC Memory Varies on size of database, # of hosts, # of replicas Shared-Nothing - Memory & Disk Data Storage SCSI or RAID for I/O performance 100 Mbps or better Network (Gigabit recommended, SCI supported) Operating System Linux (Red Hat, SuSE), Solaris, HP-UX, Mac OSX, others…
  • 52. Cluster Components • Standard SQL Interface SQL Node • Scale-out for Performance (MySQL) • Enables Replication • High Performance NDB API • C++ API (Application) • Developer’s Guide • Data Storage (Memory/Disk) • Automatic & User-Defined Partitioning Data Node (NDB Storage Engine) • Local & Global Checkpoints • Scale-out for Capacity & Redundancy • Configuration Management • Arbitration Node • Use Two for Redundancy
  • 53. 2 Data Node MySQL Cluster Clients Application/SQL Nodes (NDB API and/or MySQL Server) Management Nodes Data Nodes NDB Storage Engine
  • 54. 4 Data Node MySQL Cluster Clients Application/SQL Nodes (NDB API and/or MySQL Server) Management Nodes Data Nodes NDB Storage Engine
  • 55. Cluster uses Synchronous Replication Update: UPDATE author Two-phase SET country = ‘Cuba’ commit protocol WHERE authid = 2; Node Group authid (PK) fname lname country authid (PK) fname lname country 1 Albert Camus France 1 Albert Camus France 2 Ernest Hemingway Cuba 2 Ernest Hemingway Cuba 3 Johan Goethe Germany 3 Johan Goethe Germany 4 Junichiro Tanizaki Japan 4 Junichiro Tanizaki Japan
  • 56. Geographic Redundancy • As of 5.1, support for asynchronous replication between Clusters • Enables a higher degree of availability and continuity Asynchronous MySQL Replication NDB API NDB API NDB Storage Engine NDB Storage Engine Cluster 1 Cluster 2
  • 57. Distribution & Partitioning: 4 Data Nodes Four Data Nodes (Physical) authid (PK) fname lname country * Half of database on each node 1 Albert Camus France 2 Ernest Hemingway USA Two Replicas (Logical) * Two copies of each partition 3 Johan Goethe Germany 4 Junichiro Tanizaki Japan Two Node Groups * Two sets of identical Data Nodes Node Group 1 Node Group 2 authid (PK) fname lname country authid (PK) fname lname country 1 Albert Camus France 2 Ernest Hemingway USA 3 Johan Goethe Germany 4 Junichiro Tanizaki Japan
  • 58. Distribution & Partitioning: 4 Data Nodes Query: SELECT fname, lname FROM author The query can only be satisfied by a WHERE authid = 2; Data Node belonging to Node Group 2 Result: because the data is not stored within Node Group 1 Ernest Hemingway Node Group 1 Node Group 2 authid (PK) fname lname country authid (PK) fname lname country 1 Albert Camus France 2 Ernest Hemingway USA 3 Johan Goethe Germany 4 Junichiro Tanizaki Japan
  • 59. Distribution & Partitioning: 4 Data Nodes Query: SELECT fname, lname FROM author In a four node cluster, even if we WHERE authid BETWEEN 1 AND 3; loose a Data Node in each Node Result: Group, we can still satisfy any query Albert Camus Ernest Hemingway Johan Goethe Node Group 1 Node Group 2 authid (PK) fname X lname country X authid (PK) fname lname country 1 Albert Camus France 2 Ernest Hemingway USA 3 Johan Goethe Germany 4 Junichiro Tanizaki Japan
  • 60. Data Node Failure & Recovery • Server 3 failure is detected • Server 4 handles Server 3 requests 1 2 3 4 Node Group 1 Node Group 2
  • 61. Data Node Failure & Recovery • Server 3 begins copying data from Server 4 • Complete or just changes since failure 1 2 3 4 Node Group 1 Node Group 2
  • 62. Data Node Failure & Recovery • Once data is fully restored, Server 3 rejoins the cluster 1 2 3 4 Node Group 1 Node Group 2
  • 63. Network Partitioning – Avoiding “Split Brain” • By default, the Management Node acts as arbitrator • In the event of a network failure, arbitration determines which set of nodes should continue while shutting down the rest NDB API Application Nodes (NDB API and/or MySQL Server) Management Nodes Data Nodes X
  • 64. MySQL MySQL Replication MySQL, Heartbeat Requirements MySQL Cluster Replication + Heartbeat + DRBD Availability Automated IP Fail Over No Yes Yes No Automated DB Fail Over No No Yes Yes Typical Fail Over Time Varies Varies < 30 secs < 3 secs Auto Resynch of Data No No Yes Yes Geographic Redundancy Yes Yes MySQL Replication MySQL Replication Scalability MySQL Built-in Load Balancing MySQL Replication MySQL Replication Yes Replication Read Intensive Yes Yes MySQL Replication Yes Write Intensive No No If configured correctly Yes # of Nodes per Cluster Master/Slave(s) Master/Slave(s) Active/Passive 255 # of Slaves Dozens for Reads Dozens for Reads Dozens for Reads Dozens for Reads
  • 65. MySQL Migration Toolkit • Wizard Interface. Supports... • Oracle • Microsoft SQL Server • Microsoft Access • Sybase • MySQL
  • 67. Thank you for your Time and Attention! For more information visit http://www.osscube.com Or drop-in an email to [email protected]

Editor's Notes

  • #13: Point to make: MySQL Monitoring &amp; Advisor Service = “Virtual MySQL DBA” There are 3 main features, each with business rewarding features…
  • #14: Points to make: Enterprise Dashboard – global view of health, security, availability and performance of all MySQL servers. Heat chart – first two columns show up/down status of MySQL server. That one feature alone will save most DBAs at least 20 minutes a day. The Enterprise dashboard helps a DBA find the needle BEFORE they get to the haystack.
  • #15: Points to make: MySQL Advisors are “areas of concern” categories for all DBAs. MySQL Advisors are comprised of MySQL Advisor Rules that are designed to enforce MySQL best practices. MySQL Advisors provide “Virtual MySQL DBA” expertise!
  • #16: Points to make: MySQL Advisor rules provide immediate ROI as they go to work as soon as they are scheduled to find and report on problems and performance tuning opportunities. There is no “warm” up period; DBAs beginning receiving expert advice on improving them systems immediately. The simplest MySQL Advisor rule would take even the most skilled MySQL DBA several hours at best to research, code, test, debug, and schedule. Then they have to factor in the time to maintain and monitor. With MySQL Network, the most complex rule can be implemented and set to monitor MANY MySQL servers in less than 1 minute.
  • #17: Points to make: DBAs can set different SLAs, alerts and notifications for specific groups of servers (Example: Prod vs Dev). Alerts and notifications can be set at application, criticality, responsibility, etc. levels.
  • #18: Give examples of concrete applications looking at different 9’s Real life application Order management, ecommerce.
  • #36: According to the Institute of Electrical and Electronics Engineers (IEEE), High availability (HA) refers to the availability of resources in a computer system, in the wake of component failures within the system. This can be achieved leveraging a variety of strategies. They may range from solutions that utilize customized and redundant hardware, to software solutions using commercial off-the-shelf (COTS) hardware components. Customized solutions typically provide a higher degree of availability, but are significantly more expensive to deploy and maintain. This fact has led to the growth of software solutions which leverage COTS hardware. The solutions presented in this paper will focus on achieving MySQL high availability using the latter strategy.