0% found this document useful (0 votes)
108 views31 pages

The EMC Isilon Story

Big Data In The Enterprise

Uploaded by

Yowan Solomun
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
108 views31 pages

The EMC Isilon Story

Big Data In The Enterprise

Uploaded by

Yowan Solomun
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 31

THE EMC

ISILON STORY
Big Data In The Enterprise
2012

Copyright 2012 EMC Corporation. All rights reserved.

Big Data In The Enterprise


Isilon Overview
Isilon Technology
Summary

Copyright 2012 EMC Corporation. All rights reserved.

What is
Big Data?

Copyright 2012 EMC Corporation. All rights reserved.

The Big Data Challenge


File Shares
90
and Archives

Bioinformatics

Financial
Services

Design and
Simulation

Media &
Entertainment

Oil and Gas

80
70

EXABYTES

60
50
40
30
20
10
0

2009

2010

2011

File Based: 61.8% CAGR

2012

2013

2014

Block Based: 23.7% CAGR

By 2013, 80% of all storage capacity sold will be for file-based data
Source: IDC Whitepaper June 2011 Scale Out Storage In the Content Driven Enterprise: Unleashing the Value of Information Assets
referencing IDC's 2010 Enterprise Disk Storage Consumption Model

Copyright 2012 EMC Corporation. All rights reserved.

CIOs Turning To Scale-Out To Deal With


Massive File-Data Growth
THE #1 AND #2 CONCERNS
OF CIOS

ARE DRIVING ADOPTION


OF SCALE-OUT!

Data Growth

47%
System Performance
& Scalability

37%

CIO Study October 2010: Key Trends Shaping the


Future of Data Center Infrastructure Through 2011

Copyright 2012 EMC Corporation. All rights reserved.

Already using
or planning to
use scale-out
within the next
24 months

Scale-out NAS Market Survey, November, 2010

Big Data In The Enterprise


Isilon Overview
Isilon Technology
Summary

Copyright 2012 EMC Corporation. All rights reserved.

EMC Isilon

Setting The Standard For Scale-Out NAS

Broad adoption in many markets


Corporate IT
Commercial HPC

Over 3,000 global customers


100% Y/Y growth rate
EMC #1 NAS market (Gartner 2012)

OneFS Software
6th generation, industry-proven,
innovative scale-out operating
environment

Copyright 2012 EMC Corporation. All rights reserved.

EMC Isilon Scale-Out Innovation


Single Storage Pool For Application Consolidation
Simple to Scale
Manage 15+ PBs like 1 TB drive

Predictable Performance
Grows linearly

Efficient to Operate
Maximize utilization to 80%+
Automate tiering

Available Always
Survives multiple failures

Enterprise Proven
Management and protection
tools customers expect

No Data Migrations

Copyright 2012 EMC Corporation. All rights reserved.

EMC Isilon

Ease of Use And Management

IDC: Isilon Improves IT Productivity by 48%, Reduces OPEX*


*Results of an IDC Business Value Strategy Analysis - 28 November 2011

Copyright 2012 EMC Corporation. All rights reserved.

EMC Isilon Customers

Reduced Big Data Storage Costs by 40%


Average Annual Cost Per TB in Use
$2,500

$2,000

$1,500

$1,000

$500

$0

Traditional
OPEX IT Staff

Isilon
CAPEX

Source: IDC Whitepaper Quantifying the Business Benefits of Scale-Out. October 2011

Copyright 2012 EMC Corporation. All rights reserved.

10

Big Data Apps Need Big Data Storage


Traditional Isilon Workflows

Medical Imaging

Gene Sequencing

Seismic Exploration

Media & Entertainment

Satellite Images

Product Development

Copyright 2012 EMC Corporation. All rights reserved.

11

Enterprise IT Needs Big Storage


Enterprise IT Workloads

LARGE-SCALE HOME DIRECTORIES

LARGE-SCALE ARCHIVES

LARGE-SCALE VIRTUALIZATION

LARGE-SCALE ANALYTICS

Copyright 2012 EMC Corporation. All rights reserved.

12

EMC Isilon Growing Momentum


3000+ Customers

Copyright 2012 EMC Corporation. All rights reserved.

13

Big Data In The Enterprise


Isilon Overview
Isilon Technology
Summary

Copyright 2012 EMC Corporation. All rights reserved.

14

EMC Isilon Scale-Out NAS Architecture


NFS

CIFS

HTTP

FTP

HDFS
for
Hadoop

Servers

Servers

Client/Application Layer

Copyright 2012 EMC Corporation. All rights reserved.

Ethernet Layer

Single FS/Volume

Servers

OneFS Operating
Environment

Intra-cluster
Communication Layer

15

EMC Isilon Core Innovation


OneFS Scale-Out Operating System

Single Filesystem

High Performance

Multi-Tier

Single volume for


management simplicity

Over 100 GB aggregate


throughput

Auto-tiering and
AutoBalance

80%+ Efficiency

Easy Growth

Linear Scalability

Scale in <60 Seconds


with no downtime

Scale performance and


capacity up to 15.5 PBs

Industry-leading raw
storage utilization

Copyright 2012 EMC Corporation. All rights reserved.

16

EMC Isilon

Scale-Out NAS Product Family


S-Series

Purpose-built for IOPSintensive, random access


file-based applications

Linear Scaling of Performance & Capacity

X-Series

A flexible solution to
accelerate highconcurrent and sequential
throughput applications

NL-Series

Purpose-built for
cost-effective, large
capacity storage

Copyright 2012 EMC Corporation. All rights reserved.

17

Isilon, Scale-Out NAS for Big Data

Single File System, Single Volume Simplicity For Active,


Persistent, And Archive Data
Virtualized
Servers

Quota
management

X-series

High speed replication


Disaster recovery

Thin provisioning

Backup
Accelerator

Business continuance

Virtualized Servers
File immutability

Network

S-series

WAN/LAN

Protection from
deletion/change

Clients
NL-series
Load balancing

Instant recovery

Seamless failover

Data protection

Performance zones

Client/Application
Layer

Automated
storage tiering

Copyright 2012 EMC Corporation. All rights reserved.

NL-series

Primary &
Nearline Storage

Local/Remote
Archive

18

Comprehensive Enterprise Software


DATA PROTECTION
INNOVATIONS

DATA MANAGEMENT
INNOVATIONS

Snapshot IQ

SmartPools

SyncIQ

SmartQuotas

SmartConnect

Insight IQ

SmartLock

Isilon for vCenter

Unlimited and flexible snapshots


Fast and flexible asynchronous
replication
Policy-based client failover with load
balancing
Policy based immutability

Backup Accelerator

Policy based automated tiering


Quota management and thin
provisioning
Analytics platform to maximize
performance and resource utilization
VMware integrated management
features

Scalable backup to tape

Copyright 2012 EMC Corporation. All rights reserved.

19

EMC Isilon Storage Efficiency


Single volume spans all nodes

EFFICIENCY

Directories and files striped across


the cluster

Auto-balance capacity and


performance
Automation:
NO manual intervention
NO reconfiguration
NO server or client mount point or
application changes

Storage efficiency inherently


optimized at 80+%

Copyright 2012 EMC Corporation. All rights reserved.

20

SPECsfs2008 CIFS Performance


Aggregate Vendor Performance

ISILON
RECORD-BREAKING
PERFORMANCE

June 27, 2011, http://www.spec.org/sfs2008/results/sfs2008cifs.html

Copyright 2012 EMC Corporation. All rights reserved.

21

SPECsfs2008

Linear, Predictable Scalability

Predictable SLAs

Copyright 2012 EMC Corporation. All rights reserved.

22

Largest & Most Scalable File System


More Scalable than Traditional Storage Systems

OneFS Scales From 18 TB To Over 15.5 PB In A Single


File System, Single Volume
Under 60 seconds to scale with no downtime
Worlds fastest performance and capacity scaling

Copyright 2012 EMC Corporation. All rights reserved.

23

Gain New Levels of Efficiency


AutoBalance
BALANCED
EMPTY
FULL
BALANCED
EMPTY
FULL
BALANCED
EMPTY
FULL
BALANCED
EMPTY
FULL
BALANCED
EMPTY

Copyright 2012 EMC Corporation. All rights reserved.

Automated data balancing across


nodes reduces costs, complexity
and risks for scaling storage

AutoBalance migrates
content to new storage
nodes while system is online
and in production
NO manual intervention,
NO reconfiguration, and
NO server or client mount
point or application changes
Eliminates Hot Spots

24

Unmatched Protection & Availability


Built-In High Availability Clustered Architecture

With N+2,
N+3, and
N+1 protection,
N+4
protection,
Data Is
100% Available
data
available
Even is
If 100%
A Single
Drive
if
drives or
Ormultiple
Node Fails
nodes fail

100%
100%
FAILED

100%
100%
100%

And Isilon Offers The


Industrys Fastest Drive
Rebuild Times
In about 2-3 Hours!

Copyright 2012 EMC Corporation. All rights reserved.

100%
100%
FAILED

100%

25

Powerful, Flexible, & Scalable Backup


& Disaster Recovery
SyncIQ Replication
Architecture
Sync IQ benefits:

Disaster recovery
Business continuance
Disk to disk backup
Remote archive

Block efficient, file


specific
Scales with cluster
Leverages SnapshotIQ
Per-directory policies and
granularity
Unlimited snapshots per
cluster
Minimal performance
impact
Allows tiered snapshots

Copyright 2012 EMC Corporation. All rights reserved.

26

Optimize Resources With


SmartPools Automated Tiering
I/Ops

MB/s

Archive

Reduced cost/TB

Innovation
Single point of management
Single file system
Single volume
Tiers of performance

Automatic data movement

I/Ops

I/Ops

I/Ops

I/Ops

NL Archive
Throughput
NL Archive
Throughput
NL Archive
Throughput
NL Archive
Throughput
Throughput
Throughput

NL Archive

NL Archive

Copyright 2012 EMC Corporation. All rights reserved.

Policy-based movement
Transparent reallocation
NO application-changes

Investment protection

Eliminate data migration


Scale any application
Completely transparent
Pay as you grow

27

Industrys First & Only Scale-Out Storage


Solution With Native Hadoop Integration
Accelerate the Benefits of Hadoop for the Enterprise
Proven Hadoop solution, faster implementation
Greater interoperability with enterprise applications through
multi-protocol parallel access from any client (NFS, CIFS, and
HDFS)

Reduce Risk
Eliminates Hadoop Name Node single point of failure

Enterprise data protection


Fast backup and recovery
Simple, reliable data replication for disaster recovery

Ultimate Flexibility
Scale compute and storage separately

EMC Innovation
Worlds 1st scale-out storage solution with native HDFS integration

Copyright 2012 EMC Corporation. All rights reserved.

28

Big Data In The Enterprise


Isilon Overview
Isilon Technology
Summary

Copyright 2012 EMC Corporation. All rights reserved.

29

EMC Isilon Scale-Out NAS


Value to Customers

Scales to over 15 PB in a single file system


Over 100 GB/s throughput, 1.6M SPECsfs Ops
>80% storage utilization, and automated storage tiering
Efficient backup & recovery, reliable disaster recovery, and WORM data
retention, N+1 thru N+4 redundancy
Single file system, single volume, global namespace
Integrated support for a wide range of industry-standard protocols
including NFS, SMB, HTTP, FTP, iSCSI and HDFS

Copyright 2012 EMC Corporation. All rights reserved.

30

You might also like