AlexMcDonald PNFS NFSv43
AlexMcDonald PNFS NFSv43
AlexMcDonald PNFS NFSv43
Abstract
pNFS & NFSv4.2; a filesystem for grid, virtualization
and database
This session will appeal to Virtual Data Center Managers,
Database Server administrators, and those that are seeking
a fundamental understanding pNFS. This session will cover
the four key reasons to start working with NFSv4 today,
and explain the storage layouts for parallel NFS; NFSv4.1
and the upcoming NFSv4.2 standard. The session includes
use cases for database access, enterprise and desktop
virtualization, including deduplication options.
Tutorial Agenda
Introduction to NFS and NFS Special Interest Group
NFS v4 Security, High Availability,
Internationalization and Performance (SHIP)
pNFS Layout Overview
Files based access
Block based access
Object based access
Background Information
Network File System
Protocol to make data stored on file servers available to
any computer on a network
NFS clients are included in all commonly used Operating
Systems, e.g. Linux, Solaris, AIX, Windows etc..
Application and OSI layers (remote procedure calls)
2000
2010?
Future
Market
Adoption
Cycles
DirectAttached
Storage
Networked
Storage
Evolving Requirements
Economic Trends
Performance
Results in Limitations
Islands of storage
Server and Appliance HW
Networking and I/O
10
10
2000
2010
2020
Future
NFSv4.1
Parallel NFS
NFSv4.2
Market
Adoption
Cycles
DirectAttached
Storage
Networked
Storage
Scale-Out
Storage
11
NFS
Hosts
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
12
12
High
availability
International
characters
Performance
Business Benefit
13
14
pNFS protocol
Standardized: NFSv4.1
Storage-access protocol
Files (NFSv4.1)
Block (iSCSI, FCP)
Object (OSD2)
Control protocol
pNFS
protocol
Storage-access
protocol
Metadata
Server
Control
protocol
Data Servers
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
15
pNFS Operations
GETDEVICEINFO
GETDEVICELIST
Clients requests the list of all data servers participating in the storage
cluster
LAYOUTGET
LAYOUTCOMMIT
LAYOUTRETURN
CB_LAYOUT
Server recalls the data layout from a client; if conflicts are detected
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
16
16
Mount, Open
& Get layout
File Handle
R/W Request
Issued in
parallel
Control
protocol
Data
Servers
17
17
pNFS
Protocol
Storage Access
Protocol SCSI
Control
protocol
Data
Servers
18
18
pNFS
Protocol
Storage Access
Protocol iSCSI
OSD
Control
protocol
Data
Servers
19
19
Full read and write support for all three layout types in the
upstream kernel,
O_DIRECT reads and writes are not yet supported.
Technical preview" support for NFSv4.1 and for the pNFS files layout
type
Microsoft NFSv4.1
Windows
client
from
CITIand database
pNFS
& NFSv4.2; a filesystem
for grid,
virtualization
20
21
22
IO_ADVISE
Client or appl inform the server of the expected
caching requirements of the file
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
23
FCoE
NFS
pNFS
iSCSI /NFS
FC Network
iSCSI / FC
pNFS
pNFS
Server
Storage
Heads
24
...
FCoE
NFS
iSCSI /NFS
FC Network
iSCSI / FC
Storage
Heads
pNFS
Server
25
VM
DB
Cluster Datastore
Mount Server:/
Name Space
/
VM
...
pNFS
Server
DB
HV1
HV2
Srv1 Srv2
Srv3
26
Striped Volume
Striped Volume
pNFS
Server
Name Space
/
VM
HV1
HV2
...
HyperVisor Cluster Nodes
DB
Srv1
Srv2
Srv3
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
27
pNFS
Server
Name Space
/
VM
...
HyperVisor Cluster Nodes
HV1
DB
Srv1
HV1
HV2
Srv1
Srv2
Srv2
HV2
Srv3
Srv3
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
28
VM Cluster Datastore
Cluster Datastore
Mount Server:/
Name Space
/
VM
...
HyperVisor Cluster Nodes
HV1
DB
Srv1
HV1
HV2
Srv1
pNFS
Server
Srv2
Srv2
HV2
Srv3
Srv3
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
29
VM
Cluster Datastore
Mount Server:/
Name Space
/
VM
...
HyperVisor Cluster Nodes
HV1
DB
Srv1
HV1
HV2
Srv1
pNFS
Server
Srv2
Srv2
HV2
Srv3
Srv3
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
30
NFSv4.1 Trunking/Sessions
connection
Open sessions
w/connection
Trunking
31
VM
Cluster Datastore
Mount Server:/
Name Space
/
VM
...
HyperVisor Cluster Nodes
HV1
DB
Srv1
HV1
HV2
Srv1
pNFS
Server
Srv2
Srv2
HV2
Srv3
Srv3
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
32
pNFS
Server
Srv2
HV1
Name Space
Srv1
/
VM
HV1
HV2
DB
Srv1
Srv2
Srv3
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
33
pNFS
Server
Srv2
HV1
Name Space
Srv1
/
VM
HV1
HV2
DB
Srv1
Srv2
Srv3
34
DB
Cluster Datastore
Mount Server:/
Name Space
/
VM
...
HyperVisor Cluster Nodes
HV1
DB
Srv1
HV1
HV2
Srv1
pNFS
Server
Srv2
Srv2
HV2
Srv3
Srv3
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
35
Name Space
DB
pNFS
Server
/
VM
Srv2
HV1
DB
Srv1
HV1
HV2
Srv1
Srv2
Srv3
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
36
DB (Replica)
DB
Non-disruptive data
moves using storage
control protocols
Name Space
/
VM
...
HyperVisor Cluster Nodes
HV1
DB
Srv1
HV1
HV2
Srv1
pNFS
Server
Srv2
Srv2
HV2
Srv3
Srv3
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
37
DB (Replica)
DB
pNFS
Server
Name Space
...
/
VM
DB
Srv1
HV1
HV2
Srv1
Srv2
Srv2
HV2
Srv3
Srv3
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
38
VM
DB
Cluster Datastore
Mount Server:/
Name Space
/
VM
...
HyperVisor Cluster Nodes
HV1
DB
Srv1
HV1
HV2
Srv1
pNFS
Server
Srv2
Srv2
HV2
Srv3
Srv3
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
39
Summary/Call to Action
pNFS is the first open standard for parallel I/O
across the network
Ask vendors to include NFSv4.1 support for client/servers
40
Q&A / Feedback
Please send any questions or comments on this
presentation to SNIA: [email protected]
Many thanks to the following
individuals for their
contributions to this tutorial.
Peter Honeyman
Brent Welch
David Black
Piyush Shivam
Mark Carlson
Andy Adamson
Pranoop Ersani
Ricardo Labiaga
Tom Haynes
41
Backup slides.
http://wiki.linux-nfs.org/wiki/index.php/Main_Page
NFS Version 4.1
http://tools.ietf.org/html/
pNFS Problem Statement
http://www.citi.umich.edu/projects/asci/pnfs/linux
pNFS & NFSv4.2; a filesystem for grid, virtualization and database
2011 Storage Networking Industry Association. All Rights Reserved.
42