Technical Presentation

​FabricPool in ONTAP 9.12.1

John Lantz
Senior Technical Marketing Engineer
March 2023

1 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

 Value prop

2 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Modernize Your Data Center
What Is FabricPool?

Performance Workloads Inactive/Cold Data

on High-Performance Flash Aggregates Moves to the Cloud

All Flash Cloud

FabricPool
Combines performance and cloud tier
into one storage pool that manages data seamlessly
and reduces the total cost of ownership
3 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
The FabricPool Solution
What Is FabricPool?

Automatic tiering

Zero-touch management
On-Premises Footprint
Preserves file system
FabricPool
Lower cost of ownership

Local Tier
Cloud Tier
80% Inactive
Data

Object Storage
Before After
Active Data Inactive Data
4 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
End-to-End Security
What Is FabricPool?

Local Tier Over the Wire Cloud Tier

 NetApp® Volume Encryption (NVE)  TLS 1.2  Client-side encryption (NVE)

 NetApp Storage Encryption (NSE)  AES-256 encryption  Server-side encryption

 AES-256 encryption  AES-256 encryption

5 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Storage Efficiency
What Is FabricPool?

 Compression
 Deduplication
 Compaction

 Efficiencies carry over to the cloud tier

6 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Total Cost of Ownership
What Is FabricPool?

 www.evaluatorgroup.com/FabricPool/

 Capacity
 Growth
 Snapshots
 Cold data
 Multi-year TCO

7 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Big Picture
What Is FabricPool?

Local
Hybrid Cloud
Tier Smart Economics
Transparent to existing
On Premises TCO savings applications

Cloud
Tier
Simple Data Security
Public Cloud Private Cloud
Quick setup On premises
Little policy Over the wire
management Cloud

8 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

 Use cases

9 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

FabricPool with Primary Data

Before
• All flash or hybrid with solid-state drive (SSD)
Primary Cluster aggregates

• 10% used by NetApp® Snapshot™ copies

• Conservative use of Snapshot copies

• Inefficient use of flash

Provisioned storage
Active data

Snapshot copies
Inactive data

10 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

FabricPool with Primary Data
Snapshot-Only Volume Tiering Policy

Before After • Snapshot-Only volume tiering policy

Primary Cluster Primary Cluster
• Optimized use of solid-state drive (SSD)

• Increase number of NetApp® Snapshot copies

(1,023 maximum)

• snapshot show

Provisioned storage
Active data

Snapshot copies S3
Inactive data

11 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

FabricPool with Primary Data
Auto Volume Tiering Policy

Before After • Auto volume tiering policy tiers all inactive (cold)
Primary Cluster Primary Cluster blocks

• 31-day default cooling period

• Adjustable cooling period

(2 to 183 days)

Provisioned storage
• -tiering-minimum-cooling-days
Active data

Snapshot™ copies S3
Inactive data

12 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

FabricPool with Secondary Data
Data Protection Without Tiering

Primary Cluster Secondary Cluster  Data protection volumes

 DR (SnapMirror)
 Backup (SnapVault)

NetApp®  > 1:1 ratio

SnapMirror®

 Most data is inactive

 Power
 Cooling
NetApp
SnapVault®  Maintenance
 Rack space

Provisioned storage
Active data

Inactive data

13 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

FabricPool with Secondary Data
All Volume Tiering Policy

Primary Cluster Secondary Cluster

 Reduce footprint

 Expand capacity
NetApp®
SnapMirror®

 No change to data
management
NetApp
SnapVault®

Provisioned storage
Active data
S3
Inactive data

14 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

FabricPool with Secondary Data
All Volume Tiering Policy

Primary Cluster Secondary Cluster  Sizing

 Metadata (~5%)
 Hot data

NetApp®
SnapMirror®  Limits
 Tiering stops when aggregate
reaches 98% capacity or tiers 16PB

NetApp
SnapVault®  392TB local + 7.8PB cloud
 400TB aggr
Provisioned storage  @5% metadata usage
Active data
S3
Inactive data

15 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Technical content

16 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Agenda slide
• What’s new in NetApp® ONTAP® 9.12.1?

• How does FabricPool work?

• Requirements

• Configuration

• Best practices

• Key takeaways

17 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

What’s New in ONTAP 9.12.1?

18 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

• SVM Migrate support for FabricPool

• FabricPool + FlexGroup + SVM-DR

19 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

SVM Migrate support for FabricPool
ONTAP 9.12.1

 Beginning in ONTAP 9.12.1, SVM Migrate is supported on FabricPool aggregates.

 First available in ONTAP 9.10.1, SVM Migrate allows cluster administrators can non-disruptively relocate an
SVM from a source cluster to a destination cluster to manage capacity and load balancing, or to enable
equipment upgrades or data center consolidations.

 Note: SVM Migrate is only supported on AFF arrays. Although support for FabricPool was added in 9.12.1,
there is still a lengthy list of features that do not support SVM Migrate.

Please see: https://docs.netapp.com/us-en/ontap/svm-migrate/index.html#supported-configurations

20 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

FabricPool + FlexGroup + SVM-DR
ONTAP 9.12.1

Primary Cluster Secondary Cluster  Prior to ONTAP 9.12.1 customers

were given the option to use any two
of the following features in
combination … but not all three:
NetApp®
 FabricPool
SnapMirror®
 FlexGroup volumes
 SVM-DR
SVM

NetApp
SnapMirror  Beginning in 9.12.1, customers can
Disaster use all three features together,
Recovery®
protecting SVMs hosting FlexGroup
Provisioned storage
Active data
volumes on FabricPool aggregates.
S3
Inactive data

21 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

How Does FabricPool
Work?

22 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Block Temperature
How does FabricPool work?

 Attach cloud tier storage (Amazon S3, Microsoft Azure Blob Storage, StorageGRID®, etc.) to aggregates

 Set tiering policy on volumes

• Snapshot-Only
Cold NetApp® Snapshot blocks not shared by the active file system are moved to the cloud tier

• Auto
Cold blocks are moved to the cloud tier

• All
Blocks are tiered directly to the cloud tier; no temperature scans are required

• None (default)
Cold blocks are not moved to the cloud tier
23 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Block Temperature
How does FabricPool work?

1 Data blocks are written with temperature value: hot ( )

NetApp® FlexVol® Volume

24 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Block Temperature (Continued)
How does FabricPool work?

1 Data blocks are written with temperature value: hot ( )

2 Temperature scan monitors the activity of each block and

decreases the temperature value during every scan until it
becomes cold ( ) (2183 days)
Default is 2 days for the Snapshot-Only tiering policy
Default is 31 days for the Auto tiering policy

NetApp® FlexVol® Volume

25 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Block Temperature (Continued)
Using FabricPool with Primary Data

1 Data blocks are written with temperature value: hot ( )

2 Temperature scan monitors the activity of each block and

decreases the temperature value during every scan until it
becomes cold ( ) (2183 days)
Default is 2 days for the Snapshot-Only tiering policy
Default is 31 days for the Auto tiering policy

NetApp® FlexVol® Volume 3 Tiering scan collects cold blocks ( ) and packages them into 4MB
objects (1,024 4K blocks)

26 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Block Temperature (Continued)
How does FabricPool work?

1 Data blocks are written with temperature value: hot ( )

2 Temperature scan monitors the activity of each block and

decreases the temperature value during every scan until it
becomes cold ( ) (2183 days)
Default is 2 days for the Snapshot-Only tiering policy
Default is 31 days for the Auto tiering policy

NetApp® FlexVol® Volume 3 Tiering scan collects cold blocks ( ) and packages them into 4MB
objects (1,024 4K blocks)

4 Objects are moved to the external cloud tier

Note: Tiering does not take place until the aggregate is at more
than 50% capacity

27 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Data Retrieval

28 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Data Retrieval: Cloud to Local Tier
How does FabricPool work?

1 Data blocks in the volume are read

NetApp® FlexVol® Volume

29 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Data Retrieval: Cloud to Local Tier (Continued)
How does FabricPool work?

1 Data blocks in the volume are read

2 Cold blocks ( ) are fetched using a GET operation, moved to the

performance tier, and made hot ( )

GET operations fetch blocks (4K256K), not necessarily the

entire 4MB object
NetApp® FlexVol® Volume
Note: When enough blocks in an object have zero references, the
object can be deleted from the external cloud tier.

30 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Data Retrieval: Cloud to Local Tier (Continued)
How does FabricPool work?

1 Data blocks in the volume are read

2 Cold blocks ( ) are fetched using a GET operation, moved to the

performance tier, and made hot ( )

GET operations fetch blocks (4K–256K), not necessarily the

entire 4MB object
NetApp® FlexVol® Volume
Note: When enough blocks in an object have zero references, the
object can be deleted from the external cloud tier.

3 Performance tier blocks are temperature scanned and are

moved to the cloud tier if they become cold.

31 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Data Retrieval: Cloud to Local Tier (Continued)
How does FabricPool work?

• Cold blocks are fetched using a GET operation, written to the performance tier, and made hot … but not in all
circumstances:

• Snapshot-Only
Read: cold blocks are made hot and written to the performance tier

• Auto
Random read: cold blocks are made hot and written to the performance tier
Sequential read: cold blocks stay cold; blocks are not written to the performance tier

• All
Read: cold blocks stay cold; blocks are not written to the performance tier

• >90% capacity on performance tier

Read: cold blocks stay cold; blocks are not written to the performance tier
32 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Requirements

33 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Requirements

• Supported platforms

• Intercluster logical interfaces (IC LIFs)

• Thin-provisioned volume

• No quality of service (QoS) floors

• License required when using:

• Alibaba Cloud Object Storage Service
• Amazon S3
• Google Cloud Storage
• IBM Cloud Object Storage
• Microsoft Azure Blob Storage
• Other S3 compatible providers

• Certificate authority (CA) certificate (StorageGRID®, other private clouds, including ONTAP S3)

34 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Supported Platforms
Requirements

NetApp® AFF All platforms capable of running ONTAP 9.2

All platforms* capable of running ONTAP 9.2 except:

• FAS8020
NetApp FAS* • FAS2554, FAS2552, FAS2520
*Prior to 9.8, only solid-state drive (SSD) aggregates can use FabricPool
Amazon: Local tier: gp2, io1, and st1, EBS volumes; Cloud tier: Amazon
S3
Cloud Volumes ONTAP Microsoft Azure Blob Storage
Google Cloud Storage
Alibaba Cloud Object Storage: Standard, Infrequent Access
Amazon S3: Standard, Infrequent Access, One Zone, Intelligent-Tiering,
Commercial Cloud Services (C2S)
Google Cloud Storage: Multi-Regional, Regional, Nearline, Coldline
Object storage IBM Cloud Object Storage: Cleversafe, SoftLayer
Microsoft Azure Blob Storage: Hot, Cool
NetApp StorageGRID®: 10.3+
Others: using ‘S3 Compatible’ in 9.7

35 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Intercluster LIFs
Requirements

• High-availability (HA) pairs that use FabricPool

require intercluster logical interfaces (IC LIFs)
to communicate with the external cloud tier

• Use at least one IC LIF on each node

• Disabling or deleting all intercluster

LIFs interrupts communication to the cloud tier

36 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Volumes
Requirements

• Thin provisioning is required

• The amount of space grows as data is added instead of being determined by the initial volume size

• This growth is essential for FabricPool because the volume must support external cloud tier data that
becomes hot and is brought back to the local tier

• volume modify -space-guarantee none

37 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

No QoS Floors
Requirements

• Quality of service (QoS) throughput floors, QoS Min, guarantees that throughput for a workload does not fall
below a minimum number of IOPS

• FabricPool and QoS Min goals are mutually exclusive

• FabricPool sends blocks to object stores, decreasing performance
• QoS Min guarantees performance minimums

• Solution
• Turn off QoS Min on volumes you want to tier
• Turn off tiering (-tiering-policy none) on volumes that need QoS Min

38 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Cloud Tiering License
Requirements

• Required for third-party object store providers

• Cloud Tiering licenses are attached to a customer’s account and the total tiering capacity can be used
across multiple clusters.

• Pay-as-you-go subscriptions from cloud provider marketplaces,

or 2-, 12-, 24-, and 36-month term-based licenses.

• Cloud Tiering licenses (including add-on or extensions to pre-existing FabricPool

licenses) are activated in the Cloud Manager Digital Wallet. Tiering setup and
configuration are done using the Cloud Tiering service.
https://cloud.netapp.com/cloud-tiering

39 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

CA Certificate
Requirements

• Private clouds, such as NetApp® StorageGRID®, or ONTAP S3, require security certificates for securing
access to:
• The management interface
• Storage and API gateway nodes
• DNS hostname to Data LIF resolution

• CA certificates should be installed on NetApp ONTAP® before a private object store bucket is attached to
an aggregate

• Failing to do so will result in an error unless validation has been turned off
(not recommended)

-is-certificate-validation-enabled false

• Must match fully qualified domain name (FQDN)

Note: The default StorageGRID CA cert
does not match FQDN; it is IP-based

40 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Configuration

41 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Configuration

• Configure Amazon S3
• Create bucket, purchase license, and install license

• Configure IBM Cloud Object Storage

• Create bucket, purchase license, and install license

• Configure Microsoft Azure Blob Storage

• Create container, purchase license, and install license

• Configure NetApp® StorageGRID®

• Create bucket and add CA certificate

• Configure ONTAP S3
• Please refer to:
S3 Configuration Power Guide: http://docs.netapp.com/ontap-9/topic/com.netapp.doc.pow-s3-cg/S3%20configuration.pdf

• Attach aggregate

• Set tiering policy

42 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Amazon S3: Create Bucket
Configuration

• Sign in to AWS Management Console and open the S3 console

• https://console.aws.amazon.com/s3

• Create a bucket
1. Click Create bucket.
2. Enter a unique DNS-compliant bucket name.
3. Select a region close to your data center.
4. Click Create.

• Additional settings
• Do not edit bucket properties or permissions.

43 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Amazon S3: Purchase License
Configuration

• When ordering a new cluster, sales should include a free 10TB FabricPool license;
for existing systems, a FabricPool license must be purchased
Note: A license is not required when using NetApp® StorageGRID® as the cloud tier
or Amazon S3 as the cloud tier in Cloud Volumes ONTAP.

• FabricPool licenses are clusterwide; customers need their cluster UUID when obtaining a license (cluster
identity show)

• For additional info about point-of-sale and add-on sales, refer to the ONTAP FabricPool Licensing Overview
and Understanding the FabricPool License

• A single license works for all third-party endpoints

• FabricPool licenses are available in perpetual and term-based (1- or 3-year) formats

44 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Amazon S3: Install FabricPool License
Configuration

• After obtaining a NetApp® license file (NLF), install it using NetApp OnCommand® System Manager

• Click Configurations > Licenses > Add to add the license to

NetApp ONTAP®

45 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Azure: Create Container
Configuration

• Sign in to Microsoft Azure

• https://portal.azure.com/

• Create a container
1. Click Settings > Containers.
2. Enter a name.
3. Select an access level.
4. Click OK.

46 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Azure: Purchase License
Configuration

• When ordering a new cluster, sales should include a free 10TB FabricPool license;
for existing systems, a FabricPool license must be purchased
• A license is not required when using NetApp® StorageGRID® as the cloud tier
or Amazon S3 as the cloud tier in ONTAP® Cloud

• FabricPool licenses are clusterwide; customers need their cluster UUID when obtaining a license (cluster
identity show)

• For additional info about point-of-sale and add-on sales, refer to the ONTAP FabricPool Licensing Overview

• A single license works for all third-party endpoints

• FabricPool licenses are available in perpetual and term-based (1- or 3-year) formats

47 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Azure: Install FabricPool License
Configuration

• After obtaining a NetApp® license file (NLF), install it using NetApp OnCommand® System Manager

• Click Configurations > Licenses > Add to add the license to

NetApp ONTAP®

48 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

StorageGRID : Create Bucket
Configuration

• Create StorageGRID® buckets with third-party tools

• Install a third-party S3 browser

• Many options are available; bucket creation instructions
here are for CloudBerry Explorer

• Connect to StorageGRID
1. Click File.
2. Select New S3 Compatible Account.
3. Select S3 Compatible Account.
4. Enter the display name, service point, access key, and
secret key associated with your StorageGRID
account.
5. Click Test Connection.
6. Click OK.

49 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

StorageGRID : Create Bucket (Continued)
Configuration

Create a new bucket

1. Select StorageGRID as the

destination source.
2. Click the New Bucket icon.
3. Name the bucket.
4. Click OK.

50 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

StorageGRID : Locate CA Certificate
Configuration

Locate CA certificate

• StorageGRID® admin
1. Select Configuration > Grid Options.

2. Under API Server Certificates, expand CA Certificate.

3. Copy the CA certificate, including:

-----BEGIN CERTIFICATE----- and -----END CERTIFICATE-----

• Admin other than StorageGRID

1. openssl s_client -connect <FQDN> -showcerts

2. Copy the CA certificate, including:

-----BEGIN CERTIFICATE----- and -----END CERTIFICATE-----

51 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

StorageGRID : Install CA Certificate
Configuration

• Install CA certificate in NetApp® ONTAP®

security certificate install -type server-ca

Note: When adding NetApp StorageGRID® as an external cloud tier,

the server name (FQDN) must match the FQDN used by the CA certificate.

52 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Identify and Attach Cloud Tier
Configuration

• Identification and attachment of a cloud tier can be completed by using either NetApp® OnCommand®
System Manager or NetApp ONTAP® CLI

• You need the following information on hand

• Server name (FQDN) (for example, s3.amazonaws.com)
• Access key ID
• Secret key
• Container name (bucket name)

53 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Identify a Cloud Tier
Configuration

NetApp OnCommand System Manager GUI

1. Launch NetApp® OnCommand® System Manager.

2. Click Storage.
3. Click Aggregates & Disks.
4. Click External Cloud Tier.
5. Select a provider and click Add.
6. Complete the text fields as required for
your object store provider.
7. Click Save and Attach Aggregates.

54 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Identify a Cloud Tier
Amazon S3, IBM Cloud Object Storage and StorageGRID)
Configuration

NetApp® ONTAP® CLI

object-store config create

-object-store-name <name>
-provider-type <AWS/SGWS>
-port <443/8082> (AWS/SGWS)
-server <name> (s3.amazonaws.com/FQDN)
-container-name <bucket-name>
-access-key <string>
-secret-password <string>
-ssl-enabled true
-ipspace default

55 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Identify a Cloud Tier (Azure)
Configuration

NetApp® ONTAP® CLI

object-store config create

-object-store-name <name>
-provider-type Azure_Cloud
-port 443
-server blob.core.windows.net
-container-name <name>
-azure-account <name>
-azure-private-key <string>
-ssl-enabled true
-ipspace default

56 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Attach Aggregate: GUI
Configuration

NetApp OnCommand System Manager GUI

1. Launch NetApp® OnCommand® System Manager.

2. Click Storage.

3. Click Aggregates & Disks.

4. Click Cloud Tier.

5. Select an object store provider and click Attach Aggregates.

6. View and update the tiering policies for the volumes on the aggregate.
Note: By default, volume tiering policies are set as Snapshot-Only.

7. Click Save.

57 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Attach Aggregate: CLI
Configuration

NetApp® ONTAP® CLI

storage aggregate object-store attach

-aggregate <name>
-object-store-name <name>

58 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Set Tiering Policy
Configuration

• Snapshot-Only
• Cold blocks associated with NetApp® Snapshot copies that are not shared with the active file system will be moved to the cloud tier

• Auto
• Cold blocks are moved to the cloud tier
• The default setting for tiering-minimum-cooling-days is 31 days; adjustable from 2 to 183 days (63 days max prior to 9.8)

• All
• All blocks are immediately moved to the cloud tier (WAFL® metadata stays on the local tier.)
• Warning!
• Tiering data immediately reduces storage efficiencies. (Inline only, no background efficiencies. Use Auto 2-days to gain background effeciencies)
• Object storage is not transactional and will result in significant fragmentation if subjected to change.

• None (default)
• Cold blocks in the volume are not moved to the cloud tier
• Previously tiered data remains on the cloud tier until it is read and made hot

59 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Set Tiering Policy: GUI
Configuration

NetApp OnCommand System Manager GUI

1. Launch NetApp® OnCommand® System Manager.

2. Select a volume.

3. Click Actions and select Change Tiering

Policy.

4. Select the tiering policy you want to

apply to the volume.

Note: By default, volume tiering policies are

set as Snapshot-Only.

5. Click Save.

60 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Set Tiering Policy: CLI
Configuration

NetApp® ONTAP® CLI

volume modify
-vserver <name>
-volume <name>
-tiering-policy <snapshot-only, auto, all, none (default)>
-tiering-minimum-cooling-days <#>

Note: Advanced privilege level is required to set tiering-minimum-cooling-days.

61 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Best Practices

62 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Best Practices

• Performance

• Connectivity

• Buckets

• Information lifecycle management

• Data redundancy

• Storage classes

• Data protection

63 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Performance
Best Practices

• 10Gbps connection (AWS Direct Connect, Azure ExpressRoute, etc.)

• SATA-like performance
• SATA-like performance might be overkill for your cold data

• NetApp® ONTAP® Cloud instances limited to 2GBps (~250MBps)

Note: SR-IOV instances (10Gbps) are available in Cloud Volumes ONTAP 9.4.

64 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Performance
Best practices

• NetApp® StorageGRID®
• More nodes = more CPU
• More CPU = more IOPS
• More IOPS = more GETs

• Public Clouds
• IOPS limited by provider
• Number of concurrent sessions
• Constrained at the bucket level
? 1000*
65 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Performance (Continued)
Best Practices

• Reading data from the cloud tier is not as fast as reading data from SSDs on the local tier (MBps vs. GBps)
Note: Adjust recovery time objective (RTO) accordingly.

• Although FabricPool and your chosen object store can withstand 10-second latency, client applications might
not be able to

• Do not run virtualized StorageGRID, or other virtualized object stores, in volumes that tier inactive data. Set
tiering policy to None.

66 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Connectivity
Best Practices

What happens when connectivity is lost?

• Local tier remains online

• Cold blocks on the cloud tier become unavailable until it comes back online

• Applications receive an error message

SMB STATUS_INTERNAL_ERROR Retries are client dependent

NFS v3: EJUKEBOX Retry after 5 seconds

v4: EDELAY Hang until connectivity is reestablished

SAN UNRECOVERED READ ERROR/ The application might need to be restarted so that the read can
RECOMMEND REWRITE THE DATA be retried – please read the slide notes

67 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Buckets
Best Practices

• Bucket creation
• Amazon S3
• Microsoft Azure Blob Storage
Aggr_1
• NetApp® StorageGRID®

• Aggregate-to-bucket relationships Aggr_1

• 1:1 Aggr_2
• Many:1
• This is the recommended best practice and facilitates
optimized volume moves
• 1:many (is not OK)
Aggr_1

68 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Information Lifecycle Management
Best Practices

• Information lifecycle management (ILM): tiering and deletion polices on the object
store

• NetApp® ONTAP® data management software is blind to object store configurations

• Misconfiguration can result in data loss

• Other than StorageGRID® data replication and erasure coding, and changing
storage classes in public clouds, FabricPool does not support ILM policies applied to
object store buckets

Note: Starting in ONTAP 9.8, using tags, FabricPool supports ILM policies on
StorageGRID.

69 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Data Replication
Best Practices

• NetApp® StorageGRID®
• 2+1 erasure coding
• 99.9999999999999% durability (15 nines)

• Microsoft Azure Blob Storage

• Automatically replicates to multiple locations
• 99.99999999999999% durability (16 nines)

• Amazon S3
• Automatically replicates to multiple locations
• 99.999999999% durability (11 nines)

• ONTAP S3
• No additional data replication other than standard ONTAP data protection
• Recommend using SnapMirror or other data protection technologies

70 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Storage Classes
Best Practices

• Amazon S3
• Standard
• Standard - Infrequent Access
• One Zone
• Intelligent-Tiering
• Commercial Cloud Services (C2S)

• Google Cloud Storage

• Multi-Regional
• Regional
• Nearline
• Coldline

71 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Data Protection
Best practices

• Traditional aggregate

Aggregate

Vol1

Vol2

Vol3

72 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Data Protection
Best practices

• FabricPool aggregate

Aggregate
+ Vol1
Cloud

Vol2

Vol3

73 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Data Protection
Best practices

• FabricPool aggregate

Aggregate
+ Vol1
Cloud

Vol2

Vol3

74 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Data Protection
Best practices

• FabricPool aggregate + data protection

Aggregate
+ Vol1
Cloud NetApp®
SnapMirror®

Vol2

Vol3

Source Destination
75 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Capacity
Best practices

• Sizing
• Hot data
• Cold data’s metadata
• Cold data that is made hot 1:10
• Cold data until it is tiered to the cloud tier

• Limits
• Tiering stops when an aggregate reaches 98% capacity
or when 16PB has been tiered from the aggregate,
whichever comes first %
• 800TB  784TB at 98%
• @ 5% metadata, 784TB SSD will tier 15.6PB
98 16PB
• 400TB  392TB at 98%
• @ 5% metadata, 392TB HDD will tier 7.8PB

76 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Capacity
Best practices

• NetApp® Cloud Volumes ONTAP® is different

• Capacity does not grow to include additional tiered capacity
• Capacity limits are spread across performance and cloud tiers

• ONTAP Local

50TB
+ Cloud

980TB

• Cloud Volumes ONTAP

• 368TB max system capacity
Local

50TB
+ Cloud

318TB
• 50 + 318 = 368
77 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Supported Features
NetApp ONTAP 9.8

Supported Not Supported

 Data protection  QoS Min (floors)

 NetApp® SnapMirror® technology  SMTape
 NetApp SnapVault® software
 NetApp SnapLock® Enterprise*  NetApp SnapLock® Compliance
* requires fpvr
 DP_Optimized (DPO) license
 Storage efficiency
 Inline dedupe
 Inline compression
 Compaction
 Inline aggregate dedupe*
* Local tier only

 Encryption
 NetApp Volume Encryption (NVE)
 NetApp Storage Encryption (NSE)

78 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

 Understand the value of FabricPool
• Lower provisioning costs
• High performance tiering

Understand what’s new in FabricPool

• HDD support
Key takeaways • Cloud retrieval
• ONTAP S3 as cloud tier

See how other customers reduce costs

• Primary data (NAS/SAN)
• Secondary data (HDD support is new in 9.8)

79 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Next steps and resources

80 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Next steps
Call to action!

• Turn on active data reporting

storage aggregate modify
-aggregate <name>
-is-inactive-data-reporting-enabled true

• Talk with your customer about the results

• How much of their data is inactive?
• Per aggregate
• Per volume

• Plan a cloud tier for provisioning inactive data

• StorageGRID
• ONTAP S3
• Public cloud

81 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Resources
Customer facing

• TR-4598: FabricPool Best Practices in ONTAP

http://www.netapp.com/us/media/tr-4598.pdf

• TR-4814: S3 Best Practices in ONTAP

http://www.netapp.com/us/media/tr-4814.pdf

• Configuration and usage videos

https://www.youtube.com/playlist?list=PLdXI3bZJEw
7mcD3RnEcdqZckqKkttoUpS

• [email protected]

82 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Resources
NetApp confidential

• FabricPool collection:
https://fieldportal.netapp.com/collections/533113

• FabricPool Technical FAQ

• FabricPool TCO Calculator
• Creating Buckets for FabricPool Guide
• Configuration and usage videos
• TR-6773: StorageGRID Performance
• TR-4814: ONTAP S3 Best Practices

83 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

What’s New in ONTAP 9.11.1?

84 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

• Support for Amazon S3 Glacier Instant Retrieval
storage class

85 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Amazon S3 Glacier Instant Retrieval
ONTAP 9.11.1

 The Amazon S3 Glacier Instant Retrieval storage class uses a different cost structure but provides the same
performance as the S3 Standard storage class.

Please see https://aws.amazon.com/s3/pricing for more information.

Note: Glacier Flexible Retrieval and Glacier Deep Archive are not supported.

 Supported cloud tiers

• Alibaba Cloud Object Storage Service (Standard, Infrequent Access)
• Amazon S3 (Standard, Standard-IA, One Zone-IA, Intelligent-Tiering, Glacier Instant Retrieval)
• Amazon Commercial Cloud Services (C2S)
• Google Cloud Storage (Multi-Regional, Regional, Nearline, Coldline, Archive)
• IBM Cloud Object Storage (Standard, Vault, Cold Vault, Flex)
• Microsoft Azure Blob Storage (Hot and Cool)
• StorageGRID 10.3+

86 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

What’s New in ONTAP 9.10.1?

87 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

• PUT throttling

• Unified format temperature sensitive storage

efficiency

88 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

PUT Throttling
ONTAP 9.10.1

 Put throttling allows storage administrators to set an upper threshold on the maximum, per node, PUT rate.

PUT throttling can be useful when network resources, or the object store endpoint, are resource constrained.
Although rare, resource constraints can occur with underpowered object stores or during the first days of
FabricPool usage when TB or PB of cold data begin to tier out.

Note: FabricPool PUTs do not compete for resources with other applications. FabricPool PUTs are
automatically placed at a lower priority (bullied) by client apps and other ONTAP workloads, such as
SnapMirror. PUT throttling using put-rate-limit is unrelated to concurrent traffic.

 storage aggregate object-store put-rate-limit modify

-node] <nodename>
-default] <true|false>
-put-rate-bytes-limit <integer>[KB|MB|GB|TB|PB]

 Advanced privilege level is required.

89 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Unified format temperature sensitive storage efficiency
ONTAP 9.10.1

 Temperature sensitive storage efficiency (TSSE) was introduced in ONTAP 9.8. With this feature, storage
efficiency is applied according to whether data is hot or cold. For cold data, 32KB data blocks are
compressed, and for hot data, which is overwritten more often, smaller data blocks are compressed, making
the process more efficient.

 Compression is a trade-off of space saved versus the performance impact to compress and de-compress the
data, TSSE automatically applies the optimal level of space saving dependent on how hot the data is.

 Due to various issues, prior to 9.10.1, volumes with TSSE would tier uncompressed data, losing storage
efficiencies associated with compression on objects in the cloud tier. For this reason, TSSE was not enabled
by default on volumes in FabricPool aggregates.

 ONTAP 9.10.1 supports a unified object format in which volumes with TSSE will preserve compression-based
storage efficiencies when tiering … and provide the additional storage efficiencies associated with TSSE.

90 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

What’s New in ONTAP 9.9.1?

91 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

• Not much.

• 9.9.1 saw some bug fixes but is a very minor

release for FabricPool.

92 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

What’s New in ONTAP 9.8?

93 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

• HDD Support

• ONTAP S3

• Cloud Retrieval

• Inactive Data Reporting Enhancements

• Increased Cooling Period

• Object Tagging

• Defrag Threshold Changes

• FabricPool supported on Azure NetApp Files

94 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

HDD Support
What else is new in ONTAP 9.8?

• HDD Support
• 9.2 – 9.7 SSD only
• 9.6 added HDD support for inactive data reporting

• Client workloads take priority over FabricPool®

temperature scans on HDD aggregates
• Reduces the frequency of the scans
without reducing performance

95 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

HDD Support
What else is new in ONTAP 9.8?

• Primary environments
• Does tiering from HDD to HDD make sense?
• Migrations become much easier with
optimized volume moves
• Cold data tiers before the migration
• Only hot data needs to be provisioned

Vol

96 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

HDD Support
What else is new in ONTAP 9.8?

• Secondary environments
• Prior to 9.8, SSD aggregates were required even in
backup/DR environments
(WAFL metadata always stays on the local tier)

Many customers found this prohibitively expensive

• With the release of 9.8, the local tier can be provisioned with
HDD aggregates

• Flash Pool™ aggregates (SSD & HDD)

are not supported
• Volume move to exclusively SSD or HDD aggregates

97 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

ONTAP S3
What else is new in ONTAP 9.8?

• Repurpose existing infrastructure as an object store

endpoint
• Excellent option for customers with existing FAS platforms
• Can be used cluster-to-cluster or within the same cluster
(Intra-node tiering is not recommended for single node clusters)
• No FabricPool license required
(Requires the installation of the zero-cost S3 license)

Refer to the ONTAP S3 Technical Presentation for more

information.

• StorageGRID
• Preferred choice for FabricPool*
• More data tiered to StorageGRID than any other S3 target
• Robust distributed \ multisite capable S3 object storage
• Positions NetApp to support additional S3 workloads

*FabricPool to ONTAP S3 >300TB requires FPVR

98 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Cloud Retrieval
What else is new in ONTAP 9.8?

• Cold blocks are written to the performance tier,

and made hot…but not in all circumstances
• Auto volume tiering policy
Random read: cold blocks are made hot
and written to the local tier

Sequential read: cold blocks stay cold

blocks are not written to the local tier

• volume modify
-vserver <vserver-name> -volume <volume-name>
-cloud-retrieval-policy
default = random reads only
on-read = random and sequential reads
never = cold blocks stay cold
promote = brings data back on the next tiering scan

(Advanced privilege level required)

99 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Cloud Retrieval
What else is new in ONTAP 9.8?

• Bring everything back to the local tier

• Before
-tiering-policy auto
cloud-retrieval-policy default
• After
-tiering-policy none
cloud-retrieval-policy promote

• Bring the active file system back to the local tier

but keep snapshot copies cold
• Before
-tiering-policy auto
cloud-retrieval-policy default
• After
-tiering-policy snapshot-only
cloud-retrieval-policy promote

100 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Inactive Data Reporting Improvements
What else is new in ONTAP 9.8?

• 9.4 – 9.7, inactive data reporting uses a 31-day

cooling period to determine what data is considered
inactive

• This is not adjustable…until ONTAP® 9.8.

• Non-FabricPool® local tiers

None: 31-days
Snapshot-only: -tiering-minimum-cooling-days
Auto: -tiering-minimum-cooling-days
All: All user data is inactive

• FabricPool local tiers

None: Cold user data is reported

Snapshot-only: Data tiers before it is reported
Auto: Data tiers before it is reported
All: Data tiers before it is reported

101 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Increased Cooling Period
What else is new in ONTAP 9.8?

• 9.2 – 9.7, FabricPool®’s volume cooling period was

adjustable between 2 days and 63 days using
-tiering-minimum-cooling-days

• 9.8 increases that number to 183 days

• Great for customers who have inflexible SLAs
• Not recommended as a best practice

• FabricPool is high performance tiering

• Data is immediately accessible
• Data is dynamically written to the tier that makes the most sense

• FabricPool is not an ILM policy

• Data is not permanently archived/exiled
• Increasing -tiering-minimum-cooling-days means data
stays on the local tier longer, increasing provisioning costs and
reducing the value of FabricPool

102 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Object Tagging
What else is new in ONTAP 9.8?

• Object tagging is supported when StorageGRID is

used as the cloud tier

• Many possibilities using StorageGRID ILM policies:

• Node location
• Replication and erasure coding scheme

• Supports up to four key=value pairs

volume modify <name>

-tiering-object-tags
key1=val1,key2=val2

• Customers should avoid using other ILM policies,

especially those that delete or move data out of the
grid

103 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Defrag Threshold Changes
What else is new in ONTAP 9.8?

• FabricPool® deletes objects after a certain

percentage of the object’s blocks are no longer
referenced by ONTAP®

Object Store ONTAP Cloud Volumes ONTAP

Amazon S3 20% 30%

Google Cloud Storage 20% 35%

IBM Cloud Object Storage 20% NA

Microsoft Azure Blob Storage 25% 35%

StorageGRID 40% NA

storage aggregate object-store modify

–aggregate <name> -object-store-name <name>
–unreclaimedspace-threshold <%> (0%-99%)
(Advanced privilege level required)

104 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

What’s New in ONTAP 9.7?

105 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

• FabricPool Mirror

• MetroCluster Support

• NDMP Support

• S3 Compatible Providers

106 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

FabricPool Mirror

• Aggregate-to-bucket relationships
• 1:1
• Many:1
Aggr_1
• 1:Many (not OK)

Aggr_1
Aggr_2

Aggr_1

107 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

FabricPool Mirror

• Aggregate-to-bucket relationships
• 1:1
• Many:1
Aggr_1
• 1:Many

• Mirror tiered data across two buckets Aggr_1

Aggr_2

• Stand alone feature

• Does not require MetroCluster™ to use.

Aggr_1

108 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

FabricPool Mirror

• Multi-vendor solutions
• Mirror the same data to multiple vendors for an
additional level of resiliency.

• Change cloud providers non-disruptively

• Prior to ONTAP 9.7, buckets could not be changed
without first bringing all the cold data back and
performing diag-level commands.

Aggr_1

109 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

MetroCluster

Cluster A Cluster B
Site A Site B

• Continuous availability.

• Independent cluster at each site up

to 700km apart.

• Redundant fabrics.

• Entire cluster workload can be

transferred between sites.

110 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

MetroCluster

Cluster A Cluster B
Site A Site B

• Continuous availability.

• Independent cluster at each site up

to 700km apart.

• Redundant fabrics.

• Entire cluster workload can be

transferred between sites.

• Includes object store connectivity.

A1 A2

B2 B1

111 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

NDMP Support

 ONTAP 9.2 – 9.6

• NDMP hardcoded to not work on FabricPool aggregates

 ONTAP 9.7
• NDMP operations now supported on FabricPool aggregates

Note: Customers who use third party backup tools should configure them to use NDMP as the protocol—not SMB or NFS.

ONTAP will treat backups operations using NAS protocols as client reads—making the data hot. With frequent backups, it is likely that the
data being backed up will never become cool enough to tier.

NDMP reads are treated differently (ONTAP uses FPolicy hooks and does not consider them as client reads) and will not keep the data
hot.

112 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

S3 Compatible Providers

 ONTAP 9.2 – 9.6

• Customers need to navigate a complex FPVR process in order to
use
non-qualified object store providers.
• Hash keys, boot arguments, countless emails across multiple
organizations, etc.

 ONTAP 9.7
• FPVR process no longer required.
• Customer will still need to perform the testing and confirm that the
object store meets their requirements.
• If it does, FabricPool will be supported.

113 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

S3 Compatible Providers

 Frequently requested, non-qualified providers

• Dell EMC Elastic Cloud Storage (ECS)
• Cloudian
• Hitachi Content Platform
• Western Digital ActiveScale
• Etc.

 Officially qualified providers

• Alibaba Cloud Object Storage Service
• Amazon S3
• Amazon Commercial Cloud Services
• Google Cloud Storage
• IBM Cloud Object Storage
• Microsoft Azure Blob Storage
• StorageGRID

114 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

What’s New in ONTAP 9.6?

115 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

What’s New in ONTAP 9.6?

• Google Cloud Storage

• Alibaba Cloud Object Storage Service

• Volume tiering policy: All

• Volume move enhancements

• SVM-DR

• Automatic Inactive Data Reporting

• Removed hardcoded 1:20 maximum tiering ratio

• New licensing model

116 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

New Cloud Providers
What’s New in ONTAP 9.6?

• Google Cloud Storage

• -provider-type GoogleCloud
Archival pricing
• Multi-Regional
in an S3 bucket
• Regional
• Nearline
• Coldline

• Alibaba Cloud Object Storage Service

• -provider-type AliCloud
#1 cloud service
• Standard
provider in China
• Infrequent Access

117 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

All volume tiering policy
What’s New in ONTAP 9.6?

• All replaces Backup

• Backup is deprecated

• Works like the Backup volume tiering policy, but can be used on non-DP volumes.
• Blocks in the volume are immediately marked as cold ( ) and tiered.
• NetApp WAFL® metadata is always hot. ( )
• If read, cold blocks stay cold and are not written back to the performance tier.

• Warning!
• Tiering data immediately reduces storage efficiencies. (Inline only)
• Only use on volumes you are confident contain cold data that will not change.
• Object storage is not transactional and will result in significant fragmentation if subjected to change.
• Volumes with active RW workloads should use the Auto (with an appropriate tiering-minimum-cooling-days setting) volume tiering policy
instead of the All Volume tiering policy.

118 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Volume Move Enhancements
What’s New in ONTAP 9.6?

 Volume moves no longer need to write-back tiered data

then re-tier it.

 Volume moves now only need to move the WAFL metadata on the
performance tier.

 Tiered data does not need to move, reducing network traffic and
associated costs.

119 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Volume Move Enhancements
What’s New in ONTAP 9.6?

 ONTAP 9.2-9.5
Cold data is brought
back to the cluster …

Aggr_1

Vol1 Bucket 1
… then tiered back
to the cloud
Aggr_2

 Additional network traffic

 Additional egress charges

120 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Volume Move Enhancements
What’s New in ONTAP 9.6?

• ONTAP 9.6

Aggr_1
Cold data
Vol1 never leaves Bucket 1
the bucket!

Aggr_2

 Only data on the performance tier moves.

121 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

SVM-DR
What’s New in ONTAP 9.6?

 SVM DR uses SnapMirror to mirror a

storage SVM’s volumes and
configuration in order to significantly
simplify data recovery.

 Use to quickly activate a destination

SVM after a disaster.

 Now supported on FabricPool

aggregates.

122 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Automatic Inactive Data Reporting
What’s New in ONTAP 9.6?

• First available in ONTAP 9.4, Inactive Data Reporting,

one of the most helpful hardware refresh/provisioning
tools, is now enabled by default on SSD aggregates.

• When enabled by default, IDR automatically turns off, resetting

cooling days to zero when a client workload needs 100% of system
resources. If this happens, IDR does not automatically turn back on.

To avoid IDR being turned off, manually enable IDR using

-is-inactive-data-reporting-enabled true

123 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Removed hardcoded 1:20 maximum tiering ratio
What’s New in ONTAP 9.6?

 Previous 1:20 ratio assumed >5% WAFL metadata usage.

Many customer’s datasets used less than 5% metadata and were
prevented from tiering additional cold data.

 Now, instead of a 1:20 maximum tiering threshold, tiering stops when

the aggregate reaches 98% capacity or 16PB tiered.

Assuming no other data lives on an 800TB aggregate and all volumes use the All tiering policy:
 Dataset using 5% metadata = x20 tiered = 15.6PB tiered + 784TB on SSD
 Dataset using 10% metadata = x10 tiered = 7.8PB tiered + 784TB on SSD
 Dataset using 20% metadata = x5 tiered = 3.9PB tiered + 784TB on SSD

124 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Term-based licensing
What’s New in ONTAP 9.6?

 New licensing options include 1-Year and 3-Year terms.

 Advantages include:
 OpEx, not CapEx
 No additional support cost line items
 Costs amortized over time rather than large immediate expense

 After June 14th, the previous, perpetual, license will no longer

be available.

125 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

What’s New in ONTAP 9.5?

126 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

What’s New in ONTAP 9.5?

• FlexGroup Volumes

• Client-Side Encryption

• IBM Cloud Object Storage (ICOS)

• Amazon Commercial Cloud Services (C2S)

• Adjustable Tiering Fullness Threshold

127 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

FlexGroup Volumes
What’s New in ONTAP 9.5?

+ Cloud

NetApp® FlexVol® volumes FlexGroup volumes

• Single node, single aggregate  Multiple nodes, multiple aggregates
• 2 billion files  50 billion files per HA pair
• Limited to 100TB  Tested to 20PB

128 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

FlexGroup Volumes
What’s New in ONTAP 9.5?

• Requirements
• All aggregates used by the FlexGroup volume must be FabricPool aggregates
• FlexGroup volumes use None as the default volume tiering policy
(FlexVol volumes use Snapshot-Only)
• All constituent/member volumes in a FlexGroup volume use the same volume tiering policy
• Standard FabricPool requirements apply (SSDs, thin provisioning, etc.)

• Auto vs. manual provisioning

• Auto provisioning requires that FlexGroup volumes use a FabricPool aggregates on every cluster node
• This is a recommended best practice, not a requirement

• Multiple object-store buckets

• FlexGroup volumes are likely composed of multiple aggregates
• Each aggregate may use a unique bucket

129 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

FlexGroup Volumes
What’s New in ONTAP 9.5?

• Create new FlexGroup volume using FabricPool aggregates

• Attach object store to aggregates used by existing FlexGroup volumes:

1. Set the tiering policy on the existing FlexGroup to the desired value

volume modify -volume <name> -tiering-policy <auto|snapshot|none|backup>

2. List the aggregates used by the FlexGroup:

volume show -volume <name> -fields aggr-list

3. Attach an object store to each aggregate used by the FlexGroup:

storage aggregate object-store attach

-aggregate <aggregate name> -name <object-store-name> -allow-flexgroup true

130 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

FlexGroup Volumes
What’s New in ONTAP 9.5?

Additional resources

• TR-4571:FlexGroup Volumes Best Practices

https://www.netapp.com/us/media/tr-4571.pdf
• FlexGroup Volumes Technical Presentation
https://fieldportal.netapp.com/content/464279

131 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Client-Side Encryption
What’s New in ONTAP 9.5?

Performance Tier Over the Wire Cloud Tier

 NetApp® Volume Encryption (NVE)  TLS 1.2  Server-side encryption

 NetApp Storage Encryption (NSE)  AES-256 encryption  Client-side encryption

 AES-256 encryption  AES-256 encryption

132 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Client-Side Encryption
What’s New in ONTAP 9.5?

• Automatic
• No additional configuration needed

• No additional performance impact to the object store

• Does not replace the need for TLS.

• Even when storage data is encrypted, additional session information is passed over the wire that a man-in-the-middle attacks can
intercept. TLS provides security against these attacks.

133 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

IBM Cloud Object Storage (ICOS)
What’s New in ONTAP 9.5?

• OnCommand System Manager and CLI

• -provider-type IBM_COS

• IBM Cloud Direct Link (10Gbps) recommended

134 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Amazon Commercial Cloud Services (C2S)
What’s New in ONTAP 9.5?

• Air-gapped cloud environment

• Governments, public sectors, intelligence communities

• -provider-type AWS_S3

• Requirements
• CAP url
• Server CA certificate
• Client CA certificate
• Client private key

• AWS Direct Connect (10Gbps) recommended

135 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Adjustable Tiering Fullness threshold
What’s New in ONTAP 9.5?

• Previous to ONTAP 9.5, no tiering would take place in an aggregate until the performance tier of
the aggregate was at least 50% full.
• In ONTAP 9.5, the tiering fullness threshold is adjustable
• Consider reducing the threshold to reduce the amount of data stored on the performance tier.
• Consider increasing the threshold to tier only when necessary to reduced used capacity of the performance tier.

• Enable through CLI

storage aggregate object store modify
-aggregate <name>
-tiering-fullness-threshold # (default is 50%)

Note: Advanced privilege level is required to set tiering-fullness threshold.

136 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

What’s New in ONTAP 9.4?

137 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

What’s New in ONTAP 9.4?

• Auto tiering policy

• Microsoft Azure Blob Storage

• NetApp® ONTAP® Select

• Inactive data reporting

• Object store profiler

• Object defragmentation

• Compaction

• Bypass certificate validation

138 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Auto Tiering Policy
What’s New in ONTAP 9.4?

• Auto tiering policy

• Tiers all inactive (cold) primary data (not just Snapshot™ copies)
• Default cooling period: 31 days
• Cooling period is adjustable: 2 to 63 days

• CLI
volume modify
-vserver <name>
-volume <name>
-tiering-policy <snapshot-only (default), auto, backup, none>
-tiering-minimum-cooling-days <#>

Note: Advanced privilege level is required to set tiering-minimum-cooling-days.

139 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Microsoft Azure Blob Storage
What’s New in ONTAP 9.4?

• Microsoft Azure Blob Storage

• -provider-type Azure_Cloud

• Support for Hot and Cool access tiers

• Archive access tier not supported

• Azure ExpressRoute (10Gbps) recommended

140 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

ONTAP Select
What’s New in ONTAP 9.4?

• ONTAP anywhere
• ONTAP
• Cloud Volumes ONTAP
• ONTAP Select

S3
• ONTAP Select
• NetApp recommends using SSDs for FabricPool aggregates
• Premium license supports SSD aggregates

141 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Inactive Data Reporting
What’s New in ONTAP 9.4?

• NetApp® OnCommand® System Manager now displays

inactive (cold) data that can be tiered from the
aggregate’s performance tier
• FabricPool aggregates default: True
• Non-FabricPool aggregates default: False
• Cannot be enabled where FabricPool cannot be enabled
(root, HDD, etc.)

• Enable through CLI

storage aggregate modify
-aggregate <name>
-is-inactive-data-reporting-enabled true

• View through CLI

volume show –fields
performance-tier-inactive-user-data,
performance-tier-inactive-user-data-percent

142 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Inactive Data Reporting (Continued)
What’s New in ONTAP 9.4?

• Non-FabricPool aggregates
• Snapshot™ only 31 days
• Auto 31 days
• Backup 31 days
• None 31 days

• FabricPool aggregates
• Snapshot only 31 days
• Auto 31 days (default; tiering-minimum-cooling-days)
• Backup Not reported
• None 31 days

143 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Object Store Profiler
What’s New in ONTAP 9.4?

Test latency and throughput performance of object stores before you attach them to FabricPool aggregates

Start
storage aggregate
object-store
profiler start Op Size Total Failed Latency(ms) Throughput
-object-store-name <name> min max avg
-node <name> -------------------------------------------------------------------------------
PUT 4MB 50000 0 273 9500 719 277.3MB

Show GET 4KB 5000000 0 4 9591 38 48.46MB

storage aggregate GET 8KB 5000000 0 5 9121 37 123.3MB

GET 32KB 5000000 0 7 7889 60 475.3MB
object-store GET 256KB 2125276 0 21 7838 450 530.7MB
profiler show
Note: Advanced privilege level is required to use object-store profiler.

144 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Object Defragmentation
What’s New in ONTAP 9.4?

• FabricPool now defrags objects based on the percentage of used blocks in the object
• Defrag reclaims space used by blocks that have been deleted or are no longer being referenced by the performance tier
• Prior to NetApp® ONTAP® 9.4, object store cleanup effectively took place at 0% referenced
• Consider reducing defrag thresholds when using Infrequent Access/Cool pricing schemes

• CLI
• storage aggregate object-store modify –aggregate <name> -object-store-name <name> –unreclaimed-space-
threshold <%> (0%-99%)

Note: Advanced privilege level required to modify unreclaimed-space-threshold.

• Default settings* (*changes in 9.8)

• 14% IBM Cloud Object Storage (ONTAP 9.5)
• 15% Microsoft Azure Blob Storage
• 20% Amazon S3
• 40% NetApp StorageGRID®

145 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Compaction
What’s New in ONTAP 9.4?

• First available in NetApp® ONTAP® 9, the

compaction feature packs multiple logical data
blocks that normally occupy multiple physical
4K blocks into a single physical 4K block

• Enabled by default on AFF

• Optional on FAS

• FabricPool now applies these additional storage

efficiencies to the cloud tier

146 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

Bypass Certificate Validation
What’s New in ONTAP 9.4?

• Private cloud appliances require unique security certificates for securing access to:
• The management interface
• Storage and API gateway nodes

• StorageGRID® certificate authority (CA) certificates should be installed on ONTAP® before a StorageGRID
bucket is attached to an aggregate
• Failing to do so will result in an error

• … unless validation is turned off

(not recommended)

-is-certificate-validation-enabled false

147 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

 ONTAP 9.2 – 9.5
Backup Volume Tiering Policy

ONTAP 9.6
Depreciated and replaced by
All Volume Tiering Policy
148 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
The Backup Policy Tiers Immediately

Backup can only be enabled on data protection

Primary Cluster Secondary Cluster 1 destination volumes

NetApp® SnapMirror®

vol1
vol1

NetApp SnapVault®

Data Protection Volume

149 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

The Backup Policy Tiers Immediately (Continued)

Backup can only be enabled on data protection

Primary Cluster Secondary Cluster 1 destination volumes

NetApp® SnapMirror®
2 Replicated blocks are immediately made cold ( )
and moved to the cloud tier
vol1
vol1
NetApp WAFL® metadata is always hot ( )

NetApp SnapVault®

Data Protection Volume

150 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —

The Backup Policy Tiers Immediately (Continued)

Backup can only be enabled on data protection

Primary Cluster Secondary Cluster 1 destination volumes

NetApp® SnapMirror®
2 Replicated blocks are immediately made cold ( )
and moved to the external cloud tier
vol1
vol1
NetApp WAFL® metadata is always hot ( )

If read, cold blocks stay cold; blocks are not

NetApp SnapVault® 3 written to the performance tier

Data Protection Volume

151 © 2022 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —