OceanStor Dorado

6.1.x

SmartDedupe and
SmartCompression Feature Guide
for File
Issue 07
Date 2023-07-15

HUAWEI TECHNOLOGIES CO., LTD.

Copyright © Huawei Technologies Co., Ltd. 2023. All rights reserved.
No part of this document may be reproduced or transmitted in any form or by any means without prior
written consent of Huawei Technologies Co., Ltd.

Trademarks and Permissions

and other Huawei trademarks are trademarks of Huawei Technologies Co., Ltd.
All other trademarks and trade names mentioned in this document are the property of their respective
holders.

Notice
The purchased products, services and features are stipulated by the contract made between Huawei and
the customer. All or part of the products, services and features described in this document may not be
within the purchase scope or the usage scope. Unless otherwise specified in the contract, all statements,
information, and recommendations in this document are provided "AS IS" without warranties, guarantees
or representations of any kind, either express or implied.

The information in this document is subject to change without notice. Every effort has been made in the
preparation of this document to ensure accuracy of the contents, but all statements, information, and
recommendations in this document do not constitute a warranty of any kind, express or implied.

Huawei Technologies Co., Ltd.

Address: Huawei Industrial Base
Bantian, Longgang
Shenzhen 518129
People's Republic of China

Website: https://e.huawei.com

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. i

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File About This Document

About This Document

Purpose
This document describes SmartDedupe and SmartCompression features, including
their working principles and application scenarios.

The following table lists the product models applicable to this document.

Product Model Product Version

OceanStor Dorado 3000 (96 GB memory per 6.1.2

controller) 6.1.3
6.1.5

OceanStor Dorado 3000 6.1.6

OceanStor Dorado 5000 6.1.0

6.1.2
OceanStor Dorado 6000
6.1.3
OceanStor Dorado 8000
6.1.5
OceanStor Dorado 18000 6.1.6

NOTICE

This document is updated periodically with the software version. The operations
described in this document use the latest version as an example. Note that the
supported functions and features vary according to the software version. The
content in this document is for reference only.

Intended Audience
This document is intended for:

● Technical support engineers

● Maintenance engineers

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. ii

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File About This Document

Symbol Conventions
The symbols that may be found in this document are defined as follows.

Symbol Description

Indicates a hazard with a high level of risk which, if not

avoided, will result in death or serious injury.

Indicates a hazard with a medium level of risk which, if not

avoided, could result in death or serious injury.

Indicates a hazard with a low level of risk which, if not

avoided, could result in minor or moderate injury.

Indicates a potentially hazardous situation which, if not

avoided, could result in equipment damage, data loss,
performance deterioration, or unanticipated results.
NOTICE is used to address practices not related to personal
injury.

Supplements the important information in the main text.

NOTE is used to address information not related to personal
injury, equipment damage, and environment deterioration.

Change History
Changes between document issues are cumulative. The latest document issue
contains all the changes made in earlier issues.

Issue 07 (2023-07-15)
This issue is the seventh official release. The updates are as follows:
Optimized descriptions about some operations.

Issue 06 (2023-04-20)
This issue is the sixth official release. The updates are as follows:
Optimized descriptions about some operations.

Issue 05 (2022-11-15)
This issue is the fifth official release. The updates are as follows:
Optimized descriptions about some operations.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. iii

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File About This Document

Issue 04 (2022-08-25)
This issue is the fourth official release.

Issue 03 (2022-04-15)
This issue is the third official release.

Issue 02 (2022-01-25)
This is the second official release. The updates are as follows:
Optimized descriptions about some operations.

Issue 01 (2021-09-30)
This issue is the first official release.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. iv

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File Contents

Contents

About This Document................................................................................................................ ii

1 Feature Description................................................................................................................. 1
1.1 Overview.................................................................................................................................................................................... 1
1.2 License Requirements............................................................................................................................................................ 2
1.3 Working Principles.................................................................................................................................................................. 3
1.4 Application Scenarios............................................................................................................................................................. 7

2 Configuring SmartDedupe and SmartCompression........................................................ 9

2.1 Configuration with the Effective Capacity License...................................................................................................... 9
2.2 Configuration with the SmartDedupe & SmartCompression License (Applicable to Versions Earlier
Than 6.1.3)..................................................................................................................................................................................... 11
2.3 Configuration with the SmartDedupe & SmartCompression License (Applicable to 6.1.3 and Later)... 12

3 Managing SmartDedupe and SmartCompression......................................................... 15

3.1 Management with the Effective Capacity License.................................................................................................... 15
3.2 Management with the SmartDedupe & SmartCompression License................................................................. 15
3.2.1 Viewing the System's Overall Data Reduction Information............................................................................... 15
3.2.2 Viewing Data Reduction Information of a Storage Pool..................................................................................... 16
3.2.3 Viewing the SmartDedupe and SmartCompression Status of a File System................................................17

A Configuration and Management Using the CLI.............................................................19

B How to Obtain Help............................................................................................................. 22
B.1 Preparations for Contacting Huawei.............................................................................................................................. 22
B.1.1 Collecting Troubleshooting Information....................................................................................................................22
B.1.2 Making Debugging Preparations................................................................................................................................. 22
B.2 How to Use the Document............................................................................................................................................... 23
B.3 How to Obtain Help from Website................................................................................................................................ 23
B.4 Ways to Contact Huawei................................................................................................................................................... 23

C Glossary................................................................................................................................... 24
D Acronyms and Abbreviations............................................................................................. 40

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. v

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 1 Feature Description

1 Feature Description

About This Chapter

Two of Huawei's most reliable storage offerings, SmartDedupe and
SmartCompression, reduce storage space consumption and improve storage space
utilization to meet demands of growing data. In addition, the service life of SSDs
can be prolonged because the amount of data that is written into SSDs and data
write count are reduced.
1.1 Overview
1.2 License Requirements
1.3 Working Principles
1.4 Application Scenarios

1.1 Overview
This section introduces the background, definition, and benefits of SmartDedupe
and SmartCompression.

Background
For any company, data is the core asset. With the demand to find value in the
massive volumes of data that rises with rapid business growth, companies will
need an ever-larger storage capacity. Fast data growth poses the following
challenges:

● Business data may overlap, causing redundant copies and unnecessary storage
device procurement expenses.
● Device maintenance and management become complex as more devices are
added, including huge expenses spent on equipment rooms, power supply,
and cooling systems.

The consequent maintenance costs of redundant data have far exceeded its value.
Therefore, storage system administrators are looking for ways to reduce redundant
data while ensuring data integrity and accuracy.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 1

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 1 Feature Description

For all-flash storage systems, the amount of data that is written into SSDs and
data write count must be reduced in the service operating process due to the
erase/write cycle and service life issues of SSDs.

Data deduplication and compression technologies are common data reduction

technologies aimed at improving data transfer, processing, and storage efficiency
with less redundant data. In addition, the two technologies can reduce the data
write count, minimizing the wear of SSDs and prolonging their service life.

Definition
SmartDedupe and SmartCompression are developed by Huawei to provide state of
the art functions, including smart data deduplication and data compression.

● SmartDedupe deletes duplicate data blocks from a storage system, reducing

storage space consumption. The storage systems support similarity-based
deduplication.
● SmartCompression reorganizes data to save storage space and improve the
data transfer, processing, and storage efficiency without any data loss. The
storage systems support inline compression.

Benefits
Table 1-1 describes the benefits of SmartDedupe and SmartCompression.

Table 1-1 Benefits

Benefit Description

Less data storage SmartDedupe and SmartCompression can effectively

space reduce redundant data and data storage space.

Reduced initial Fewer storage devices are required to store the same
procurement costs amount of data.

Lower total cost of Less management manpower is needed because fewer

ownership (TCO) storage devices are purchased. Costs in room space,
power consumption, and maintenance drop accordingly.

Prolonged service The amount of data that is written into SSDs and the
life of SSDs data write count are reduced. Therefore, SSDs are less
worn and their service life is prolonged.

1.2 License Requirements

This section describes the license requirements of SmartDedupe and
SmartCompression.

License Requirements
SmartDedupe and SmartCompression are two value-added features.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 2

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 1 Feature Description

Both of them are available after you have purchased the effective capacity license
or SmartDedupe & SmartCompression software license.

1.3 Working Principles

The SmartDedupe and SmartCompression features deduplicate and compress data
respectively to reduce redundant data and save storage capacity. Moreover, the
features reduce the number of write requests to and data volume of SSDs,
prolonging the service life of SSDs.
The storage system provides an adaptive deduplication policy that combines inline
deduplication and similarity-based deduplication. The system adaptively performs
deduplication and compression based on service data characteristics in different
scenarios. Adaptive deduplication and compression maximize the data reduction
ratio. Figure 1-1 shows the system processing flow.

Figure 1-1 Adaptive deduplication and compression process

Write user data to disks.

Adaptive dedupe
algorithm

Similarity-based dedupe
Inline dedupe Calculate fingerprints for
similarity-based dedupe.
Compression Key technique:
Inline Similarity-based dedupe
Key techniques:
compression Opportunity Dedupe Fingerprint
1. Compression
table processing table
algorithm
Fingerprint
2. Data compaction
Data
compaction
Data

Adaptive dedupe algorithm: distributes requests based on data

characteristics.
Storage pool Opportunity table: saves similar fingerprints.
Fingerprint table: saves fingerprints of data that has been
deduplicated.

1. When a user writes data, the adaptive deduplication algorithm identifies data
suitable for inline deduplication based on data characteristics and directly
performs inline deduplication.
2. The adaptive deduplication algorithm identifies data suitable for similarity-
based deduplication based on data characteristics, calculates similar
fingerprints (SFPs), and adds the SFPs to the similarity-based deduplication
opportunity table. Then the system compresses the user data, writes the
compressed data to the storage pool, and returns a success message.
3. The background deduplication task finds similar data in the opportunity table
and reads the data from disks for similarity-based deduplication. After the
deduplication is complete, the fingerprint table is updated.

Basic Concepts
The basic concepts of SmartDedupe and SmartCompression are as follows:

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 3

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 1 Feature Description

● Deduplication data block size: Specifies the granularity of data that will be
deduplicated in a storage system.
● Compression data block size: Specifies the granularity of data that will be
compressed in a storage system.
● Similarity-based deduplication: The system divides data into blocks of a fixed
size and analyzes the similarity among the blocks. Then, the system
deduplicates the identical data blocks and performs combining compression
on the similar data blocks.
● Fingerprint: The fingerprint is a fixed-length binary numeric value. In a
storage system, all the mappings between data block fingerprints and data
storage locations are stored in the fingerprint table.
● Similar fingerprint (SFP): Specifies the similarities among data. If two pieces
of data have the same SFP, the contents of the two pieces of data are
partially or completely the same.
● Gradient fingerprint (GFP): A piece of data may be similar to multiple pieces
of other data, and therefore has multiple SFPs. To ensure that fingerprints
with high similarities are preferentially processed during deduplication, the
system also records the GFPs for describing data similarities when calculating
SFPs.
NOTE

Only 6.1.2 and later versions support GFPs.

● Opportunity table: Saves data blocks' fingerprint and location information,
and identifies hot data.
● Byte-by-byte comparison: When a storage system searches for duplicate data
blocks, it will compare fingerprints of data blocks. If the fingerprints are the
same, the system compares the data blocks byte by byte.
● Deduplication metadata: Saves information about deduplication. For example,
the metadata saves the fingerprint information about data blocks and the
storage locations of data after deduplication is executed.

SmartDedupe
Figure 1-2 shows the similarity-based deduplication process.

NOTE

In 6.1.5 and later versions, you can run the change disk_domain general
disk_domain_id=? dedup_method=? command on the CLI in developer mode to change
the deduplication mode, which can be inline (inline deduplication) or offline (similarity-
based deduplication).

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 4

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 1 Feature Description

Figure 1-2 Similarity-based deduplication process

Step 1: Write data to disks,

calculate fingerprint Step 2: Periodically perform similarity-based
information, and write the deduplication on the data.
information into the
opportunity table.

Start

Start
Divide the written data
into blocks.
Check whether similar data blocks are the
same based on byte-by-byte comparison.
Calculate SFPs and GFPs If yes, perform fixed-length deduplication.
Periodically check whether Yes
of the new data blocks. If no, perform delta compression, record
SFPs exist in the opportunity fingerprint information to the fingerprint
table. table, update fingerprint information to
Write the data blocks to the metadata of the data blocks, and
disks and record the reclaim the space of these data blocks.
data blocks' fingerprint No
and location
information in the
opportunity table.

End

Step 1:
1. The storage system divides newly-written data into blocks. The Application
Request Size set on the file system is the block size.
2. The storage system uses a similar fingerprint algorithm to calculate the SFPs
and GFPs of the new data blocks.
NOTE

Only 6.1.2 and later versions support GFPs. For 6.1.0, only SFPs of the newly-written
data blocks are calculated.
3. The storage system writes the data blocks to disks and records data blocks'
fingerprint and location information in the opportunity table.
Step 2:
1. The storage system periodically checks whether SFPs exist in the opportunity
table.
– If yes, go to 2.
– If no, continue the periodic check.
2. The storage system checks whether similar data blocks are the same based on
byte-by-byte comparison.
– If yes, the storage system considers the new data block redundant and
deletes it. Then, the storage system points the fingerprint and storage
location of the new data block to that of the existing one in the
fingerprint table.
– If no, the storage system performs combining compression on the new
data block, records its fingerprint in the fingerprint table, updates the
fingerprint to the metadata of the data block, and reclaims the storage
space of the data block.
For example, file system 1, file system 2, and file system 3 in a storage system
have the same application request size and enabling status of SmartDedupe and

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 5

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 1 Feature Description

SmartCompression. Table 1-2 lists the existing data blocks in file system 1, file
system 2, and file system 3 as well as the results of comparison between new data
blocks J, K, and L in file system 1 and the existing data blocks.

Table 1-2 Characteristics of new data blocks

File System Existing Data Block Characteristic of New Data
Name Block

File system Data blocks A, B, and C ● The SFP of data block J is

1 stored in the opportunity
table. Data block J is the
same as data block E in byte-
by-byte comparison.
● The SFP of data block K is
stored in the opportunity
table. Data block K is
different but similar to data
block I in byte-by-byte
comparison.
● The fingerprint of data block
L is not found in the
opportunity table.

File system Data blocks D, E, and F -

2

File system Data blocks G, H, and I -

3

Figure 1-3 shows the data deduplication results when SmartDedupe is disabled
and enabled respectively.

Figure 1-3 Data deduplication results

SmartDedupe disabled SmartDedupe enabled

J J
K K
L L

A B C D E F G H I
Data delivered A B C D E F G H I

by the host
File
system 1
File
system 2
File
system 3
... File
system 1
File
system 2
File
system 3
...

Storage pool Storage pool

J
Data block J is the same as data block E.
J
Data is directly written to Data block K is similar to data block I.
K
K
L persistent storage media without Delta compression is performed.
L
fingerprint calculation. Data block L is written and its fingerprint
is not found in the opportunity table.

Data written J K L L
to the A B C D E F G H I A B C D E F G H I K

storage
system
File
system 1
File
system 2
File
system 3
... File File File ...
system 1 system 2 system 3

Storage pool Storage pool

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 6

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 1 Feature Description

SmartCompression
The storage systems support inline compression. If the SmartCompression feature
is enabled for a file system when the file system is created, the storage system will
compress all the data written to the file system.

Figure 1-4 shows data compression results.

Figure 1-4 Data compression results

SmartCompression disabled SmartCompression enabled

Data delivered A host sends a data A host sends a data

by the host write request. write request.

File system File system

Data is directly written to Data is compressed and then

the storage system without written to the storage system.
Data written to compression.
the storage
system File system File system

Space occupied by the existing data

Space occupied by new data

1.4 Application Scenarios

SmartDedupe and SmartCompression are Huawei's deduplication and data
compression technologies, respectively. They can work independently or together
in scenarios such as database, virtual desktop, and email service. The benefits of
using these features include storage space saving, storage efficiency improvement,
and investment and O&M cost reduction.

SmartCompression
● Databases
Databases typically have large volumes of stored data. With
SmartCompression, over 65% of storage space can be saved with only a
negligible dip in performance.
● File services
SmartCompression is also widely applied in file services.
● Engineering, natural disaster, and geological data
Similar to database backup, this data has a unified storage format but with
considerable variations between data sets. Using SmartCompression helps
save storage space.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 7

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 1 Feature Description

SmartDedupe and SmartCompression Combined

SmartDedupe and SmartCompression can be used together for data test or
development systems, file service systems, and engineering data systems.
When using Virtual Desktop Infrastructure (VDI), VDI is generally used to create
multiple virtual mirrors on a single storage device. However, these mirrors contain
a high amount of duplicate data. As duplicate data increases, the storage system
may not be able to operate normally. Using SmartDedupe and SmartCompression
prevents this.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 8

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 2 Configuring SmartDedupe and SmartCompression

2 Configuring SmartDedupe and

SmartCompression

You can import an effective capacity license or a SmartDedupe &

SmartCompression license to enable SmartDedupe and SmartCompression.
2.1 Configuration with the Effective Capacity License
2.2 Configuration with the SmartDedupe & SmartCompression License (Applicable
to Versions Earlier Than 6.1.3)
2.3 Configuration with the SmartDedupe & SmartCompression License (Applicable
to 6.1.3 and Later)

2.1 Configuration with the Effective Capacity License

Context
● If the effective capacity license is used, SmartDedupe and SmartCompression
are enabled by default when you create a file system. You are advised not to
disable them. Otherwise, the physical capacity may be insufficient.
● In traditional capacity mode, SmartDedupe and SmartCompression are
disabled by default.
● You can run the change user_mode current_mode user_mode=developer
command to enter the developer mode. For details about the commands in
developer mode, visit Command/Event/Error Code Query.

Precautions
The application type of a file system cannot be modified once specified. You are
advised to specify the application type based on the service I/O model.

Configuration Method
Some application types are preset for typical application scenarios of file systems.
For the preset application types, the application request size and the SmartDedupe
and SmartCompression status have been configured. When creating a file system

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 9

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 2 Configuring SmartDedupe and SmartCompression

on the CLI or DeviceManager, you only need to specify an appropriate application

type.

The preset application types include NAS_Default, NAS_Virtual_Machine,

NAS_Database, NAS_Large_File, Office_Automation, NAS_EDA, and
NAS_Others.

When a file system is created on DeviceManager, the default application type is

NAS_Default. You can select an application type that matches your service I/O
model by referring to the following application type details. Table 2-1 lists the
application request size and the SmartDedupe and SmartCompression status for
each application type.

Table 2-1 Preset application types

Application Type Application SmartDedup SmartCompres

Request Size e sion

NAS_Default 16 KB Enabled Enabled

NAS_Virtual_Machine 16 KB Enabled Enabled

NAS_Database 8 KB Enabled Enabled

NAS_Large_File 32 KB Disabled Enabled

Office_Automation 16 KB Enabled Enabled

NAS_EDA 16 KB Enabled Enabled

NAS_Others 16 KB Enabled Enabled

NOTE

● NAS_Others applies only to storage systems of 6.1.3 and later versions.

● If the preset application types do not meet service requirements, run the create
workload_type general name=? io_size=? dedup_enabled=? compression_enabled=?
template_type=file_system fs_layer_distribution_algorithm=? id=? command in
developer mode to create an application type.

To specify the application type when creating a file system on the CLI, run the
create file_system general name=? pool_id=? capacity=? alloc_type=?
workload_type_id=? command. After creation, run the show file_system general
file_system_name=? command. Workload Type Name in the command output
indicates the application type of the file system. For details, visit Command/
Event/Error Code Query.

Follow-up Procedure
To query the details (including the SmartDedupe and SmartCompression status)
about an application type, run the show workload_type detail_info command in
developer mode.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 10

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 2 Configuring SmartDedupe and SmartCompression

2.2 Configuration with the SmartDedupe &

SmartCompression License (Applicable to Versions
Earlier Than 6.1.3)
Context
● If the SmartDedupe & SmartCompression license is used, SmartDedupe and
SmartCompression are enabled by default when you create a file system.
● If the SmartDedupe & SmartCompression license is used, the enabling status
of SmartDedupe and SmartCompression corresponding to each application
type will be displayed when a file system is created on DeviceManager.
● You can run the change user_mode current_mode user_mode=developer
command to enter the developer mode. For details about the commands in
developer mode, visit Command/Event/Error Code Query.

Precautions
The application type of a file system cannot be modified once specified. You are
advised to specify the application type based on the service I/O model.

Configuration Method
Some application types are preset for typical application scenarios of file systems.
For the preset application types, the application request size and the SmartDedupe
and SmartCompression status have been configured. When creating a file system
on the CLI or DeviceManager, you only need to specify an appropriate application
type.
The preset application types include NAS_Default, NAS_Virtual_Machine,
NAS_Database, NAS_Large_File, Office_Automation, and NAS_EDA.
When a file system is created on DeviceManager, the default application type is
NAS_Default. You can select an application type that matches your service I/O
model by referring to the following application type details. Table 2-2 lists the
application request size and the SmartDedupe and SmartCompression status for
each application type.

Table 2-2 Preset application types

Application Type Application SmartDedup SmartCompres

Request Size e sion

NAS_Default 16 KB Enabled Enabled

NAS_Virtual_Machine 16 KB Enabled Enabled

NAS_Database 8 KB Enabled Enabled

NAS_Large_File 32 KB Disabled Enabled

Office_Automation 16 KB Enabled Enabled

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 11

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 2 Configuring SmartDedupe and SmartCompression

Application Type Application SmartDedup SmartCompres

Request Size e sion

NAS_EDA 16 KB Enabled Enabled

NOTE

If the preset application types do not meet service requirements, run the create
workload_type general name=? io_size=? dedup_enabled=? compression_enabled=?
template_type=file_system fs_layer_distribution_algorithm=? id=? command in
developer mode to create an application type.

When creating a file system on the CLI:

● To specify an application type, run the create file_system general name=?

pool_id=? capacity=? alloc_type=? workload_type_id=? command. After
creation, run the show file_system general file_system_name=? command.
Workload Type Name in the command output indicates the application type
of the file system.
● To specify the deduplication and compression functions, run the create
file_system general name=? pool_id=? capacity=? alloc_type=?
compression_enabled=? dedup_enabled=? block_size=? command in
developer mode. After creation, run the show file_system general
file_system_name=? command in developer mode and query the values of
Dedup Enabled and Compression Enabled in the command output.

Follow-up Procedure
To query the details (including the SmartDedupe and SmartCompression status)
about an application type, run the show workload_type detail_info command in
developer mode.

2.3 Configuration with the SmartDedupe &

SmartCompression License (Applicable to 6.1.3 and
Later)
Context
● If the SmartDedupe & SmartCompression license is used, SmartDedupe and
SmartCompression are enabled by default when you create a file system.
● If the SmartDedupe & SmartCompression license is used, the enabling status
of SmartDedupe and SmartCompression corresponding to each application
type will be displayed when a file system is created on DeviceManager.
● You can run the change user_mode current_mode user_mode=developer
command to enter the developer mode. For details about the commands in
developer mode, visit Command/Event/Error Code Query.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 12

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 2 Configuring SmartDedupe and SmartCompression

Precautions
The application type of a file system cannot be modified once specified. You are
advised to specify the application type based on the service I/O model.

Configuration Method
Some application types are preset for typical application scenarios of file systems.
For the preset application types, the application request size and the SmartDedupe
and SmartCompression status have been configured. When creating a file system
on the CLI or DeviceManager, you only need to specify an appropriate application
type.

The preset application types include NAS_Default, NAS_Virtual_Machine,

NAS_Database, NAS_Large_File, Office_Automation, NAS_EDA, and
NAS_Others.

When a file system is created on DeviceManager, the default application type is

NAS_Default. You can select an application type that matches your service I/O
model by referring to the following application type details.

● When licenses other than SmartDedupe & SmartCompression Software

License Basic are used:
Table 2-3 lists the application request size and the SmartDedupe and
SmartCompression status for each application type.

Table 2-3 Preset application types

Application Type Application SmartDedu SmartCompre

Request Size pe ssion

NAS_Default 16 KB Enabled Enabled

NAS_Virtual_Machine 16 KB Enabled Enabled

NAS_Database 8 KB Enabled Enabled

NAS_Large_File 32 KB Disabled Enabled

Office_Automation 16 KB Enabled Enabled

NAS_EDA 16 KB Enabled Enabled

NAS_Others 16 KB Enabled Enabled

NOTE

● NAS_Others applies only to storage systems of 6.1.3 and later versions.

● If the preset application types do not meet service requirements, run the create
workload_type general name=? io_size=? dedup_enabled=?
compression_enabled=? template_type=file_system
fs_layer_distribution_algorithm=? id=? command in developer mode to create an
application type.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 13

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 2 Configuring SmartDedupe and SmartCompression

● When SmartDedupe & SmartCompression Software License Basic is used,

by default, SmartDedupe and SmartCompression are enabled only for
NAS_Others, and are disabled for other preset application types.
Table 2-4 lists the application request size and the SmartDedupe and
SmartCompression status for each application type.

Table 2-4 Preset application types

Application Type Application SmartDedu SmartCompre

Request Size pe ssion

NAS_Default 16 KB Disabled Disabled

NAS_Virtual_Machine 16 KB Disabled Disabled

NAS_Database 8 KB Disabled Disabled

NAS_Large_File 32 KB Disabled Disabled

Office_Automation 16 KB Disabled Disabled

NAS_EDA 16 KB Disabled Disabled

NAS_Others 16 KB Enabled Enabled

NOTE

● NAS_Others applies only to storage systems of 6.1.3 and later versions.

● If the preset application types do not meet service requirements, run the create
workload_type general name=? io_size=? dedup_enabled=?
compression_enabled=? template_type=file_system
fs_layer_distribution_algorithm=? id=? command in developer mode to create an
application type.

When creating a file system on the CLI:

● To specify an application type, run the create file_system general name=?

pool_id=? capacity=? alloc_type=? workload_type_id=? command. After
creation, run the show file_system general file_system_name=? command.
Workload Type Name in the command output indicates the application type
of the file system.
● To specify the deduplication and compression functions, run the create
file_system general name=? pool_id=? capacity=? alloc_type=?
compression_enabled=? dedup_enabled=? block_size=? command in
developer mode. After creation, run the show file_system general
file_system_name=? command in developer mode and query the values of
Dedup Enabled and Compression Enabled in the command output.

Follow-up Procedure
To query the details (including the SmartDedupe and SmartCompression status)
about an application type, run the show workload_type detail_info command in
developer mode.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 14

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 3 Managing SmartDedupe and SmartCompression

3 Managing SmartDedupe and

SmartCompression

3.1 Management with the Effective Capacity License

3.2 Management with the SmartDedupe & SmartCompression License

3.1 Management with the Effective Capacity License

You can run the show storage_pool data_info command to view the
deduplication and compression ratios of a storage pool. For details about the
command, visit Command/Event/Error Code Query.

3.2 Management with the SmartDedupe &

SmartCompression License

3.2.1 Viewing the System's Overall Data Reduction

Information
After the SmartDedupe & SmartCompression license has been imported, the
DeviceManager home page displays the data reduction information, such as the
reduction ratio, capacity before and after reduction, and capacity trend. Figure 3-1
shows an example. The capacity trend is predicted based on the physical capacity.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 15

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 3 Managing SmartDedupe and SmartCompression

Figure 3-1 DeviceManager home page

NOTE

● The screenshot is for reference only and the actual displayed information may vary.
● If both the effective capacity license and the SmartDedupe & SmartCompression license
are imported to the storage system, the DeviceManager home page displays the data
reduction information as the SmartDedupe & SmartCompression license takes effect,
and does not display the effective capacity.

3.2.2 Viewing Data Reduction Information of a Storage Pool

After the SmartDedupe & SmartCompression license has been imported, you can
query the data reduction information of each storage pool, including the data
reduction ratio and total space saving ratio.
On DeviceManager, you can use either of the following methods to query the
information:
1. Choose System > Storage Pools and view the data reduction ratio and total
space saving ratio in the function pane. You can click on the right to select
the parameters you want to view.

Figure 3-2 Viewing overall storage pool information

2. Choose System > Storage Pools. Click the name of the desired storage pool.
On the page that is displayed, view the data reduction ratio and total space
saving ratio.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 16

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 3 Managing SmartDedupe and SmartCompression

Figure 3-3 Viewing detailed storage pool information (applicable to 6.1.0)

Figure 3-4 Viewing detailed storage pool information (applicable to 6.1.2 and
later versions)

NOTE

● The screenshot is for reference only and the actual displayed information may vary.
● In admin mode on the CLI, run the show storage_pool general pool_id=? command
and query Data Reduction Ratio of the storage pool in the command output.
● In developer mode on the CLI, run the show storage_pool data_info command and
query the data reduction ratio of the storage pool. For details about the command, visit
Command/Event/Error Code Query.

3.2.3 Viewing the SmartDedupe and SmartCompression Status

of a File System
After the SmartDedupe & SmartCompression license has been imported, click the
name of a file system and check whether SmartDedupe and SmartCompression
are enabled for this file system.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 17

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File 3 Managing SmartDedupe and SmartCompression

Figure 3-5 Viewing file system details

NOTE

The screenshot is for reference only and the actual displayed information may vary.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 18

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File A Configuration and Management Using the CLI

A Configuration and Management Using

the CLI

This section provides some CLI commands for configuring and managing
SmartDedupe and SmartCompression (for file services).

NOTE

● The CLI commands supported by different models may vary.

● For more CLI commands and their description, refer to Command/Event/Error Code
Query.

Configuring SmartDedupe and SmartCompression Using CLI Commands

Table A-1 Commands for configuring SmartDedupe and SmartCompression

Operation Command

Creating an Application create workload_type general

Type

Specifying the Application create file_system general name=? pool_id=? capacity=?

alloc_type=? workload_type_id=?
Type During File System
Creation NOTE
If the SmartDedupe & SmartCompression license is used,
you can run the create file_system general name=?
pool_id=? capacity=? alloc_type=?
compression_enabled=? dedup_enabled=? block_size=?
command to specify the deduplication and compression
status separately when creating a file system.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 19

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File A Configuration and Management Using the CLI

Managing SmartDedupe and SmartCompression Using CLI Commands

Table A-2 Commands for managing SmartDedupe and SmartCompression

Operation Command

Creating an Application create workload_type general

Type for a File System

Querying Details About Run the following command in developer mode:

an Application Type show workload_type detail_info

Modify Application Type change workload_type general

Information NOTE
When an application type is used by a file system, the
parameters of the application type cannot be modified.

Deleting an Application delete workload_type general

Type NOTE
An application type used by a file system cannot be
deleted.

Querying the Application show file_system general file_system_id=?

Type of a File System

Querying the Run the following command in developer mode:

SmartDedupe and show file_system reduction_switch file_system_id=?
SmartCompression Status
of a File System

Modifying the Run the following command in developer mode:

SmartDedupe and change file_system enabled file_system_id=? dedup_enabled=?
compression_enabled=?
SmartCompression Status
of a File System NOTE
If the effective capacity license is used, you are advised not
to disable SmartDedupe and SmartCompression.
Otherwise, the physical capacity may be insufficient.

Querying Data Reduction Run the following command in developer mode:

Information of a Storage show storage_pool data_info pool_id=?
Pool

Querying the Run the following command in developer mode:

Deduplication Mode of a show disk_domain general disk_domain_id=?
Disk Domain NOTE
This command applies to 6.1.5 and later versions.

Changing the Run the following command in developer mode:

Deduplication Mode of a change disk_domain general disk_domain_id=? dedup_method=?
Disk Domain NOTE
This command applies to 6.1.5 and later versions.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 20

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File A Configuration and Management Using the CLI

Table A-3 Commands when the SmartDedupe & SmartCompression license is used
Operation Command

Querying the Data show storage_pool general pool_id=?

Reduction Ratio of a
Storage Pool

Querying the show file_system general file_system_id=?

SmartDedupe and
SmartCompression Status
of a File System

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 21

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File B How to Obtain Help

B How to Obtain Help

If a tough or critical problem persists in routine maintenance or troubleshooting,

contact Huawei technical support.

B.1 Preparations for Contacting Huawei

To better resolve the fault, you are advised to collect troubleshooting information
and make debugging preparations before contacting Huawei.

B.1.1 Collecting Troubleshooting Information

You need to collect troubleshooting information before troubleshooting.
You need to collect the following information:
● Name and address of the customer
● Contact person and telephone number
● Time when the fault occurred
● Description of the fault phenomena
● Device type and software version
● Measures taken after the fault occurs and the related results
● Troubleshooting level and required solution deadline

B.1.2 Making Debugging Preparations

When you contact Huawei for help, the technical support engineer of Huawei
might assist you to do certain operations to collect information about the fault or
rectify the fault directly.
Before contacting Huawei for help, you need to prepare the boards, port modules,
screwdrivers, screws, cables for serial ports, network cables, and other required
materials.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 22

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File B How to Obtain Help

B.2 How to Use the Document

Huawei provides guide documents shipped with the device. The guide documents
can be used to handle the common problems occurring in daily maintenance or
troubleshooting.
To better solve the problems, use the documents before you contact Huawei for
technical support.

B.3 How to Obtain Help from Website

Huawei provides users with timely and efficient technical support through the
regional offices, secondary technical support system, telephone technical support,
remote technical support, and onsite technical support.
Contents of the Huawei technical support system are as follows:
● Huawei headquarters technical support department
● Regional office technical support center
● Customer service center
● Technical support website: https://support.huawei.com/enterprise/
You can query how to contact the regional offices at https://
support.huawei.com/enterprise/.

B.4 Ways to Contact Huawei

Huawei Technologies Co., Ltd. provides customers with comprehensive technical
support and service. For any assistance, contact our local office or company
headquarters.
Huawei Technologies Co., Ltd.
Address: Huawei Industrial Base Bantian, Longgang Shenzhen 518129 People's
Republic of China
Website: https://e.huawei.com/

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 23

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

C Glossary

A
AC power module The module that transfers the external AC power
supply into the power supply for internal use.
Application server A service processing node (a computer device) on the
network. Application programs of data services run
on the application server.
Asynchronous remote A kind of remote replication. When the data at the
replication primary site is updated, the data does not need to be
updated synchronously at the mirroring site to finish
the update. In this way, performance is not reduced
due to data mirroring.
Air baffle It optimizes the ventilation channels and improves
the heat dissipation capability of the system.
Audit log guarantee A mode for recording audit logs. This mode
mode preferentially ensures that the audit log function is
normal and no audit log is missing.
Audit log non- A mode for recording audit logs. In this mode,
guarantee mode services are running properly. Audit logs may be
missing.

B
Backup A collection of data stored on (usually removable)
non-volatile storage media for purposes of recovery
in case the original copy of data is lost or becomes
inaccessible; also called a backup copy. To be useful
for recovery, a backup must be made by copying the
source data image when it is in a consistent state.
The act of creating a backup.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 24

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

Backup window An interval of time during which a set of data can be

backed up without seriously affecting applications
that use the data.
Bandwidth The numerical difference between the upper and
lower frequencies of a band of electromagnetic
radiation. A deprecated synonym for data transfer
capacity that is often incorrectly used to refer to
throughput.
Baud rate The maximum rate of signal state changes per
second on a communications circuit. If each signal
state change corresponds to a code bit, then the
baud rate and the bit rate are the same. It is also
possible for signal state changes to correspond to
more than one code bit, so the baud rate may be
lower than the code bit rate.
Bit error An incompatibility between a bit in a transmitted
digital signal and the corresponding bit in the
received digital signal.
Bit error rate The probability that a transmitted bit will be
erroneously received. The bit error rate (BER) is
measured by counting the number of bits in error at
the output of a receiver and dividing by the total
number of bits in the transmission. BER is typically
expressed as a negative power of 10.
Bonding Bonding of multiple independent physical network
ports into a logical port, which ensures the high
availability of server network connections and
improves network performance.
Boundary scan A test methodology that uses shift registers in the
output connections of integrated circuits (ICs). One IC
is often connected to the next IC. A data pattern is
passed through the chain and the observed returned
data stream affected by the circuit conditions gives
an indication of any faults present. The system is
defined under IEEE standard 1149.1 and is also
known as Joint Test Action Group (JTAG).
Browser/Server Architecture that defines the roles of the browser and
server. The browser is the service request party and
the server is the service provider.
Built-in FRU Alarm It indicates errors on the built-in FRUs of a controller,
indicator such as errors on fans or memory modules.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 25

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

C
Cache hit ratio The ratio of the number of cache hits to the number
of all I/Os during a read task, usually expressed as a
percentage.
Captive screw Specially designed to lock into place on a parent
board or motherboard, allowing for easy installation
and removal of attached pieces without release of
the screw.
Challenge Handshake A password-based authentication protocol that uses a
Authentication challenge to verify that a user has access rights to a
Protocol system. A hash of the supplied password with the
challenge is sent for comparison so the cleartext
password is never sent over the connection.
Compliance mode A protection mode of WORM. In compliance mode,
files within their protection period cannot be changed
or deleted by either the file user or by the system
administrator. Files with expired protection periods
can be deleted but not changed by the file user or
the system administrator.
Controller The control logic in a disk or tape that performs
command decoding and execution, host data transfer,
serialization and deserialization of data, error
detection and correction, and overall management of
device operations. The control logic in a storage
subsystem that performs command transformation
and routing, aggregation (RAID, mirroring, striping, or
other), high-level error recovery, and performance
optimization for multiple storage devices.
Controller enclosure An enclosure that accommodates controllers and
provides storage services. It is the core component of
a storage system and generally consists of
components, such as controllers, power supplies, and
fans.
Copying A pair state. The state indicates that the source LUN
data is being synchronized to the target LUN.
Container root Space used to store the metadata for running
directory container images and container instances.
Container image An image is a special file system, which provides the
programs, libraries, resources, and configuration files
required for running containers. It also contains
configuration parameters, for example, for
anonymous disks, environment variables, and users.
The image does not contain dynamic data, and its
content will not be modified after construction.
Containerized An image can start multiple containers, and an
application application can contain one or a group of containers.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 26

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

Container node Controller that runs the container service.

Configuration item list A series of modifiable configuration items defined in
the Helm chart of the container.
Container service Containerized application management service, which
manages the lifecycle of containerized applications.

D
Data compression The process of encoding data to reduce its size. Lossy
compression (i.e., compression using a technique in
which a portion of the original information is lost) is
acceptable for some forms of data (e.g., digital
images) in some applications, but for most IT
applications, lossless compression (i.e., compression
using a technique that preserves the entire content of
the original data, and from which the original data
can be reconstructed exactly) is required.
Data flow A process that involves processing data extracted
from the source system. These processes include:
filtering, integration, calculation, and summary,
finding and solving data inconsistency, and deleting
invalid data so that the processed data meets the
requirements of the destination system for the input
data.
Data migration A movement of data or information between
information systems, formats, or media. Migration is
performed for reasons such as possible decay of
storage media, obsolete hardware or software
(including obsolete data formats), changing
performance requirements, the need for cost
efficiencies etc.
Data source A system, database (database user; database
instance), or file that can make BOs persistent.
Deduplication The replacement of multiple copies of data — at
variable levels of granularity — with references to a
shared copy in order to save storage space and/or
bandwidth.
Dirty data Data that is stored temporarily on the cache and has
not been written onto disks.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 27

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

Disaster recovery The recovery of data, access to data and associated

processing through a comprehensive process of
setting up a redundant site (equipment and work
space) with recovery of operational data to continue
business operations after a loss of use of all or part
of a data center. This involves not only an essential
set of data but also an essential set of all the
hardware and software to continue processing of that
data and business. Any disaster recovery may involve
some amount of down time.
Disk array A set of disks from one or more commonly accessible
disk subsystems, combined with a body of control
software. The control software presents the disks'
storage capacity to hosts as one or more virtual disks.
Control software is often called firmware or
microcode when it runs in a disk controller. Control
software that runs in a host computer is usually
called a volume manager.
Disk domain A disk domain consists of the same type or different
types of disks. Disk domains are isolated from each
other. Therefore, services carried by different disk
domains do not affect each other in terms of
performance and faults (if any).
Disk enclosure Consists of the following parts in redundancy:
expansion module, disk, power module, and fan
module. System capacity can be expanded by
cascading multiple disk enclosures.
Disk location The process of locating a disk in the storage system
by determining the enclosure ID and slot ID of the
disk.
Disk utilization The percentage of used capacity in the total available
capacity.

E
eDevLUN Logical storage array space created by a third-party
storage array.
Expansion module A component used for expansion.
Expansion Connects a storage system to more disk enclosures
through connection cables, expanding the capacity of
the storage system.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 28

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

F
Field replaceable unit A unit or component of a system that is designed to
be replaced in the field, i.e., without returning the
system to a factory or repair depot. Field replaceable
units may either be customer-replaceable or their
replacement may require trained service personnel.
Firmware Low-level software for booting and operating an
intelligent device. Firmware generally resides in read-
only memory (ROM) on the device.
Flash Translation Layer Flash Translation Layer (FTL) organizes and manages
host data, enables host data to be allocated to NAND
flash chips of SSDs in an orderly manner, maintains
the mapping relationship between logical block
addresses (LBAs) and physical block addresses
(PBAs), and implements garbage collection, wear
leveling, and bad block management.
Front-end port The port that connects the controller enclosure to the
service side and transfers service data. Front-end port
types are Fibre Channel and iSCSI.
Front-end interconnect On a storage device, all controllers share the front-
I/O module (FIM) end interface modules.

G
Garbage collection The process of reclaiming resources that are no
longer in use. Garbage collection has uses in many
aspects of computing and storage. For example, in
flash storage, background garbage collection can
improve write performance by reducing the need to
perform whole block erasures prior to a write.
Gateway A device that receives data via one protocol and
transmits it via another.
Global garbage With a view to defragmentation of storage arrays
collection and garbage collection of disks, global garbage
collection reduces garbage of disks by enabling
storage arrays to inform disks of not implementing
invalid data relocation and of controlling space
release so that disks and controllers consume less
space, reducing costs and prolonging the useful life
of storage arrays.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 29

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

Global system for The second-generation mobile networking standard

mobile defined by the European Telecommunications
communications Standards Institute (ETSI). It is aimed at designing a
standard for global mobile phone networks. GSM
consists of three main parts: mobile switching
subsystem (MSS), base station subsystem (BSS), and
mobile station (MS).
Global wear leveling With a view to individual characteristics of a single
disk, global wear leveling uses space allocation and
write algorithms to achieve wear leveling among
disks, preventing a disk from losing efficacy due to
excessive writes and prolonging the useful life of the
disk.

H
Hard disk tray The tray that bears the hard disk.
Heartbeat Heartbeat supports node communication, fault
diagnosis, and event triggering. Heartbeats are
protocols that require no acknowledgement. They are
transmitted between two devices. The device can
judge the validity status of the peer device.
Hit ratio The ratio of directly accessed I/Os from the cache to
all I/Os.
Hot swap The substitution of a replacement unit (RU) in a
system for a defective unit, where the substitution
can be performed while the system is performing its
normal functioning normally. Hot swaps are physical
operations typically performed by humans.
HyperMetro A value-added service of storage systems.
HyperMetro means two datasets (on two storage
systems) can provide storage services as one dataset
to achieve load balancing among applications and
failover without service interruption.
HyperMetro domain A HyperMetro configuration object generally; made
up of two storage arrays and one quorum server.
HyperMetro services can be created on a HyperMetro
domain.
HyperMetro vStore A HyperMetro vStore pair consists of two vStores,
pair that is, two tenants. After a HyperMetro relationship
is set up for a pair of vStores, the datasets in the two
vStores work in redundancy mode and provide
storage services in one dataset view, achieving hitless
service failover.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 30

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

HyperMetro-Inner On an eight-controller network, with HyperMetro-

Inner, continuous mirroring, back-end global sharing,
and three-copy technologies, a storage system can
tolerate one-by-one failures of seven controllers
among eight controllers, concurrent failures of two
controllers, and failure of a controller enclosure.
HyperDetect HyperDetect is a feature that provides ransomware
detection.
Handle A handle resides on the structural part of a module. It
is used to insert or remove a module into or from a
chassis, not helpful in saving efforts.
Helm chart A Helm chart is in TAR format. It is similar to the deb
package of APT or the rpm package of Yum. It
contains a group of yaml files that define Kubernetes
resources.

I
In-band management The management control information of the network
and the carrier service information of the user
network are transferred through the same logical
channel. In-band management enables users to
manage storage arrays through commands.
Management commands are sent through service
channels, such as I/O write and read channels. The
advantages of in-band management include high
speed, stable transfer, and no additional
management network ports required.
Initiator The system component that originates an I/O
command over an I/O interconnect. The endpoint
that originates a SCSI I/O command sequence. I/O
adapters, network interface cards, and intelligent I/O
interconnect control ASICs are typical initiators.
I/O Shorthand for input/output. I/O is the process of
moving data between a computer system's main
memory and an external device or interface such as a
storage device, display, printer, or network connected
to other computer systems. This encompasses
reading, or moving data into a computer system's
memory, and writing, or moving data from a
computer system's memory to another location.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 31

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

Intelligent ransomware The system detects known ransomware features to

detection identify whether the file systems are attacked by
ransomware. If no ransomware attack is identified,
the system analyzes and compares the changes in file
system snapshots, and uses machine learning
algorithms to further check whether the file systems
are infected by ransomware.
Interface module A replaceable field module that accommodates the
service or management ports.

L
Load balance A method of adjusting the system, application
components, and data to averagely distribute the
applied I/Os or computing requests to physical
resources of the system.
Logical unit The addressable entity within a SCSI target that
executes I/O commands.
Logical unit number The SCSI identifier of a logical unit within a target.
Industry shorthand, when phrased as "LUN", for the
logical unit indicated by the logical unit number.
LUN formatting The process of writing 0 bits in the data area of the
logical drive and generating related parity bits so that
the logical drive can be in the ready state.
LUN mapping A storage system maps LUNs to application servers
so that application servers can access storage
resources.
LUN migration A method for the LUN data to migrate between
different physical storage spaces while ensuring data
integrity and uninterrupted operation of host
services.
LUN snapshot A type of snapshot created for a LUN. This snapshot
is both readable and writable and is mainly used to
provide a snapshot LUN from point-in-time LUN
data.
Lever A lever resides on the structural part of a module. It
is used to insert or remove a module into or from a
chassis, saving efforts.
Local image repository A private repository used to store the container
images and Helm charts imported by users. It is
different from the standard image repository. The
imported images and Helm charts must meet the
compatibility requirements of the system.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 32

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

M
Maintenance terminal A computer connected through a serial port or
management network port. It maintains the storage
system.
Management interface The module that integrates one or more
module management network ports.
Management network An entity that provides means to transmit and
process network management information.
Management network The network port on the controller enclosure
port connected to the maintenance terminal. It is provided
for the remote maintenance terminal. Its IP address
can be modified with the change of the customer's
environment.

N
NVM Express A host controller interface with a register interface
and command set designed for PCI Express-based
SSDs.
NVMe SSD A solid state disk (SSD) with a non-volatile memory
express (NVMe) interface. Compared with other
SSDs, such SSDs can deliver higher performance and
shorter latency.

O
Out-of-band A management mode used during out-of-band
management networking. The management and control
information of the network and the bearer service
information of the user network are transmitted
through different logical channels.

P
Power failure When an external power failure occurs, the AC PEM
protection depends on the battery for power supply. This
ensures the integrity of the dirty data in the cache.
Pre-copy When the system monitors a failing member disk in a
RAID group, the system copies the data from the disk
to a hot spare disk in advance.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 33

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

Palm-sized NVMe SSD A palm-sized NVMe SSD is a type of NVMe SSD of

which the dimensions (H x W x D) are 160 mm x 79.8
mm x 9.5 mm (neither 3.5-inch nor 2.5-inch).

Q
Quorum server A server that can provide arbitration services for
clusters or HyperMetro to prevent the resource access
conflicts of multiple application servers.
Quorum Server Mode A HyperMetro arbitration mode. When a HyperMetro
arbitration occurs, the quorum server decides which
site wins the arbitration.

R
RAID level The application of different redundancy types to a
logical drive. A RAID level improves the fault
tolerance or performance of the logical drive but
reduces the available capacity of the logical drive.
You must specify a RAID level for each logical drive.
Ransomware file When launching attacks, ransomware usually
interception generates encrypted files with special file name
extensions. In light of this, the system intercepts the
write to files with specific file name extensions to
block the extortion from known ransomware and
protect file systems in the storage system.
Real-time ransomware Ransomware has similar I/O behavior characteristics.
detection By analyzing file I/O behavior characteristics, the
system quickly filters out abnormal files and
performs deep content analysis on the abnormal files
to detect files attacked by ransomware. Then, secure
snapshots are created for file systems where files
have been attacked, and alarms are reported to
notify the data protection administrator, limiting the
impact of ransomware and reducing losses.
Reconstruction The regeneration and writing onto one or more
replacement disks of all of the user data and check
data from a failed disk in a mirrored or RAID array. In
most arrays, a rebuild can occur while applications
are accessing data on the array's virtual disks.
Redundancy The inclusion of extra components of a given type in
a system (beyond those required by the system to
carry out its function) for the purpose of enabling
continued operation in the event of a component
failure.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 34

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

Remote replication A core technology for disaster recovery and a

foundation that implements remote data
synchronization and disaster recovery. This
technology remotely maintains a set of data mirrors
through the remote data connection function of the
storage devices that are separated in different places.
Even when a disaster occurs, the data backup on the
remote storage device is not affected. Remote
replication can be divided into synchronous remote
replication and asynchronous remote replication.
Reverse The process of restoring data from the redundancy
synchronization machine (RM) when the services of the production
machine (PM) are recovering.
Route The path that network traffic takes from its source to
its destination. On a TCP/IP network, each IP packet
is routed independently. Routes can change
dynamically.

S
Script A parameterized list of primitive I/O interconnect
operations intended to be executed in sequence.
Often used with respect to ports, most of which are
able to execute scripts of I/O commands
autonomously (without policy processor assistance).
A sequence of instructions intended to be parsed and
carried out by a command line interpreter or other
scripting language. Perl, VBScript, JavaScript and Tcl
are all scripting languages.
Serial port An input/output location (channel) that sends and
receives data (one bit at a time) to and from the CPU
of a computer or a communications device. Serial
ports are used for serial data communication and as
interfaces for some peripheral devices, such as mouse
devices and printers.
Service data The user and/or network information required for the
normal functioning of services.
Service network port The network port that is used to store services.
Simple network An IETF protocol for monitoring and managing
management protocol systems and devices in a network. The data being
monitored and managed is defined by an MIB. The
functions supported by the protocol are the request
and retrieval of data, the setting or writing of data,
and traps that signal the occurrence of events.
Single point of failure One component or path in a system, the failure of
which would make the system inoperable.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 35

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

Slot A position defined by an upper guide rail and the

corresponding lower guide rail in a frame. A slot
houses a board.
Small computer system A collection of ANSI standards and proposed
interface standards that define I/O interconnects primarily
intended for connecting storage subsystems or
devices to hosts through host bus adapters. Originally
intended primarily for use with small (desktop and
desk-side workstation) computers, SCSI has been
extended to serve most computing needs, and is
arguably the most widely implemented I/O
interconnect in use today.
Snapshot A point in time copy of a defined collection of data.
Clones and snapshots are full copies. Depending on
the system, snapshots may be of files, LUNs, file
systems, or any other type of container supported by
the system.
Snapshot copy A copy of a snapshot LUN.
Source LUN The LUN where the original data is located.
Static Priority Mode A HyperMetro arbitration mode. When a HyperMetro
arbitration occurs, the preferred site always wins the
arbitration.
Storage system An integrated system that consists of the following
parts: controller, storage array, host bus adapter,
physical connection between storage units, and all
control software.
Storage unit An abstract definition of backup storage media for
storing backup data. The storage unit is connected to
the actual storage media used to back up data.
Streaming media Streaming media is media continuously streamed
over the network. Combining technologies
concerning streaming media data collection,
compression, encoding, storage, transmission,
playback, and network communications, streaming
media can provide high-quality playback effects in
real time at low bandwidth.
Subnet A type of smaller network that forms a larger
network according to a rule, such as, forming a
network according to different districts. This
facilitates the management of a large network.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 36

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

Smart disk enclosure Being compared with traditional disk enclosures, the
smart disk enclosures are equipped with Arm chips
and DDR memories or other computing modules to
achieve powerful computing capabilities. With such
capabilities, the smart disk enclosures can help
controllers to share some computing loads,
accelerating data processing.
Share authentication During vStore configuration synchronization, the
share authentication information (including the share
information and domain controller configuration) is
synchronized to the secondary end.

T
Target The endpoint that receives a SCSI I/O command
sequence.
Target LUN The LUN on which target data resides.
Thin LUN A logic disk that can be accessed by hosts. It
dynamically allocates storage resources from the thin
pool according to the actual capacity requirements of
users.
Topology The logical layout of the components of a computer
system or network and their interconnections.
Topology deals with questions of what components
are directly connected to other components from the
standpoint of being able to communicate. It does not
deal with questions of physical location of
components or interconnecting cables. The
communication infrastructure that provides Fibre
Channel communication among a set of PN_Ports
(e.g., a Fabric, an Arbitrated Loop, or a combination
of the two).
Trim A method by which the host operating system may
inform a storage device of data blocks that are no
longer in use and can be reclaimed. Many storage
protocols support this functionality via various
names, e.g., ATA TRIM and SCSI UNMAP.

U
User interface The space where users interact with a machine.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 37

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

U-shaped bracket It is an optional structural part like letter "U". It is

located between the mounting ear of a chassis and
the mounting bar of a cabinet or bay and is used to
adjust the locations of the chassis and mounting bar
of the cabinet or bay.

W
Wear leveling A set of algorithms utilized by a flash controller to
distribute writes and erases across the cells in a flash
device. Cells in flash devices have a limited ability to
survive write cycles. The purpose of wear leveling is
to delay cell wear out and prolong the useful life of
the overall flash device.
Write amplification Increase in the number of write operations by the
device beyond the number of write operations
requested by hosts.
Write amplification The ratio of the number of write operations on the
factor device to the number of write operations requested
by the host.
Write back A caching technology in which the completion of a
write request is signaled as soon as the data is in the
cache. Actual writing to non-volatile media occurs at
a later time. Write back includes inherent risks: an
application will take action predicated on the write
completion signal, and a system failure before the
data is written to non-volatile media will cause
media contents to be inconsistent with that
subsequent action. For these reasons, sufficient write
back implementations include mechanisms to
preserve cache contents across system failures
(including power failures) and a flushed cache at
system restart time.
Write Once Read Many A type of storage, designed for fixed content, that
preserves what is written to it in an immutable
fashion. Optical disks are an example of WORM
storage.
Write through A caching technology in which the completion of a
write request is not signaled until data is safely
stored on non-volatile media. Write performance
equipped with the write through technology is
approximately that of a non-cached system. However,
if the written data is also held in a cache, subsequent
read performance may be dramatically improved.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 38

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File C Glossary

Z
Zone A collection of Fibre Channel N_Ports and/or
NL_Ports (i.e., device ports) that are permitted to
communicate with each other via the fabric. Any two
N_Ports and/or NL_Ports that are not members of at
least one common zone are not permitted to
communicate via the fabric. Zone membership may
be specified by: 1) port location on a switch, (i.e.,
Domain_ID and port number); or, 2) the device's
N_Port_Name; or, 3) the device's address identifier;
or, 4) the device's Node_Name. Well-known
addresses are implicitly included in every zone.

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 39

OceanStor Dorado
SmartDedupe and SmartCompression Feature Guide
for File D Acronyms and Abbreviations

D Acronyms and Abbreviations

C
CLI Command Line Interface
CPU Central Processing Unit

F
FC Fibre Channel

I
I/O Input / Output
IOPS Input/Output Operations Per Second

L
LUN Logical Unit Number

R
RAID Redundant Arrays of Independent Disks

T
TCO Total Cost of Ownership

V
VAAI vStorage APIs for Array Integration
VDI Virtual Desktop Infrastructure

Issue 07 (2023-07-15) Copyright © Huawei Technologies Co., Ltd. 40