Storage Migrator Unixadmin
Storage Migrator Unixadmin
March 2002
30-000704-011
Disclaimer
The information contained in this publication is subject to change without notice.
VERITAS Software Corporation makes no warranty of any kind with regard to this
manual, including, but not limited to, the implied warranties of merchantability and
fitness for a particular purpose. VERITAS Software Corporation shall not be liable for
errors contained herein or for incidental or consequential damages in connection with the
furnishing, performance, or use of this manual.
Copyright
Copyright © 1994-2002 VERITAS Software Corporation. All Rights Reserved. VERITAS,
VERITAS SOFTWARE, the VERITAS logo, Business Without Interruption, VERITAS The
Data Availability Company, VERITAS NetBackup, VERITAS NetBackup BusinesServer,
VERITAS Remote Storage for Microsoft Exchange, VERITAS Cluster Server, VERITAS
Storage Migrator, and VERITAS Storage Migrator Remote are trademarks or registered
trademarks of VERITAS Software Corporation in the U.S. and/or other countries. Other
product names mentioned herein may be trademarks or registered trademarks of their
respective companies.
VERITAS Software Corporation.
350 Ellis Street.
Mountain View, CA 94043
Phone 650.527.8000
Fax 650.527.8050
http://www.veritas.com
Contents
Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxi
Audience and Scope . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxi
Organization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxi
Related Documents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .xxii
Accessibility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .xxii
Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxiii
Type Style . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxiii
Notes and Cautions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxiii
Key Combinations and Pulldown Menus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxiv
Command Usage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxiv
Getting Help . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxiv
i
Copy Files to Secondary Storage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
Update the VSM Databases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
File Caching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
File Slices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Total File Caching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
Partial File Caching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
Directory-level Migration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
Tape and Optical Volume Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
Migration Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Migration Commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
The migbatch Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
The mignospace Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
The miglow Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
User Migration Commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
The migrate Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
The migpurge Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
Accelerated Disk Space Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
Constant Sweeps . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Multilevel Migration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
File Movement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Select Files to Move . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
File Handles, Storage Methods, and Work Lists . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Copy to Next Migration Level . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Update VSM Databases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Clean Up, FHDB and VOLDB Flags . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
File Export/Import . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
VSM System Files and Directories . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Managed File System Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Databases, Work Files, Logs, and Binaries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Files in dwpath . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Contents iii
Initial Configuration Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Storage Levels for Migrating Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
Method Name . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
Tape Methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
Optical Disk Methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
Disk Method . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
Remote FTP Method . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
NetBackup Method . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
Volume Set Availability (hint value) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
Volume Pool . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
Concurrent Stripes / Concurrent Recording . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
Choosing the Best Storage Method . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
Volume Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Storage Levels for Moving Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
General File System Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Slice Size . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Quota on Migration Stop Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Partial File Caching Trade-offs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Accelerated Disk Space Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
Criteria for Migrating Files (Water Marks) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
Desired Percentage Migrated . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
Desired Percentage Purged . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
Desired Percentage of Free Space . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
Criteria for Selecting Files to Migrate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
How VSM Selects Files to Migrate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
Procedure for Setting File Migration Criteria . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76
Criteria for Purging Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
Criteria for Moving Migrated Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81
Customizing Migration, Purging, and Moving Criteria . . . . . . . . . . . . . . . . . . . . . . . . . 84
Example Planning Procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84
Contents v
Chapter 4. Configuring VSM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103
Basic Configuration Wizard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103
Basic Configuration - Select File System Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
Basic Configuration - Enter Values Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
Basic Configuration - Select Method Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105
Basic Configuration - Properties Dialogs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106
Basic Configuration - Select Local Device Properties Dialog . . . . . . . . . . . . . . 107
Setting up VSM Volumes Using Media Manager . . . . . . . . . . . . . . . . . . . . . . . . 108
Basic Configuration - Select Remote Server Properties Dialog . . . . . . . . . . . . . 109
Basic Configuration - Select Alternate Disk Properties Dialog . . . . . . . . . . . . . 110
Basic Configuration - Select NetBackup Properties Dialog . . . . . . . . . . . . . . . . 111
Basic Configuration - Configuration Summary Dialog . . . . . . . . . . . . . . . . . . . . . . 112
Advanced Configuration Wizard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
Advanced Configuration - Select File System Dialog . . . . . . . . . . . . . . . . . . . . . . . 114
Advanced Configuration - Enter Values Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114
Advanced Configuration - Hierarchy Properties Dialog . . . . . . . . . . . . . . . . . . . . 116
Advanced Configuration - New Level Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116
Advanced Configuration - New Stripe Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117
Advanced Configuration - Stripe Properties Dialogs . . . . . . . . . . . . . . . . . . . . . . . 118
Stripe Properties Dialog for Tape and Optical Media . . . . . . . . . . . . . . . . . . . . 119
Stripe Properties Dialog for Alternate Disk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122
Stripe Properties Dialog for FTP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122
Stripe Properties for NetBackup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123
Advanced Configuration - Volume Registration Dialogs . . . . . . . . . . . . . . . . . . . . 124
Volume Properties Dialog for Tape and Optical Media . . . . . . . . . . . . . . . . . . 124
Volume Properties Dialog for Alternate Disk . . . . . . . . . . . . . . . . . . . . . . . . . . . 125
Volume Properties Dialog for FTP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 126
Volume Properties Dialog for NetBackup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127
Advanced Configuration - Alternate Level Dialogs . . . . . . . . . . . . . . . . . . . . . . . . 129
Advanced Configuration - File System Properties Dialog . . . . . . . . . . . . . . . . . . . 129
Contents vii
Manage Redo Log Files Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156
Reporting Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 158
Starting the Reporting Tool . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 158
Reporting Tool Main Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 158
Reporting Tool Pull-Down Menus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159
Setting Preferences . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160
Server Reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 161
Managed File System Reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 162
Response Reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163
Performance Reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 165
File Manipulation with the File Browser . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 167
File Browser Login . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 167
File Browser Main Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 167
File Browser Pull-down Menus and Tool Bar . . . . . . . . . . . . . . . . . . . . . . . . . . . 169
File Browser Left Pane . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169
File Browser Right Pane . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169
File Browser Bottom Pane and View Menu . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 170
File Browser Actions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171
Directory Groups Menu Selection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171
Migration... Menu Selection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 172
Scheduling Tool . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 173
Scheduling Tool Main Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 174
Component Configuration Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 175
Configuring Schedule Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 176
Restarting a Task within Its Time Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 177
Time Windows that Extend Past Midnight . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 178
Viewing a Schedule Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 178
File System Analyzer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 179
File System Analyzer Main Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 180
File System Analyzer Pull-down Menus and Tool Bar . . . . . . . . . . . . . . . . . . . . . . 181
Contents ix
Deleting Volumes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 214
Duplicating a Tape Volume from Migrated Files . . . . . . . . . . . . . . . . . . . . . . . . . . . 215
Managing Migration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 218
Controlling Global Migration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 218
General Rules for VSM Control Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 218
Syntax Rules for VSM Control Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 219
Control File Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 220
Scheduling Migrations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222
Invoking Migration Commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222
Migrating Files to Secondary Storage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222
Managing the Free Space Threshold . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 223
Making More Disk Space Available . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
Move Files between Migration Levels . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 226
Customize the VSM Policy and Method for Migrating Files . . . . . . . . . . . . . . 227
Reconfiguring Storage Methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 228
Performance Tuning with Tape Marks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 229
Performance Tuning with Constant Sweeps . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 230
Moving Migrated Files (Export and Import) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 230
Planning File Exports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 231
Planning File Imports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 232
Managing VSM Databases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 232
Databases on a VSM server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233
File Handle Database (FHDB) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233
File Name Database (FNDB) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 235
Volume Database (VOLDB) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 237
Work Lists (copydb files) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 240
Destination Volume Database (DVDB) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241
FHDB Lock File (FHDB.LK) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242
File Handle Sequence File (FHSEQF) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242
Volume Database Lock File (VOLDB.LK) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242
Contents xi
Releasing VSM Tape Requests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 260
Having No Volumes Available . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 260
Contents xiii
stopmigrd(1M) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 434
VSM(1M) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 435
Glossary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 465
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 477
xv
Threshold Example 3 (threshold=90, cut to threshold=45) . . . . . . . . . . . . . . . . . . . . . . . . . 80
Selection Criteria for Moving Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
Global Configuration Worksheet . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86
Managed File System Configuration Worksheet . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87
VSM-Java Main Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90
Login Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
Components of the VSM-Java Main Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92
Edit Menu When Server Is Selected . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92
Bottom Pane Display . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
Right Pane Displaying Activity Output . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
Toolbar when Server Is Highlighted and some File Systems not Configured . . . . . . . . . . 95
Toolbar when Hierarchy Is Highlighted . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
VSM-Java Menu Bar when Hierarchy Is Highlighted . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
Edit Menu Selections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
View Menu Selections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99
Select Filesystem Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
Basic Configuration Enter Values Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105
Select Storage Method Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106
Local Device Properties Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107
Remote Server Properties Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109
Alternate Disk Properties Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110
The NetBackup Properties Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111
Configuration Summary Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
Select Filesystem Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114
Advanced Configuration Enter Values Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115
Hierarchy Properties Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116
The New Level Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117
The New Stripe Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117
General Tab, Stripe Properties Dialog for Tape and Optical Disk . . . . . . . . . . . . . . . . . . . 119
Physical Tab, Stripe Properties Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120
xvii
Schedule Jobs Dialogs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 174
File System Analyzer Main Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 180
Number by access time Graph . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 183
Number by modification time Graph . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 183
Number by size Graph . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 184
Size by access time Graph . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 185
Size by modification time Graph . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 186
Size by size Graph . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 186
What If File System Analyzer Graph . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 187
Writing and Obsoleting Files on Media . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 206
Selecting a Full Volume to Consolidate with VSM-Java . . . . . . . . . . . . . . . . . . . . . . . . . . . 207
One-Step Consolidation Process . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 209
Two-Step Consolidation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 212
Selecting an Empty Volume to Recycle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 213
Selecting a Volume to Delete . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 215
Files Affected by Example Control Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 220
Premigrating Files with VSM-Java . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 223
Managing the Free Space Threshold with VSM-Java . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224
Purging Files with VSM-Java . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
Moving Migrated Files with VSM-Java . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 226
VSM Global Log File View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 245
Managed File System Log File View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 246
Searching in the Global Log File View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 247
Sample Hardware Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 449
Dependencies for Active-Active Configuration with FTP . . . . . . . . . . . . . . . . . . . . . . . . . 451
Dependencies for Active-Inactive Configuration with NetBackup . . . . . . . . . . . . . . . . . . 454
xix
xx VERITAS Storage Migrator System Administrator’s Guide for UNIX
Preface
This guide describes how to configure and manage VERITAS Storage Migrator (VSM)
release 4.5.
VSM runs on Solaris, HP-UX, and SGI IRIX. The VSM-Java interface runs on Solaris,
HP-UX, and Windows. For specific information about supported hardware and operating
systems for this software, see the VERITAS Storage Migrator Release Notes for UNIX.
Organization
Read the following chapters in numerical order unless advised to see a specific section:
◆ “About VSM” on page 1 is a general overview of VSM; it tells you what the product
does.
◆ “Planning VSM Configuration” on page 45 provides information about developing a
migration policy for your site.
◆ “VSM-Java Overview” on page 89 describes the basics of the VSM-Java interface.
◆ “Configuring VSM” on page 103 describes how to configure VSM using the VSM-Java
interface.
xxi
Related Documents
◆ “VSM-Java Tools” on page 151 describes the VSM-Java tools that help you maintain
VSM managed files systems.
◆ “Managing VSM” on page 189 describes how to maintain and complete daily
operations on VSM and file systems it manages.
◆ “Man Pages” on page 261 contains copies of all VSM man pages (command
reference).
◆ “Enterprise Agent for Storage Migrator” on page 441 describes how to configure VSM
in failover mode with the Enterprise Agent for Storage Migrator.
Related Documents
◆ The VERITAS Storage Migrator Release Notes for UNIX lists the supported platforms
and operating systems and describes new features and problems fixed in this release.
◆ The VERITAS Storage Migrator Installation Guide for UNIX describes how to install and
configure a test system.
◆ The NetBackup Release Notes provide important information about supported
platforms, operating systems, and peripheral storage equipment.
◆ The NetBackup DataCenter Installation Guide for UNIX describes how to install
NetBackup.
◆ The NetBackup Media Manager Device Configuration Guide for UNIX describes how to
configure storage devices controlled by Media Manager.
◆ The NetBackup DataCenter Media Manager System Administrator’s Guide for UNIX
describes Media Manager, its components, and how they are used to manage media
volumes, drives, and robots.
Accessibility
VSM contains features that make the user interface easier to use by people who are vision
impaired and by people who have limited dexterity. Accessibility features include the
following:
◆ Support for assistive technologies such as screen readers and voice input software
(Windows NT/2000 only)
◆ Support for keyboard (mouseless) navigation using accelerator keys and mnemonic
keys
More information on these features are included in the release notes.
Conventions
This section explains typographical and other conventions used in this guide.
Note In this publication, the term Media Manager refers to the media management
software that is part of NetBackup. The term volume refers to storage media such as
tape or optical disk.
Type Style
Typographic Conventions
Typeface Usage
Bold fixed width Input. For example, you might see, “Type cd to change directories.”
Fixed width Paths, commands, filenames, or output. For example, you might see,
“The default installation directory is /opt/VRTSxx.”
Italics Book titles, new terms, or used for emphasis. For example, you might
see, “Do not ignore cautions.”
Sans serif (italics) Placeholder text or variables. For example, you might see, “Replace
filename with the name of your file.”
Bold type (no italics) Graphical user interface (GUI) objects, such as fields or menu choices.
For example, you might see, “Enter your password in the Password
field.”
Caution This is a Caution. It is used to warn you about situations that can cause data
loss.
Preface xxiii
Getting Help
Command Usage
The following conventions are frequently used in the synopsis of command usage.
brackets [ ]
The enclosed command line component is optional.
Vertical bar or pipe (|)
Separates optional arguments from which the user can choose. For example, it is used
when a command has the following format:
command arg1|arg2
The user can use either the arg1 or arg2 variable.
Getting Help
◆ For updated information about this product, including system requirements,
supported platforms, supported peripherals, and a list of current patches available
from Technical Support, visit our web site:
http://support.veritas.com/
◆ VERITAS Customer Support can be reached through email, as follows:
[email protected]
Note Usually, the hsmname is the same as the file system mount point.
When a user accesses a migrated file, it is automatically retrieved from secondary storage
and cached in the online file system. Except for the delay to perform the retrieval, users
and programs are unaware that file migration and retrieval are taking place.
VSM is implemented using the standard Data Management Application Programming
Interface (DMAPI) and an inode-to-handle (IHAND) file.
VSM stores data on directly connected tape, optical disk, magnetic disk devices, or remote
volume servers. Media Manager provides the interface to tape and optical storage devices.
Support for large-capacity library devices with robotic access mechanisms eliminates the
need for operator action to either migrate or cache files. The net result is apparently
unlimited online storage that uses low-cost media.
VSM offers several storage methods (the method name is in parentheses):
◆ Disk file for premigration (dk)
◆ Alternate magnetic disk (ad)
◆ Tape (ct, dt, and mt)
◆ Optical disk as tape with random seek (op and ow)
1
◆ Remote migration using FTP (ft)
◆ Migration integrated with NetBackup (nb)
Caution The NetBackup (nb) method will not be supported in the next release of VSM.
Choosing this method will require conversion for the next release.
VSM shares secondary storage devices with NetBackup through the use of a common
Media Manager.
The VSM server performs the following tasks:
◆ Holds managed file systems
◆ Executes the server component of VSM
◆ If configured, communicates with a remote volume server using NFS (ad method) or
FTP (ft method). Remote volume servers hold remote volumes VSM uses.
The figure “Basic VSM Configuration” shows a managed file system residing on the
managed server. The VSM server migrates files to local optical and tape volumes using
op, ow, ct, dt, or mt migration methods. This managed server also migrates files to a
remote volume server using the ft, ad, or nb methods. (A second copy of VSM can be,
but is not required to be, running on the remote volume server.)
Remote
volume
server
Remote
volumes
(ft, ad,
and nb
methods)
Local optical
Managed (op and ow methods) volumes
file system
2. Premigrates the files by associating them with migration identifiers in its databases,
and placing them on a work list of files that can be migrated.
3. Copies the premigrated files to one or more secondary storage devices, which means
that files are actually migrated. The files remain available on disk. They are ready to be
purged and are referred to as purge candidates.
VSM deletes purge candidates when the managed file system uses disk space up to a
configured threshold. The file names and attributes of these migrated files remain in
users’ directories, and information about each migrated file (size, number of copies VSM
made, location, and type of media for each copy) resides in VSM databases on the server.
If users access migrated files, VSM makes them available by recalling, or caching, the data
back to disk. Often users have no idea the files reside somewhere other than local disk.
VSM can use an NFS-mounted file system as a secondary storage device. Although you
can NFS-mount a VSM partition, VSM cannot directly manage an NFS-mounted file
system. VSM can only manage file systems that are resident on the server on which VSM
is installed.
Caution Mount NFS file systems in a dedicated subdirectory of the root directory. You
cannot mount them in the root directory itself because VSM and other
applications perform stat() operations on entries in the root directory to
determine the path to the current working directory. The stat operation can
block on an NFS mount point in the root directory itself if the NFS server is
unreachable.
Administrative Controls
As an administrator, you configure and manage VSM operation. You choose the file
systems that VSM manages and tailor VSM to meet their migration requirements. For
example, it makes sense to migrate small and frequently accessed files to optical disk and
to migrate very large or infrequently accessed files to tape.
“Managing VSM” on page 189 describes management and operation in detail.
Areas that you can configure for each file system follow:
◆ Space thresholds at which VSM starts and stops migration.
◆ How VSM selects individual files to migrate and purge.
◆ Media on which VSM writes selected files, and how data is written on that media (for
example, block sizes). The choice of media also implies the device using the media.
◆ Number of copies made of each migrated file
◆ How much of a migrated file remains on disk after the file is purged (the file slice).
◆ Registration of volumes on which to store each copy of the files.
◆ Whether or not to use concurrent recording to speed up migrations when multiple
devices are available.
◆ Quota for the amount of space a user can restrict from migration.
◆ Number of migration levels to use.
After you have configured VSM, you can initiate and control file migrations using
VSM-Java, at the system prompt, and by using the Scheduling tool. You can also add
commands to startup scripts that will start and stop VSM. If you use such techniques,
VSM requires little or no action outside of exception conditions.
You can control data migration in various ways:
◆ Make space available before you have problems by selecting and copying files to
secondary storage, but also retaining the files on disk. If open file system space falls
below configured limits, VSM will purge some or all of them to make space available.
◆ Check open file system space and keep it within configured limits. If space is below
configured limits, VSM purges files it can or migrates and then purges additional files
until it provides enough space.
◆ Activate and deactivate managed file systems.
◆ List which files you always want to migrate in a global migrate file, and list which
files you never want to migrate in a global stop file.
◆ Enable constant sweeping of the managed file system to select migration candidates.
VSM also offers a comprehensive set of tools for managing the secondary media. These
management capabilities include the following:
◆ Registering media for use with VSM
◆ Consolidating volumes to recover obsolete space
◆ Listing database information about all VSM volumes
◆ Scanning volumes and displaying information about their contents
◆ Displaying the location of a migrated file
◆ Validating database consistency
◆ Restoring lost files
◆ Reconstructing lost VSM databases
User Controls
You can provide users some control over their file migrations and caches by allowing
them to do the following:
◆ Premigrate files if they own the files or directories
◆ Delete purge candidates if they own the files or directories
◆ Specify which files they want to prevent from automatic migration by listing them in
local stop files (.migstop)
◆ Specify which files they always want to migrate by listing them in local migrate files
(.migrate)
◆ Force files in a directory to be migrated and cached together
◆ Read migrated data without caching files
◆ Display file information about migrated files. If a file is migrated, the fls command
displays an m in the left column of the mode bit field and the machine ID and file
handle on the right, as in the following example output:
mrw---x--- 1 lm 6123456 Dec 10 06:13 fileA [002c70c0 00005b3d]
If the same file is purged, a t also appears in the mode bit field, as follows:
mrw---x--t 1 lm 6123456 Dec 10 06:13 fileA [002c70c0 00005b3d]
If the file is cached back to disk but not modified, VSM removes the m and the t from
the output. If the file is modified, it removes the m, t, machine ID, and file handle, as
follows:
-rw---x--- 1 lm 6123456 Dec 19 08:43 fileA
The migloc command is more explicit. It defines a file’s migration status using the
words Premigrated, Migrated, Purged, Cached, and Unmigrated.
To enable user permissions, you change file access permissions on command files, as
described in the VERITAS Storage Migrator Installation Guide for UNIX.
VSM Architecture
The main elements of VSM architecture are as follows:
◆ Migration daemon (migd)
◆ Reload processor (migin)
◆ Media Manager
◆ Administrative tools to control the migration and cache processes (for example,
migbatch and mignospace)
◆ Utilities for volume management (migvold) and database request (migrd)
management
The migration daemon (migd) uses the DMAPI interface to communicate with the
VERITAS VxFS file system on Solaris, the OnlineJFS file system on HP-UX, and the XFS
file system on IRIX.
The following figure illustrates how these elements interact.
Administrative Media
tools Manager
migd
migin
DMAPI
interface
The migration daemon (migd) runs in user space. It processes both object events and file
system events generated by the file system when a user references a migrated file.
Object events are as follows:
DM_EVENT_READ
DM_EVENT_WRITE
DM_EVENT_TRUNCATE
File system events are as follows:
DM_EVENT_NOSPACE
DM_EVENT_REMOVE
DM_EVENT_DESTROY (Solaris and HP-UX only)
DM_EVENT_UNMOUNT
The migd daemon registers to receive certain DMAPI events generated by the managed
file system. It then calls the appropriate processor, based on the original request. For
instance, on read and write requests, migd calls the reload processor (migin) to cache
(recall) the requested file to disk. After migin finishes, migd sends a completion message
to the kernel. The completion message causes the kernel to pass the original read or
write request to the underlying UNIX file system for further processing.
The migd daemon checks the open disk space on the managed file system at set intervals
that you can specify when you start the daemon. The default is 60 seconds.
The miglow or migbatch and mignospace commands manage open file system space
by controlling migration and purging of files. During the migration process, migcopy
copies files from the managed file system to secondary storage.
VSM records its activities in log files. The migd daemon records its activities in a VSM
global log file. Other VSM processes use individual log files for managed file systems.
The migvold volume daemon unmounts Media Manager volumes mounted in read
mode. VSM uses Media Manager to access tape or optical disk.
The migrd request daemon handles communication for VSM-Java and commands.
To change states, you can select Actions > File System > Set State and select a state or run
the migVSMstate -s state hsmname. If you change the state to Idle, VSM first changes
the state to Idling while operations complete and changes the state to Idle when
operations are complete.
Use the VSM-Java Actions > File System > Kill HSM Processes for Filesystem selection
or the migVSMshutdown command to stop VSM activities. You will need to stop all VSM
activity if you make changes to the file system itself. For example, unmounting a managed
file system requires that VSM activities stop.
Shutting down VSM through VSM-Java or migVSMshutdown will leave an Active file
system in Idle state for reboot. These actions also shut down the VSM daemons.
All managed file systems should be in Idle state when the VSM server boots. The
migVSMstartup command changes a managed file system in Idle state to Active or
Inactive state, and it moves a file system in a state other than Idle to the Maintenance state.
As VSM comes up, some recovery operations take place (as described in the
migVSMstartup man page). After migVSMstartup completes its processing, a file
system will be in Active state or Inactive state if its space thresholds are within the
configured limits and no problems were encountered during recovery. Otherwise, the
managed file system state will be changed to Maintenance. Further recovery on a file
system in Maintenance state must be carried out manually. After recovery is complete,
manually change the state of the managed file system to Active using VSM-Java or
migVSMstate. In VSM-Java, select Actions > File System > Set State > Active.
Both the migVSMstartup and migVSMshutdown commands use the migVSMstate
command to change file system states. The standard VSM startup and shutdown scripts
use migVSMstartup and migVSMshutdown to cleanly start and stop VSM operations.
See the table “Startup/Shutdown Scripts” on page 192 for scripts appropriate for your
platform.
File Migration
During migration, VSM selects files, associates them with a file handle, adds them to a
work list of files to copy, and then copies them to secondary storage.
The following figure shows the main steps in the migration process.
◆ Appends one entry to the file name database (FNDB) for the file.
◆ Appends entries to the FHDB for the file. One entry represents the copy on disk.
Other entries (one or more) are “placeholders” that will later hold information about
the copies VSM makes.
◆ Sets DMAPI managed regions on the file so that any attempt to write or truncate the
file will be reported to the migd daemon.
◆ Sets DMAPI “attributes” on files. These attributes contain the file handle and machine
ID as well as other information DMAPI requires about the file.
VSM holds a copy of migrated data on disk until space is needed in the managed file
system, at which time the migrated file is purged or truncated.
Assigning file handles and creating database entries are quick operations that neither
move nor copy data from one place to another. All data remains in the same file system
and takes up no additional space.
If a user executes the VSM fls -l command on a migrated file, the resulting output
shows the migrated flag, the file handle, the original file size and dates. If the file has been
purged, the t flag is also shown in the output, as in the following example:
mrw---x--t 1 ljgm 20000 Dec 17 19:42 filec [002c70c0 00005bc9]
The t flag indicates that the file has been purged. The t flag can be seen with the standard
UNIX ls command on an NFS client, which is useful whan an NFS server exports VSM
managed file systems. The t flag tells a user on the client that there will be a delay when
the file is accessed.
The migloc command for the same file provides more detailed information:
Status: Purged nutmeg ljgm filec
Handle: 2C70C0M5BC9 20000 1/1 Mon Dec 17 19:48:23 2001
Medium: 2N512A op.1 1 1 765 1331737600
If a purge candidate is written to, truncated, or removed, a DMAPI event will be
generated that will cause VSM to make the file unmigrated.
The volume set availability provides an indication of how long it takes to access the
volume. For example, library indicates that the volume is in an online library and VSM
has immediate access.
The volume pool specifies if the volume set is part of a group (pool) of volumes.
File Caching
Caching is the process of copying migrated files back to the managed file system for access.
Caching fits into the entire migration process as follows:
1. After copies have been made, a file’s data blocks are still on the local disk. At this
point, VSM (or the file owner) may purge the file’s data blocks (which is why it is
called a purge candidate).
2. Users can access purge candidates without intervention from VSM. The name of the
file remains in its original directory and stays visible to the user. Users can determine
the status of a purge candidate by using the fls(1) or migloc(1) command.
4. If the user or an application tries to read a purged file, VSM must cache the data back
to the original file system in one of two ways:
- Total file caching (described in detail on page 16)
- Partial file caching (described in detail on page 17)
The following figure illustrates how VSM does file caching:
File Caches
No
File is not cached. When it cannot cache a file, VSM
Is migd active?
returns errno EPFNOSUPPORT to the
user system call, which the user will
know only if the application reports
the errno. In some cases, the
Yes process will fail silently.
Is VSM No
state Active? File is not cached.
(see page 8)
Yes
No
Is partial
Entire
caching
file is cached
enabled?
Yes
Cache part
of file
When a user accesses a purged file, VSM copies data from secondary storage and makes it
available to the user. VSM updates the IHAND file to mark the file as cached (or partially
cached).
After VSM caches a migrated file, the file is again eligible for purging. If the file is
modified, VSM will change it from a migrated file to an unmigrated file, and it can again
become a migration candidate. When a migrated file is written, truncated, or removed,
VSM sets the obsolete flag in each FHDB entry for the file. You can use either the fls(1) or
migloc(1) command to see if a file is migrated or purged.
If more than one copy of a migrated file is available, VSM attempts to cache the copy from
the volume it can access in the shortest time, regardless of whether it is on remote or local
media.
Caching occurs automatically. Because the application accessing the data is blocked
during the cache operation, a noticeable delay can occur. Partial file caching can reduce or
control this delay for large files; however, it is a slower process when the whole file must
be cached.
The following factors affect the length of the caching delay:
◆ Availability of drives
◆ Availability of volumes
◆ Transfer rates and access times from secondary storage to local disk
◆ Size of files
◆ Level of activity on the system
You can minimize caching delays in several ways:
◆ Configure enough tape or optical devices to handle the peak demand
◆ Match device characteristics to the size and access frequency for migrated files
◆ Configure the NetBackup unmount delay parameter to enable successive read
requests from the same volume to proceed without unmounting and remounting that
volume
◆ Configure the NetBackup demand delay parameter to unmount an unused volume of
the same density immediately, and mount the volume containing the file to be cached
◆ Use partial file caching (described in “Partial File Caching” on page 17)
For example, making more than one device available to VSM can help minimize caching
delays. If only one device is available, only one cache or migration request can be
processed at a time. However, if four devices are available, assuming no migrations are
active, four simultaneous caches are possible.
File Slices
It is useful to understand how VSM uses the concept of file slices before discussing how
partial or total caching works.
Having part of a purged file immediately available to a user or application can be a very
efficient method of managing data migration. The user or application does not need to
wait for any VSM processing to occur before accessing the beginning of a file. If the entire
file will need to be cached, however, partial file caching is slower than total file caching.
During configuration, you can set the size of that portion of a file you want VSM to retain
on disk even after the file is purged. You can set this configured slice to a different value for
each managed file system.
Partial file caching creates an effective slice that adds file data to the configured slice when a
purged file is accessed.
Any write request or any memory-mapped I/O request to a purged file will cache the
entire file, no matter how big its slice is. Depending upon the size of the configured slice,
you can use the following methods to prevent some standard utilities like file and head
from accidentally caching a large number of migrated files:
◆ The head utility reads the first 32768 bytes of a file by default. To prevent head from
caching an entire file, set the slice value to at least 32768 bytes.
◆ The file utility normally reads fewer than 8192 bytes to determine the type of a file
(such as whether it is executable). Therefore, setting the slice value to 8192 bytes
usually prevents the file utility from caching an entire migrated file. However, file
does apply its own built-in rules to determine a file’s type. If it fails to determine the
file type by using its rules, it reads more of the file. If any of the data file tries to read
is beyond the slice, VSM caches the entire file.
Restoring a migrated file with NetBackup sets its slice value to 0. This can cause
performance delays when the files are used by file or head commands. If restored files
with a slice value of 0 are modified and then re-migrated, VSM re-establishes the
configured slice value.
Configured slice
Neither read request
data accessed by lies entirely within the
read requests configured slice that
resides on disk.
The file is cached in its
entirety.
Cached data
Migrated File
If more than one copy of a file is available, VSM attempts to cache the copy it can access
first. If everything else is equal, the copy is cached from the volume with the lowest
migration level number (that is, the Primary copy is cached before the Alternate copy, a
copy from migration level 3 before one from level 4, and so on). If the first accessed copy is
damaged, VSM automatically switches to another copy and caches it completely,
regardless of whether it is on remote or local media.
During configuration, VSM-Java sets the highest volume set availability (library) to the
Primary copy of the file, and the lower volume set availability to the Alternate copy.
If a read request either exceeds or is completely beyond the configured slice, the file is
partially cached to satisfy the read request. If a read request plus a configurable
read-ahead value either exceeds or is completely beyond the partially cached data on disk,
additional data is cached to satisfy the read request.
The configurable read-ahead determines the minimum amount of data VSM caches to
disk beyond what is needed to satisfy the read request. For more information on
configuring read-ahead values, see “File System Properties - General Tab” on page 129.
A write request always caches an entire file. If a read cache is in progress or a file is
partially cached when a read request comes in, caching continues until the file is totally
cached.
The following figure illustrates how VSM makes determinations during the first phase of
partial file caching.
resides on disk
The following figure illustrates how VSM makes determinations during the second phase
of partial file caching:
Effective slice
You can disable partial file caching by configuring the read-ahead to be -1, in which case
any read request that does not lie entirely within the configured slice caches the entire
file.
If a file is partially cached, VSM allows read access to cached data as soon as the granules
containing the requested data are cached to disk.
VSM continues with the partial caching operation for a configurable read-ahead amount.
All data previously on disk, plus the data required for the read, plus the read-ahead, is
rounded up to the next whole granule. This cached portion of the migrated file now
becomes the effective slice for the file, which supersedes the configured slice when
processing subsequent read requests.
The initial partial caching request reads from the beginning of the file, including the
configured slice. Subsequent partial caches of the same file do not reread data already
cached, but resume caching at the end of the effective slice (the data on disk).
VSM stores information on effective slices and other information pertaining to partial file
caching in the IHAND entry for the file.
Partially cached files remain marked as migrated unless the effective slice is the entire file,
in which case VSM restores the configured slice value and marks the file as totally cached.
If more than one copy of a file is available, VSM attempts to cache the copy it can access
first. If everything else is equal, the copy is cached from the volume with the lowest
migration level number (that is, the Primary copy is cached before the Alternate copy, a
copy from migration level 3 before one from level 4, and so on). If the first accessed copy is
damaged, VSM automatically switches to another copy and caches it completely,
regardless of whether it is on remote or local media.
Partial file caching applies only to the first copy VSM attempts to cache from local media.
Partially cached files remain on disk until selected for purging. Selection criteria are the
same as those for any unmigrated file. VSM updates the IHAND entry when a partially
cached file is purged.
For information on configuring file caching, see “Partial File Caching Trade-offs” on
page 68.
Directory-level Migration
While migration customarily occurs at the file level, it is also possible to perform
migration and caching at the directory level.
With directory-level migration, users can group files they own in a directory (and its
subdirectories), and migrate those files as a group. Users with root privilege can group
directories owned by any user. If any file in the group is cached, all of the files in the group
are cached.
Note Use directory-level migration only where applicable. It will increase migration and
caching activity unnecessarily if it is used when file-level migration would suffice.
In directory-level migration, grouped files are premigrated together and placed in a work
list as a group. When VSM copies the group to secondary storage, the files are located in
close proximity to one another on sequential media. This minimizes the time needed to
cache the grouped files (see “Work Lists (copydb files)” on page 240 for a more detailed
description).
Normal file selection criteria, as described in “Select Files to Migrate” on page 10, are not
applicable in directory-level migration. However, normal VSM rules apply to any
ungrouped files added to grouped directories after the directories were grouped, and
these files are selected, migrated, and cached individually.
Users can group files in directories selecting Actions > Directory Groups > Group in the
File Browser or by using the miggroup(1) command.
Media Management
VSM
Operator
Manual storage
device
When transferring data to or from a storage device, VSM queries the volume database
(VOLDB) and identifies the volume on which to read or write the migrated data. It then
includes the volume information in a tape request to the Media Manager device daemon,
which allocates or deallocates drives based on availability.
You place volumes for VSM in pools from which it selects the volumes to use. After VSM
selects a volume, that volume is assigned to it and registered in the VOLDB.
Media Manager tracks the location of both online and offline volumes and keeps this
information in its own volume database. If a request from VSM involves a robotic device,
the Media Manager device daemon queries the Media Manager volume daemon to
determine which robotic device has the volume. The device daemon then issues a mount
command to the robotic daemon controlling that device, which automatically mounts the
specified volume and returns control to the application or user. No operator intervention
is required, provided the required volume is physically in the robotic device.
With a manually operated device, the device daemon issues a mount request to the
operator. To satisfy the request, the operator must find the volume, mount it manually,
and assign it.
Media Manager is managed separately from VSM and can be used by other applications.
See “Setting up VSM Volumes Using Media Manager” on page 108 for configuration
specifics, and the Media Manager System Administrator’s Guide for more information.
Migration Parameters
The following configuration parameters control space limits on a managed file system:
◆ Free space value (also referred to as the high water mark). You can use the Scheduling
tool to configure automatic removal of premigrated files or to configure automatic
migration of files when open file system space is less than the free space value. If you
prefer you can use VSM-Java or the command line to execute commands that start this
process.
◆ Low-water mark. You can configure VSM to stop selecting files for migration when
open file system space reaches this percentage.
◆ Purge mark. Purge candidates are files left on disk, even though they are also copied to
secondary storage. VSM can remove purge candidates immediately and quickly
provide open space on the managed file system, if necessary.
The following figure illustrates how these migration parameters work in VSM.
Migration Parameters
Open space
VSM migd daemon detects that the
percentage of file system space open for
Free space use in the managed file system is below the
value free space value.
Open file
system space If purge candidates exist, VSM removes them
Free space to the purge mark percentage and stops.
value
If no purge candidates exist, VSM sweeps the
Purge mark
file system, selects enough files to increase
open file system space to the low-water mark
Low-water
percentage, migrates the files, and finally
mark
purges files to the purge mark percentage.
The following configuration parameters control the files that VSM selects for migration.
◆ VSM cannot migrate files that have been accessed or modified within a minimum age
time period. For example, if the minimum age parameter is set at 2 days, VSM selects
only files that were accessed or modified more than 48 hours ago.
◆ The minimum size specifies the minimum size of files that VSM can migrate. For
example, if minimum size is 100 KB, VSM selects only files 100 KB or larger.
◆ After ruling out migration of files that are less than the minimum age and size, VSM
calculates a value for each remaining file, referred to as its threshold. The file’s
threshold determines whether or not it is selected to be migrated. After it calculates
the threshold, VSM selects files only if their threshold exceeds the configured value.
VSM provides a threshold formula that is based on file size and age (time since last
access or modification). You can also define a site-selected threshold formula in lieu of
the VSM formula.
Note You also set size, age, and threshold parameters for purging files.
Migration Commands
VSM provides the following commands for automatic disk space management:
◆ migbatch
◆ mignospace
◆ miglow
2. Marks the files with a migrated flag and associates a file handle with them. This
process continues until one of the following is true:
- All files meeting the file-selection criteria are ready to copy to secondary storage
- The space that VSM can potentially free by purging premigrated files is enough to
increase the percentage of open file system space to the low-water mark
4. Copies files to secondary storage. Purge candidates also remain on the local disk until
the migd daemon determines that the managed file system needs more space. When
more space is needed, the purge candidates are deleted using mignospace.
You can invoke migbatch from the VSM-Java interface, from the command line, or from
a scheduled task you have defined using the Scheduling tool. You can also invoke it by
running the miglow command, which invokes migbatch and then invokes
mignospace.
When selecting files for migration, VSM performs “round-robin” sweeps, as follows:
1. Initially starts at the root of the managed file system or directory and traverses the
entire directory tree.
2. Stops sweeping when enough files have been selected to satisfy the low-water mark.
3. Saves the path of the last selected file in the file managed file system’s
dwpath/workdir/hsmname.sweep.restart. The dwpath is the pathname of the
managed file system directory containing the database and workdir directories.
4. Starts the next sweep from the last component of the saved path that still exists in the
managed file system.
5. Removes the sweep.restart file after it determines the starting point for the sweep.
6. If the sweep.restart file does not exist, starts sweeping from the root of the tree.
Round-robin sweeping eventually scans all of the files in the managed file system or
directory.
Note Files listed in local and global migrate control files are not selected during normal
sweeps of the managed file system. Eventually, however, these files may become
migration candidates if VSM cannot migrate enough files to create adequate open
space. For more information on these files, see “Control Files” on page 201.
Because the migration process can take a long time, run migbatch during off-peak times,
thus creating purge candidates without interfering with user processes. VSM can then
quickly provide space during normal working hours by purging the purge candidates.
The following figure illustrates what occurs when you run migbatch; it also indicates the
other programs that migbatch calls to perform each task.
migarch.sh
migworker
Update databases to show location
of file data migmerge.sh
Is VSM state
No Active or
Exit Maintenance?
Yes
Do purge
Yes
candidates
exist?
No
Cut threshold in
half, then exit
VSM can also accelerates disk space availability by selecting, migrating, and purging files
incrementally, if you have configured this feature. If so, when migd detects that file
system space open for use is less than the free space value, it calls mignospace with the
-N option. If no purge candidates exist, mignospace -N will work incrementally so that
users have freer access to the file system.
miglow executes
Is
free space
less than its Exit. Enough
configured space is available
No
value?
Yes
Run migbatch to select and migrate enough files to allow mignospace to bring open file
system space to purge mark
Run mignospace to remove purge candidates, increasing open space to the purge mark
Note VSM may run mignospace more than once to reach the free space value. However,
running mignospace -N triggers accelerated disk space availability during a
single migsweep process. The next time migsweep runs, it will not invoke
accelerated disk space availability.
Constant Sweeps
You can tune VSM to perform constant sweeping of the managed file system. To enable
constant sweeping, execute the following shell script:
/usr/openv/hsm/bin/migconsweep [-s sleep_time] hsmname &
The -s sleep_time option specifies the time (in seconds) that the process sleeps before
resuming a sweep of the managed file system. The default is 60.
Constant sweeping prevents the work list of premigrated files from becoming empty,
because VSM periodically checks the list and resumes sweeping if necessary.
If mignospace is running when VSM sweeps the managed file system, the accelerated
disk space availability feature of mignospace is used.
Constant sweeping does use system resources, and it can adversely affect overall system
performance, particularly during periods of heavy system usage. Once initiated, constant
sweeping continues to run until you terminate the process by using the kill command.
Multilevel Migration
Multilevel migration lets you configure and manage cost-effective storage hierarchies that
make the best use of your storage equipment investment. VSM features offer options for
how many copies of a file you want made. Primary copy only means that VSM makes one
copy of a file. Dual copies means that VSM will make two or more. Multilevel migration is
compatible with both of these methods. VSM adds optional migration levels up to a
maximum of eight: four associated with the Primary copy and four associated with the
Alternate copy.
After you configure multilevel migration, operations occur automatically on a schedule
that moves files from one migration level to the next based on your site-defined criteria.
These operations remain invisible to users but can reduce operating costs by retaining
frequently used data on more easily accessed media and moving less frequently accessed
data to lower-cost storage media at other levels. For example, frequently used files can be
kept on optical disk while “older” files are on tape.
You can configure different multilevel-migration criteria for each managed file system.
Typically, the secondary storage devices at higher levels have progressively larger
capacities, longer access times, and lower unit storage costs. However, you are free to
configure the storage methods at each level without such arbitrary restrictions.
VSM caches migrated data back to the server directly, without going through intervening
migration levels or media. By tracking multiple copies of migrated files, VSM caches data
from the volume with the highest volume set availability (library), regardless of other
criteria. If that volume is not available, VSM requests another volume. The Primary copy
of a file defaults to the volume set availability library, and the Alternate copy defaults
to vault.
Note If you use the ft or nb storage method, files are not eligible to be moved to a
different migration level. They can only reside at Primary Level 1 and Alternate
Level 2.
Level Level
7 8 Tier 4
Level 7 Level 8
Level 5 Level 6
File
System Migrate Primary Primary Alternate
copy copy copy
Migrate Alternate
copy
Initial file migration sends files to Primary Level 1 and Alternate Level 2. Thereafter, as
data access becomes less urgent, VSM automatically selects files and moves them to
higher levels whenever the migmove command is executed. You can execute migmove
from VSM-Java, from the command line, or automatically by using the Scheduling tool.
By default, VSM marks files at the source level as dead after the files are moved to the
destination level. You have the option to mark the Primary copy VSM made (also referred
to as the source-level file) obsolete or have it remain active. At some later time, you can
reclaim wasted disk space in source-level volumes by consolidating active files to other
volumes and removing all remaining obsolete or dead files. For more information on
these dead and obsolete database entries, see “Criteria for Moving Migrated Files” on
page 81.
File Movement
The migmove command controls file movement in multilevel migration. VSM selects files
and then copies them to the next migration level. The following figure shows the main
steps in this process:
Like the migbatch and mignospace commands, migmove creates a work list for each
configured storage method and volume set. It also assigns files to storage methods and
writes file entries in the proper work list. The work lists provide input for the copy
processors that move files to the next migration level.
File Export/Import
The export/import feature of VSM makes it possible to transfer migrated files from one
managed file system to another managed file system that uses the same storage methods.
To use this feature with optical volumes, the file systems must have the same platform
and operating system. NetBackup and Media Manager are required for file
export/import. VSM only exports tape and optical volumes managed by Media Manager.
The export/import operation does not require file caching and can process files of any
size.
For example, if your organization begins working on a project at Site 1, but later transfers
that project to Site 2 in another city, the administrator at Site 1 can export to tape all the
migrated files for that project. The administrator at Site 2 can import these same files,
adding them to a similarly configured managed file system that is already running.
Note The mignbexport command does not supported embedded special characters in
file names, such as asterisk, backslash, newline, parenthesis, question mark, right
curly brace, square bracket, tab, or vertical bar (pipe).
3. Backs up data from the file handle database (FHDB), file name database (FNDB), and
volume database (VOLDB) for all files being exported.
4. Deletes these FHDB, FNDB, and VOLDB entries from the exporting managed file
system.
After the mignbexport command completes processing, the exporting administrator (at
Site 1) can remove the VSM volumes containing the migrated files and the NetBackup
volumes containing the unmigrated files and database entries from their storage devices
and sends them to the new location.
The import process is the reverse of export. The importing administrator (at Site 2) places
in the appropriate storage devices the VSM volumes containing file data to be imported
and the NetBackup volumes used in the mignbexport operation and then registers them
with Media Manager for the importing managed file system. The Site 2 administrator uses
the NetBackup import feature to make NetBackup at the Site 2 aware of the new data.
2. Updates the FNDB, FHDB, and VOLDB for the importing managed file system to
include this information about all files being imported.
3. Uses the NetBackup restore command to restore the imported files into the
managed file system at the new location.
For more information on how to plan export/import operations, read “Moving Migrated
Files (Export and Import)” on page 230 and the mignbexport(1M) and
mignbimport(1M) man pages.
Note The NetBackup (nb) method will not be supported in the next VSM release.
data
/usr
/openv /var
Files in dwpath
The databases and work files associated with a managed file system reside in a pathname
referred to as the dwpath. If VSM manages more than one file system, you specify each
dwpath during global configuration. The default is
/usr/openv/hsm/database/hsmname.
The dwpath/workdir directory contains the work lists (copydb files) that VSM uses to
copy premigrated files to secondary storage and to move migrated files from source to
destination migration levels. These files have names of the following form:
hsmname.copydb.method_name.volume_set_number.volume_set_availability
The worklist directory also contains destination-volume database (DVDB) files. VSM
creates these files to store temporary FHDB entries that it creates during copy operations.
After merging the temporary entries into the FHDB, VSM deletes the DVDB file. To create
a DVDB file, VSM uses a temporary destination-volume database (TVDB) file that it
removes when it is no longer needed.
See “Databases on a VSM server” on page 233 for a more detailed description of work lists
and the DVDB.
If the following files exist in the work directory (dwpath/workdir), they contain the
process ID (pid) of the commands in the file name:
hsmname.migbatch.running: migbatch pid
hsmname.migcons.running: migcons pid
hsmname.migconsweep.running: migconsweep pid
hsmname.migdbcheck.running: migdbcheck pid
hsmname.miglow.running: miglow pid
hsmname.migmdclean.running: migmdclean pid
hsmname.migmove.running: migmove pid
hsmname.mignbexport.running: mignbexport pid
hsmname.mignbimport.running: mignbimport pid
hsmname.mignospace.running: mignospace pid
hsmname.migrc.running: migrc pid
hsmname.migreconstruct.running: migreconstruct pid
hsmname.migrecycle.running: migrecycle pid
hsmname.migsetdb.running: migsetdb pid
The workdir directory can also contain the following files, depending on what processes
are running:
mig.lck: Used by migbatch and mignospace to lock the managed file system
hsmname.idling: Exists if hsmname is idling down
hsmname.last_merge: If present, its mtime (the time when it was last modified)
is the time when the last FHDB merge operation completed.
hsmname.migsweep: List of files selected to be migrated
hsmname.nospace: Exists when mignospace is running with the -N option.
hsmname.p_badness: Current purge threshold value
hsmname.s_badness: Current threshold value.
hsmname.state: Current VSM state if the state is Idle, Iding, or Maintenance
hsmname.sweep.restart: Path of the last file selected by migsweep before
reaching the low-water mark.
hsmname.VxFS_34_vsmstate: If non-zero in size, VSM detected VxFS version
3.4. The contents of the file (ASCII 0 or 1) indicate the value VSM assumes for the
VxFS tunable hsm_write_proalloc.
The dwpath/database directory contains the following files that hold database
information:
FHDB: Contains at least one entry for each copy of a migrated file. When VSM must
split storage of a file over more than one volume, it creates an FHDB entry for each
volume on which the file is stored.
FHSEQF: Contains the eight-digit hexadecimal value that VSM assigns to the next
file handle.
FHDB.LK: Provides a master lock on the FHDB for the database merge process.
FNDB: Contains one entry for each migrated file.
VOLDB: Contains an entry for each volume registered with VSM.
VOLSEQF: Contains the eight-digit hexadecimal value that VSM assigns to the next
volume ID (handle).
VOLDB.LK: Provides a master lock on the VOLDB for the database merge process .
NEXTVOL1: Next volume VSM will use for the Primary copy of a migrated file.
NEXTVOL2: Next volume VSM will use for the Alternate copy of a migrated file (if
applicable).
NEXTVOL3 ... NEXTVOL8: Next volume VSM will use for moving a migrated file
to migration level 3-8 (if applicable).
Log files
Managed file system log files reside in the lgpath pathname. If VSM manages more than
one file system, you specify each lgpath during global configuration. The lgpath default
path is /usr/openv/hsm/logs/hsmname.log.
The global log file is not in lgpath, but in /tmp/hsm.log; its path is not configurable.
Binaries
The /usr/openv/hsm/bin directory contains the binaries and commands that you
execute from the command line.
The /usr/openv/hsm/bin/admincmd directory contains the executables for some of
the administrative commands, scripts, and tools found in /usr/openv/hsm/bin. It also
includes the VSM daemon (migd), the volume daemon (migvold), and the VSM-Java
request daemon (migrd).
/usr/var/openv/hsm
workdir
database example
Template files:
migd.pid database
VSM files: migvold.pid
migconfg MOTAB Template files:
Template files: volume mount points FHDB
migconfg_example migd.sid FNDB
HsmLogLevel FHSEQF
migrd.pid VOLDB
VOLSEQF
migsweep.site
migsweepm.site
sample.migpolicy.script
migconf
Significant directories in this tree are as follows:
◆ The /usr/var/openv/hsm/database directory contains the following files:
migconfg: VSM global configuration file created during configuration.
migconfg_example: A template VSM global configuration file.
migrate: Optional global migrate file, containing a list of the files (and possibly
directories) of files that VSM will migrate during automatic migration.
migstop: Optional global stop file that contains a list of the files that VSM will
not migrate.
schedules: Global schedule file created with the Scheduling tool.
◆ The /usr/var/openv/hsm/workdir directory contains the following files:
HsmLogLevel: Level of logged VSM messages.
MOTAB: Global VSM mount table.
migd.pid: Contains the migd daemon process ID (pid), if migd is running
migd.sid: Contains the migd daemon session ID (sid), if migd is running
ftvpath
ID_LABEL
1LXXX
CMIG.pid
2LYYY MIG.pid
data_file
data_file.GLABEL
The ftvpath directory is the path to the file system containing the ft volume. This file
system contains the following types of files:
ID_LABEL: Each remote file system containing an ft volume has an ID_LABEL file.
This file contains a single line of text that identifies the label and the client name for
the managed server using the volume.
1LXXX is the first level directory.
2LXXX is the second level directory within which data_file and data_file.GLABEL files
reside.
data_file: Each migrated file has a unique ID.
data_file.GLABEL: There is a GLABEL file for each migrated file. The GLABEL files
contain information pertaining to the migrated file.
Note If VSM is running on a remote volume server, use the global stop file to prevent the
migration of any data_file.GLABEL files from that remote server. See “Controlling
Global Migration” on page 218 for details.
Note Usually, the hsmname is the same as the file system mount point.
45
VSM Global Configuration
Note Never migrate the executables for VSM, NetBackup, Media Manager or Volume
Manager that reside in /usr/openv/.
Avoid migrating files that are critical to system operation or those in file systems that do
not grow quickly enough to benefit from VSM management. For example, the /usr file
system can contain information essential to system startup and operation, and you must
plan carefully if you need to manage it.
All your managed file systems will contain some files that you do not want to migrate.
Some specific types of files follow:
◆ Temporary files
◆ Core files
◆ History files
◆ Files labeled junk or testing
◆ .login, .cshrc, and other . (dot) files
Administrators and users can list files VSM will always migrate or those VSM should not
migrate in special VSM control files. See “Controlling Global Migration” on page 218 for
more information on how to create and use these VSM control files.
◆ If the UNIX system has migrated data to tape, caching it could cause a network
timeout. You can alleviate this problem by changing the following registry entries to
lengthen the timeout value:
- On Windows NT 4.0
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\
LanmanWorkstation\Parameters\sesstimeout(DWORD set in
seconds)
- On Windows 95 and 98
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\VxD\
VNETSUP\sesstimeout (DWORD set in seconds)
- On Windows 2000
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\
LanmanWorkstationParameters\sesstimeout (DWORD set in
seconds)
◆ Microsoft Word sets file access time to the future, which means that the data may not
migrate for an hour after it has been written.
◆ Microsoft Explorer requires that a file be cached in order to change its attributes. This
means that changing access control lists (ACLs) when using SLFS with Microsoft
Explorer will cause the file to be cached.
Caution Always specify the pathname for a database directory in a local file system that
VSM does not manage. This eliminates the possibility of migrating files from the
database or workdir directories that VSM needs for operation.
VSM-Java ensures that database directories are unique for each managed file system.
In the following example, there are 20,000 migrated files, 5% of which span two volumes.
VSM makes two copies of each file. You can anticipate an FHDB of 62,000 entries:
(20,000 files x 2 copies/file x 1.05 spanned vol.) + 20,000 dk entries = 62,000 entries
VSM also creates one FNDB entry for each migrated file.
Note The FHDB has decreased in size since the VSM 3.4.1 release.
Multiplying the number of file entries by 160 provides the total bytes you must reserve for
the database.
If there are 20,000 migrated files, 5% of which span two volumes, and VSM makes 2 copies
of each file, the FHDB space requirements can be calculated as follows:
(20,000 files x 2 copies x 1.05 spanned vol.) + (20,000 dk entries x 160 bytes/entry) = 9.92 MB
Each FNDB entry is about 80 bytes long, plus the length of the file’s full pathname. If the
average full pathname is 40 bytes long, the FNDB space requirements for 20,000 files can
be calculated as follows:
20,000 entries x 120 bytes/entry = 2.4 MB
The combined FNDB and FHDB space requirements in this example are about 12.32 MB.
2. The mignospace command causes VSM to remove files that have been copied to
secondary storage and to increase free space to the configured percentage. If there are
no files ready to remove (purge), mignospace copies files to secondary storage and
purges the local disk copies.
VSM continues to copy and purge files until the percentage of free space on the file
system increases to the configured percentage. By default, files are selected for
migration according to their size and how much time has elapsed since they were last
accessed.
3. If a user accesses a migrated file, VSM caches it back to its original directory.
Note VSM-Java refers to the hsmname and the attributes associated with it during
configuration as a Hierarchy.
1. Read all the topics in this chapter and fill out the “Global Configuration Worksheet”
on page 86.
2. Use the Basic Configuration Wizard and leave values at the defaults unless you know
that you want to customize your configuration. For example, you might provide a
limit for the number of files that VSM removes from local disk (VSM does not provide
this limit by default).
3. Evaluate VSM operation at the default values to see how well it satisfies your
migration and caching requirements. If you decide to vary your settings from the
defaults, fill out the “Managed File System Configuration Worksheet” on page 87 for
each file system.
4. If necessary, continue to adjust the file system configuration to achieve the desired
performance by following the guidelines in this chapter and using information from
step 3.
The VSM File System Analyzer can help you determine how to optimize migration (see
“Experimenting with Scenarios” on page 187).
Caution The number and type of your storage drives must correspond to the storage
levels you configure. For example, if you configure tape method names for both
the Primary Level and the Alternate Level, you must have at least two tape
drives configured.
The best storage method to use depends on the characteristics of the managed file system
you are configuring. If you have a file system with many large files, choose a method that
employs media with a fast transfer rate. If you have many small files, access time is more
important.
You set four parameters for a Level, which comprise a stripe.
Note When you use VSM-Java to define the configuration, it encodes the stripe syntax.
◆ volume set number, which makes the stripe unique (VSM-Java assigns this number)
◆ volume set availability, which defines how quickly files at this Level can be accessed.
◆ volume pool, which defines the volumes that are available to this Level.
The stripe format in the migconf configuration file is as follows:
"method name.volume set number.volume set availability.volume pool"
The following example from a migconf file has the method name ct (cartridge tape), the
volume set number 1, the volume set availability library, and the volume pool HSM:
"ct.1.library.HSM"
This stripe format is used in migconf file. You do not need to know or use it unless you
are working with the configuration file.
A Level may consist of more than one stripe. Defining multiple stripes for a Level means
that copies are made and sent to different locations on secondary storage, as described in
“Concurrent Stripes / Concurrent Recording” on page 63.
Method Name
A VSM method name equates to a set of parameters for each storage method that VSM
supports. These parameters define the characteristics that VSM associates with each
storage method. For example, the access time parameter is 0 for a local disk file and 30
seconds for an 8mm cartridge tape.
You can change storage methods for tape or optical disk in VSM-Java by highlighting the
stripe in the Left Pane of the main Administration dialog and selecting Edit > Change
Stripe Properties and making changes on the Physical tab.
VSM has the following storage method options (the actual method names are given in
parentheses):
◆ Sony AIT-2 technology 8 mm tapes (mt). In VSM-Java, this is named Tape 1.
◆ STK-9840 technology cartridge tapes (ct). Tape 2 in VSM-Java.
◆ DLT 7000 technology tapes (dt). Tape 3 in VSM-Java.
◆ Rewritable optical disk (op)
◆ Write once, read many (WORM) optical disk (ow)
◆ Remote method using FTP (ft)
◆ Alternate magnetic disk (ad)
◆ NetBackup (nb)
With release 4.5, VSM supports write-once-read-many (WORM) tapes. The storage
method for WORM tapes is determined by VSM-Java.
Note You can alter media density and other tape features on the Advanced Configuration
wizard Stripe Properties dialog’s Physical tab. You can alter the default methods
by changing them in the migconfg file. However, if you have already written
migrated files with one set of parameters, do not change them.
The VSM disk file (dk) method is used for the disk cache, and it is never used on a stripe
property. The dk is required for premigrating files, and it is automatically configured
during VSM installation.
Tape Methods
VSM supports the following tape storage methods:
◆ mt, which designates Sony AIT-2 technology 8 mm tapes (Tape 1 in VSM-Java)
◆ ct, which designates STK-9840 technology cartridge tapes (Tape 2 in VSM-Java)
◆ dt, which designates DLT 7000 technology tapes (Tape 3 in VSM-Java)
Your choice of tape method depends on the type of device you have on your site. If you
have more than one type of device, you use Edit > Add Stripe in VSM-Java and configure
the stripes you want to use for a Level.
With release 4.5, VSM supports write-once-read-many (WORM) tapes. The storage
method for WORM tapes is determined by VSM-Java when you check the WORM tape
checkbox on the Stripe Properties dialog’s General tab.
VSM interfaces with the VERITAS device-manager interface (ltid) to allow VSM to share
a tape library with other applications.
You can remove tapes from a library and store them on your site or send them to an
off-site storage location. When you physically remove a tape from the library device,
Media Manager updates its database to indicate the volumes on that tape are offline.
For more information on Media Manager and VSM configuration, see “Setting up VSM
Volumes Using Media Manager” on page 108.
Note You can alter these default storage methods by changing the configured density
attribute in migconf. However, if you have already written migrated files with one
set of parameters, do not change them.
Your choice of optical disk method depends on the type of media you have on your site. If
you have more than one type of device, you highlight the Level and select Edit > Add
Stripe in VSM-Java and configure the stripes you want to use.
The op and ow methods manage optical disks as logical tapes and treat each disk surface
as a tape volume. VSM stores files in a format similar to that used for storing files on tape;
however, the random seek ability of the optical-disk drive reduces access time. VSM does
automatic volume registration with optical disks.
Note When you register one side of an optical disk by using the migreg command, VSM
also automatically registers the other side of the disk using the same parameters.
This avoids deadlocks during volume consolidation and when moving files
between migration levels.
VSM interfaces with the VERITAS device-manager interface (ltid) to allow VSM to share
an optical-disk library with other applications.
Because VSM treats each optical disk as a tape volume, you can remove optical disks from
a library and store them elsewhere at your site or send them offline just as you would
store tapes.
For specific information on supported optical media, see “Notes on Supported Optical
Media” on page 461.
Disk Method
The alternate disk (ad) method uses disk volumes. You can use the ad method in the
following ways:
◆ To migrate files to another file system mounted on the same managed server
◆ As a remote method when used with NFS. If you NFS-mount a remote file system and
register it as a VSM volume, VSM can use it as secondary storage. You must mount
the NFS file system before registering it in the VSM volume database (VOLDB).
◆ With two-step tape or optical disk consolidation, as described in “Managing
Volumes” on page 201.
The remote volume servers that the ft method uses can be from a variety of different
vendors and have different capacities. The result is to combine a local UNIX file system
with one or more remote file systems and create the impression of one large virtual file
system.
Note If VSM transfers files greater than 2 GB using the ft method, the remote volume
server must be configured to accept and process files of this size.
A major difference between the ft method and tape or optical disk methods is that it
transfers whole files without breaking them into parts, or granules.
Note If VSM is running on the remote volume server in addition to the local server, use
the global stop file to prevent the migration of any data_file.GLABEL files from that
remote server. See “Controlling Global Migration” on page 218 for more
information. Having a stop file expedites the cleaning of remote file systems using
migmdclean(1M).
NetBackup Method
Caution The NetBackup (nb) method will not be supported in the next release of VSM.
Choosing this method will require conversion for the next release.
The nb (NetBackup) method lets you use NetBackup to store copies of migrated files.
When you use the nb method, file migration causes a user backup of files and their
associated granule header files to a previously defined NetBackup policy. The nb method
is similar to the remote ft method in that it transfers whole files without breaking them
into granules.
VSM issues a migcopy command to create the granule header file, referred to as GLABEL,
for each entry in the work list. The GLABEL header file is deleted when the copy
completes. VSM lists both the premigrated file and its GLABEL file in an input file for
NetBackup.
After worklist processing is finished, VSM issues a bpbackup command to NetBackup,
and the listed files are backed up. NetBackup backs up files using their full paths. The
bpbkar command uses invisible input/output to avoid causing unnecessary file caching
events.
After the backup operation is complete, or the deadman timeout configured for the nb
method has expired, the GLABEL files are deleted. VSM sets the copy_date field in the
FHDB for each file successfully backed up to be the UNIX date of the NetBackup image.
This value is used to cache the files, and later by migmdclean to clean the databases and
NetBackup volumes by setting obsolete entries to dead and removing them.
An error is logged in the VSM log file for each failed copy attempt, unless the entire
backup operation failed (then the backup failure is logged). GLABEL files are recreated the
next time a failed backup is migrated again.
Note Cache requests are issued immediately, regardless of volume set availability.
You can think of library as immediately available and vault as incurring a caching
delay.
Volume Pool
A volume pool is a group of volumes to be used by a single application and protected from
access by other applications and users. The VSM volume pool parameter designates a
group of volumes from which VSM selects volumes where it can write copies of files.
If you do not specify a stripe’s volume name, the default volume pool HSM is used. The
volume pool is set in the Select Local Device Properties dialog of the Basic and Database
Configuration wizards and in the New Stripe dialog of the Advanced Configuration
wizard.
◆ The Tape 3 Stripe and Tape 1 Stripe under Primary Level: 1 each contain a Primary
copy of migrated files. Files alternate going between the two devices.
◆ The Tape 3 Stripe and Tape 1 Stripe under Alternate Level: 2 each contain an
Alternate copy of migrated files. Files alternate going between the two devices.
ern
ern
a
ate
te
Le
Le
ve
el:v
2l:
2
Alternate copy
Tape 1 Stripe
You can take advantage of concurrent recording to speed up the migration process even if
you make only one copy. VSM will distribute migrated files between the two stripes and
write each copy on a separate device.
VSM is able to perform any number of concurrent migrations, although it does have some
constraints:
◆ Number of secondary storage devices that are available.
◆ Server speed. Too many concurrent migrations interfere with the performance of the
server. The actual number that VSM can support efficiently depends on the hardware,
operating system, and applications that are running.
VSM has been tested with as many as five stripes for one Level.
Consider the following device and media characteristics when making your choices:
◆ Access time
◆ Transfer rate
◆ Capacity
For example, if you have many small files that are frequently accessed, choose a device
and media with a fast access time. Transfer rate is not as important if files are small.
Optical disk generally has faster access time than tape.
As file size increases, however, the importance of the transfer rate also increases, and with
very large file sizes the transfer rate becomes the most significant factor to consider. In
most cases tape has a faster transfer rate than optical disk.
Media cost can also affect your choice of methods. For example, a site may be unable to
afford fast enough devices or enough online capacity to handle all the requests. If cost
constraints prevent you from achieving satisfactory cache times, set up special procedures
for users, such as requiring that migrated files be requested a day before they are needed.
The following example uses optical disk for the file systems hsm1, hsm2, and hsm4
because they have many small files, and cartridge tape for file system hsm3 because it has
mostly large files.
The files on /hsm3 are about 1.8 GB. They are also accessed or modified relatively
infrequently (every 30 days). Therefore, the tape library is used for the Primary and
Alternate copies of files migrated from this file system.
For all four of the file systems, volume set availability is always library for the first
copy and vault for the second copy. This ensures that VSM always chooses the Primary
copy for cache operations.
Volume Properties
You can associate Volume Properties with stripes to define the media on which VSM will
store migrated files. The Basic and Database wizards use some default values, but the
Advanced Configuration wizard will always prompt you for the following volume
information for all storage methods:
◆ The volume label that specifies the unique name of the volume to be recorded on the
volume and in the VSM volume database (VOLDB).
◆ Whether you want to force the registration of a previously labeled volume. If you
force registration on a volume, it cannot currently be registered in any VSM volume
database.
◆ Whether you want to add the volume to the current stripe or to volume set 0, which
makes the volume generally available for use should a stripe not have a free volume it
can access (see “Keeping a Supply of Unused Volumes” on page 202 for more
information).
For tapes and optical disk, the Advanced Configuration Wizard also prompts you to
specify if you want to delay labeling until it is needed.
For the alternate disk method, all configuration wizards prompt you for the volume
directory name, which is the file system mount point on the alternate disk. The entire
capacity of the file system at the specified mount point is assumed, so do not register a
disk partition for a directory below the mount point.
For the remote FTP method, all configuration wizards prompt you for the remote server’s
fully qualified hostname (its IP address is also valid), the pathname of the file system on
the remote server to which you will copy files, and the username/password to use.
For the NetBackup method, the Advanced Configuration Wizard also prompts you to
specify the name of the NetBackup master server, the policy name to be registered as an
NetBackup volume, and the name of the schedule defined for the policy.
The storage methods for moving files are the same as those described in “Storage Levels
for Migrating Files” on page 57.
Which storage method is best for moving files depends on how you want to handle files
as the time period in which they have not been accessed grows. For example, you may
have migrated files initially to an optical disk library for fast access. As these files grow
“older” and caching delays become less important, you may decide to move the files to
tape at a higher migration level.
To configure multilevel migration, highlight a Hierarchy in the VSM-Java Left Pane, and
select Edit > New Level, as described in “Adding to Configured Systems” on page 145.
Slice Size
You can configure VSM to retain on disk a slice of data from the beginning of each file it
migrates. Keeping this slice immediately available can be the most efficient use of disk
space, because it allows some data to be read without caching the file.
Determining how large a slice should be to prevent unnecessary caching is dependent on
whether read-ahead occurs on the migrated files and how much the read-ahead actually
reads. Such reads are operating system-specific and outside VSM control. You must test
your configuration to determine the best value for slice size.
You set slice values on the Advanced Configuration wizard Filesystem Properties dialog,
on the General tab. The size of a slice can range from 0 to 2147483648 bytes (2 GB).
You can limit the number of bytes that users can restrict from migration in their
.migstop files. The default is 10,000,000 bytes (about 9.5 MB per user). If there are many
users, the restricted space can become a significant consideration. For example, the default
allows 100 users to restrict a total of just under 1 GB.
After the total quota is exceeded, no files listed in any non-superuser’s .migstop files are
prevented from migration.
You set the quota on stop files in the Advanced Configuration wizard Filesystem
Properties dialog, on the General tab.
Note VSM ignores this quota for file systems configured to manage Oracle archive redo
logs.
When a file is partially cached, VSM allows read access to data as soon as it is cached to
disk. When you use partial file caching, you create an effective slice for the file, which
supersedes the configured file slice when processing read requests. The effective slice is
kept on disk as the configured file slice was.
The effective slice is all data previously on disk, plus the data required for the read, plus
the read-ahead, rounded up to the next whole granule. Subsequent partial caches of the
same file do not reread data already cached, but resume caching at the end of the effective
slice.
Partial file caching applies only to the first copy VSM attempts to cache from storage.
The decision to enable or disable partial file caching depends on the way your
applications use migrated data.
Total file caching is preferable if your applications read migrated file data sequentially
from start to end.
Partial file caching is preferable if your applications read a small portion of data without
reading the entire file. Total file caching, if enabled in this situation, can increase system
overhead and make your applications run longer.
Performance improvement is greatest if an application requires read access near the
beginning of the file. VSM allows read access to partially cached data as soon as the
granules containing the requested data are cached to disk. Total file caching, if enabled in
this situation, delays read access until the entire file is cached.
If possible, determine the applications that read entire files and separate them from those
that read only partial files. Place data for the former in a managed file system with partial
file caching disabled, and data for the latter in another managed file system with partial
file caching enabled. If you cannot separate the data in this way, enable partial file caching
and configure the read-ahead to optimize overall performance.
If the majority of your applications read migrated file data sequentially from start to end,
configure a larger read-ahead value. If the majority of your applications only read a small
portion of the file data, configure a smaller read-ahead value. Reconfigure read-ahead as
often as necessary to maintain optimum performance.
Note Take into consideration that accelerated disk space availability makes the migration
process less efficient. If files remain to be migrated, the destination storage media
must remount after each interruption.
If you use accelerated disk space availability, VSM stops migsweep and migcopy
processing as soon as any one of the following three configured file system properties is
satisfied:
◆ File is the maximum number of files processed by migsweep and migcopy VSM
stops processing. The default is 50 files. A value of 0 signifies no limit.
◆ Time is the maximum time in minutes migcopy runs before VSM stops processing.
The default is 30 minutes. A value of 0 signifies no limit.
◆ Kilobytes is the minimum amount of disk space (in kilobytes) freed by migsweep
and migcopy before VSM stops processing. The default is 1 MB. A value of 0 signifies
no limit.
If migcopy terminates before the work list is complete, Media Manager will remount the
destination volume when migcopy starts up again.
Note VSM may run mignospace more than once to reach the free space value. However,
running mignospace -N triggers accelerated disk space availability during a
single migsweep process. The next time migsweep runs, it will not invoke
accelerated disk space availability.
You set the values for accelerated disk space availability in the Advanced Configuration
wizard Filesystem Properties dialog’s Additional tab (the values can be changed after
configuration by selecting Edit > Change Filesystem Properties).
A general guideline for defining the low-water mark percentage is to set it high enough so
that the scheduled migbatch session selects and copies enough files to last until the next
migbatch session. Migration operations can be time-consuming, and you configure them
to occur at the most appropriate time.
VSM requires that the low-water mark percentage be equal to or greater than the free
space percentage. A value of 80% gives good results in most cases, but there are other
situations in which you will want to vary it:
◆ Increase the low-water mark percentage if the number of ready-to-purge files is not
enough to satisfy requirements between migbatch sessions.
◆ Decrease the low-water mark percentage if VSM is removing more files than
necessary to keep space available between migbatch sessions.
4:00 AM
Free space
Free space value 10% 11% of disk space is open
Purge mark 15% Premigrated
files Scheduled migbatch command runs
and premigrates files to the low-water
Low-water mark 20%
mark of 20% free space
4:00 AM to 2:00 PM
Free space
Free space value 10% Premigrated More file are created
files
Purge mark 15% Disk space usage increases
2:00 PM
The mignospace command purges files
Free space value 10% Free space premigrated at 4:00 AM until free space is
at the purge mark
Purge mark 15%
Premigrated files remain on disk that use
Low-water mark 20% the percentage of disk space equal to the
difference between the low-water mark
(20%) and purge mark (15%). This 5% of
disk space is available for instant access
should free space be needed quickly.
2:00 PM to 4:00 AM
Note DMAPI events only look at the free space value when a write occurs in the
managed file system. If you reconfigure the free space value to be below the current
configured value, nothing will happen until a write occurs in the managed file
system.
Administrators and users can use special control files in which they list specific files that
they want VSM to migrate or to prevent from migrating. The files listed will take priority
over other selection criteria. See “Controlling Global Migration” on page 218 for more
information on how to create and use these VSM control files.
For VSM to consider a file for migration, the file must meet the following criteria:
◆ Must be a regular UNIX file (for example, not a device file or link).
◆ Must not already be a premigrated or migrated file.
◆ Must reside in a managed file system. If you want files to be migrated, they cannot
reside within a nonmanaged file system, even if that file system is mounted in a
managed file system.
◆ Must have a full pathname length fewer than 1024 characters.
Note A significant number of files with full pathname lengths greater than 1023
characters can eventually fill a file system because they can never be selected for
migration. The migdbcheck(1M) man page provides more information on
pathname length.
◆ Must not be a sparse file. You can force the migration of sparse files by using the
migrate -f command, but you should know that when a sparse file is cached
(recalled to disk), it expands to its non-sparse size.
◆ Must not be a zero-length file.
1. VSM eliminates files that are under the configured minimum age (in days since last
accessed or modified) and size (in kilobytes). You set these minimums during
configuration. The defaults are 7 days and 8 KB.
2. Next, VSM selects from the remaining files according to a formula that assigns
weighting factors to file age and size to derive what is referred to as the threshold value
for the file.
If a file’s threshold (its age and size calculation) equals or exceeds the threshold for the
managed file system, the file can be migrated.
You configure migration criteria on the Filesystem Properties dialog’s Migration Criteria
tab. You can change the file threshold, the weighting factors used to calculate the
threshold, and the formula used to create the threshold.
The standard threshold_formula that VSM uses to calculate a file’s threshold value is as
follows:
threshold = (min_age x age_weight) (+ or x) (min_size x size_weight)
The following list defines the variables in the threshold_formula:
◆ threshold is the result of calculating the size and age (time since last access) of files
selected for migration using the configured threshold formula. A file is migrated if its
threshold equals or exceeds the configured threshold value.
◆ min_age is the minimum number of days since a selectable file was last accessed or
last modified.
◆ age_weight is a value that you assign to make the age of a file more or less important
than its size when files are selected for migration (the default is 1).
◆ min_size is the minimum size of a selectable file in kilobytes.
◆ size_weight is a value that you assign to make the size of a file more or less important
than its age when files are selected for migration (the default is 1).
◆ + (add) or x (multiply) either adds or multiplies the products of (min_age x
age_weight) and (min_size x size_weight), depending on the value you assign to
weight_operator. The default is multiply.
Note You can substitute a site-specified threshold formula for the standard VSM
migration threshold formula. VSM uses one threshold formula to calculate
threshold values when it selects files to migrate and to purge.
By configuring age and size values in the standard threshold formula, you can specify that
larger files are migrated before smaller files that have an equal time since last accessed or
modified, and less frequently accessed files are migrated before more frequently accessed
files of equal size.
To determine if a file can be selected for migration, VSM goes through the following
process:
1. Determines if the file’s time since last access or modification is greater than min_age.
If it is not, the file is not selectable for migration.
2. Determines if the file’s size is greater than min_size. If it is not, the file is not
selectable.
4. Determines if the file’s calculated threshold is greater than or equal to the result of the
configured threshold value. If it is, the file can be selected for migration.
The following figure illustrates how the threshold, min_age, and min_size affect which
files are migrated.
Files with a
calculated threshold less
than the configured threshold_formula
Files not migrated, regardless of age, because
they are under min_size
File Age
1. Determine the size- and age-range of files that you must migrate to increase file
system free space to the desired low-water mark.
2. Determine min_age and min_size criteria for the files you want to migrate.
- Set min_age to at least 1. This prevents VSM from migrating files the same day
they were created.
- Unless you anticipate problems, leave min_size at its default of 8 KB. This allows
VSM to migrate files larger than the default slice value (if they also equal or
exceed min_age and threshold).
When setting min_size, remember that VSM never automatically migrates files
less than the minimum size. If you set too high a value, a managed file system can
fill up even if you have scheduled automatic migration. Too low a value can cause
problems by significantly increasing migration time relative to the amount of
additional space provided.
3. Determine the threshold at which you want to start selecting files that equal or exceed
the minimum age and size.
4. Run the File System Analyzer to determine the amount of disk space your file
selection criteria would free on a file system, and adjust the criteria to suit your needs.
This process is described in “Experimenting with Scenarios” on page 187.
5. Monitor the file system and adjust your file-selection criteria, if necessary. For
example, change the values if your current settings allow the file system to gradually
fill up.
The following examples illustrate how a threshold_formula affects file migration.
Example 1:
Assume that for the managed file systems configured as hsm1, hsm3, and hsm4, you can
migrate enough files by setting min_age to 1 day, min_size to 1 KB, and threshold to 30.
VSM selects files for migration as follows:
◆ Never selects files that are under 1 day old or under 1 KB.
◆ Initially selects all files that are at least 1 day old and 30 KB.
◆ Selects files between 1 and 30 KB after all files of 30 KB or more are selected, and after
a smaller file’s age increases to the point that its threshold factor equals or exceeds 30.
30
25
20 Files below minimum age for migration Files greater than min_age and
min_size that can be migrated
15
File Size (in kilobytes)
10
5
threshold=3
Example 2:
Assume that the managed file system configured as hsm2 does not fill rapidly, but still can
benefit from VSM management. You want to migrate all files that have not been accessed
or modified in at least 30 days and are at least 300 KB.
First you set minimum amounts: you do not need to migrate files that have been accessed
or modified within 30 days, or any files smaller than 10 KB, regardless of age.
If min_age is 30 and threshold is 9000, files 300 KB or larger can be selected for migration:
(30 x 1) x (s x 1) = 9000
30s=9000
s=300
300
when threshold=90
200
150
File Size (kilobytes)
100
50
Example 3:
In the following example, you can see the effect of cutting the threshold in half. The
darkest shaded area that is bounded by the line labeled t1 indicates the extent of file
selection by migbatch when it selects files for premigration.
When VSM does not find enough files to migrate, it calls mignospace to decrease the
threshold by 50%. VSM then rescans the file system for migration candidates.
VSM will continue to cut the threshold in half until enough files are found to reach the
desired percentage of free space. VSM never automatically migrates files under the
configured minimum age or minimum size, even if it cannot find enough files to migrate.
The lighter shaded area that is bounded by the line labeled t2 illustrates how many new
files are selected when mignospace cuts the threshold in half--in this case from 90 to 45.
30
20 threshold=45)
15
File Size (in kilobytes)
A
10 mi dditio
gra n
ted al fil
wh es t
en hat
thr c
5 es an b t1
ho
ld= e
45
t2
0
0 5 10 15 20 25 30
min_age=3 File Age (in days)
Note Setting purge attributes is an optional step in configuring VSM. The default purge
attributes will purge the oldest files first, regardless of size. In many cases, this is
satisfactory and need not be changed.
VSM may be configured to select files to purge similarly to the way it selects files to
migrate. When properly configured, VSM purges files as follows:
1. Eliminates files that are under the purge minimum age (in days) and size (in
kilobytes). You can change these minimums with VSM-Java. The default is 0 for both.
2. Selects files to purge according to a formula that assigns weighting factors to file age
and size to derive the file’s purge threshold value. If a file’s calculated purge threshold
equals or exceeds the value that you configure for the managed file system, the file is
eligible for purging.
You set purge criteria on the Filesystem Properties dialog’s Purge Criteria tab. If you
select Weighted Calculation on this dialog, you can change both the purge threshold value
that VSM allows and the weighting factors that VSM uses to calculate a file’s purge
threshold.
The standard formula that VSM uses to calculate a file’s purge threshold is as follows:
purge_threshold = (min_age x age_weight) (+ or x) (min_size x size_weight)
The following list defines the variables in the threshold_formula:
◆ purge_threshold is the result of calculating the size and age (time since last access) of
files selected for purging using the configured purge threshold formula. A file is
purged if its threshold equals or exceeds the configured purge threshold value.
◆ min_age is the minimum number of days since a file was last accessed or last
modified.
◆ age_weight is a value that you assign to make the age of a file more or less important
than its size when files are selected for purging (the default is 1).
◆ min_size is the minimum size of a file in kilobytes.
◆ size_weight is a value that you assign to make the size of a file more or less important
than its age when files are selected for purging (the default is 0).
◆ + (add) or x (multiply) either adds or multiplies the products of (min_age x
age_weight) and (min_size x size_weight), depending on the value you assign to
weight_operator. The default is add.
Note If you use the ft or nb storage method, files are not eligible to be moved to a
different migration level. They can only reside at Primary Level: 1 and Alternate
Level: 2.
VSM selects migrated files to move similarly to the way it selects files to migrate:
1. From the files at the source migration level, VSM eliminates files that are under the
move minimum age (in days since migrated or moved to this level, or since last
accessed) and size (in kilobytes). The default minimum age is 7 days, and the default
minimum size is 0.
2. Next, VSM selects from the remaining files according to a formula that assigns
weighting factors to file age and size to derive what is referred to as the file’s
move_threshold value. If a file’s calculated move_threshold equals or exceeds the
threshold that you configured for the source migration level or method name, the file
is eligible for moving.
3. After a file has reached its destination level, VSM does not move it any more.
You configure move criteria by selecting Edit > Change Level Properties and then
selecting Weighted Calculation or Site-defined script from the selection box. The fields
for changing move criteria are active only after you select one of these criteria.
You also configure if you want the selected files to be left active, obsolete, or dead when
the move completes. The default is that VSM marks files at the source (first) level as dead
in the VSM databases after it copies them to the destination (final) level. You can configure
whether you want the source-level copy to be active, obsolete or dead in VSM databases.
A file marked active is accessible for caching. A file marked obsolete has a newer copy to
be used for caching (the data from files marked obsolete can be retrieved). A file marked
dead is not available for caching, and its data cannot be retrieved.
The following figure illustrates the selection procedure for moving files.
Is a Are
site-defined move criteria
Use default
move threshold No for migration No
move threshold
formula levels
formula
defined? specified in
migconf?
Yes Yes
The standard formula that VSM uses to calculate a file’s move threshold is as follows:
move_threshold = (min_age x age_weight) (+ or x) (min_size x size_weight)
The following list defines the variables in the move_threshold_formula:
◆ move_threshold is the result of calculating the size and age (time since last access) of
files selected for moving using the configured move threshold formula. A file is
moved if its threshold equals or exceeds the configured move threshold value.
◆ min_age is the minimum number of days since the file was migrated or moved to this
level or since the file was accessed or modified, whichever is most recent (the default
is 7 days).
◆ age_weight is a value that you assign to make the age of a file more or less important
than its size when files are selected for purging (the default is 1).
◆ min_size is the minimum size of a file in kilobytes (the default is 0).
◆ size_weight is a value that you assign to make the size of a file more or less important
than its age when files are selected for purging (the default is 1).
◆ + (add) or x (multiply) either adds or multiplies the products of (min_age x
age_weight) and (min_size x size_weight), depending on the value you assign to
weight_operator. The default is multiply.
a. Choose the managed file systems and specify an hsmname for each.
d. Choose a time for daily migrations to occur for each managed file system.
2. Determine the storage levels to use for each managed file system. As a part of
planning the storage levels, determine whether you want to use concurrent recording.
The Primary Level and Alternate Level direct the migration of Primary and Alternate
copies, respectively. Levels 3 through 8 direct the multilevel migration of these same
files to other storage media at a later time.
3. Determine general file system properties: slice size, stop file quota, and whether to
use partial file caching and/or accelerated disk space availability.
a. Choose a start point (free space value) and stop point (low-water mark) for
migration of files from managed file systems.
b. Choose how much disk space to make available (the purge mark) whenever free
space on the file system drops below the free space value.
Generally good guidelines are 10% free space for the free space value, 15% free
space for the purge mark, and 20% free space for the low-water mark. Specifying
a value for the low-water mark provides a limit on how many files are selected for
migration.
Note The minimum age is in days since the file was either accessed or modified,
whichever is less.
e. Choose criteria for moving files, if you are using multilevel migration:
- Minimum age file to move. The default is 7 days.
- Minimum size file to move (default is 0, effectively no minimum)
- Move threshold. The default value is 30.
Hierarchy Properties:
Managed File System Name (hsmname) _________________________
Dual Copies: _____
Level Properties
Stripe Properties
Storage Method: _____
Volume Pool Name: _____
Tape or Optical Alternate Disk NetBackup
Media Density: _____ Media Capacity: _____ Deadman timeout: _____
Media Capacity (tape): _____ Granule size: _____
Block size (tapes only):_____ Remote FTP
Granule size: _____ FTP port number: _____
Deadman timeout: _____ Deadman timeout: _____
Volume Properties
All methods Alternate Disk NetBackup
Volume label: ______________ Volume directory: ______________ Server: ______________
Force registration: _____ Remote FTP Policy: ______________
Add to current stripe:_____ Server: ______________ Schedule: ______________
Username: ______________
Password: ______________
File System Properties
File slice: _____
Stop File Quota: _____
Partial File Caching: _____ Size of read-ahead: _____
Accelerated Disk Space Availability: _____
Minimum before user access is allowed: Files migrated: _____ Minutes: _____ Kilobytes free: _____
Migration Thresholds (Water Marks)
Free Space Value: _____% Low-water Mark: _____% Purge Mark: _____%
Migration Criteria Purge Criteria Move Criteria
Min. age to migrate (days): _____ Min. age to purge (days): _____ Min. age to move (days): _____
Min. size to migrate (KB): _____ Min. size to purge (KB): _____ Min. size to move (KB): _____
Migrate files with threshold >: ____ Purge files with threshold >: ____ Move files with threshold >: ___
Age weight: _____ Age weight: _____ Age weight: _____
Size weight: _____ Size weight: _____ Size weight: _____
Weight operator: _____ Weight operator: _____ Weight operator: _____
89
About the Interface
The VSM-Java user interface lets you configure VSM on a server and perform a variety of
operations, including running VSM management commands.
- To install VSM-Java on a PC, use the InstallShield on the VSM release media.
VSM-Java files are installed to a directory of your choice. The default path name is
C:\Veritas\java.
- The release level of VSM-Java on the local host must match the release level of
VSM on the server being managed.
- If you use SGI machines, you run VSM-Java from NT or Windows 2000, or from a
Solaris or HP-UX system.
Note If you will run tape and optical devices, you must configure those devices and start
the Media Manager daemon before running VSM-Java. See the VSM installation
guide for information.
Login Screen
To log into a VSM server and use VSM-Java, you must provide the host name of the
server. The default for the field is the host name from which you started VSM-Java, if you
have started it on a VSM server. You can use any VSM server name.
The username you provide must either be root or another username with superuser
privileges.
Login Dialog
After you have provided the host name and user name, you enter the password and either
press <Enter> or click the Login button.
Administration Dialog
The VSM-Java Administration dialog has a Menu Bar, Toolbar, Left Pane (or Tree), Right
Pane, and Bottom Pane, as shown in the following figure.
Menu Bar
Toolbar
Right Pane
Left Pane
Bottom Pane
What is highlighted (selected) in the Left Pane determines what is displayed in the Right
Pane and which buttons and menu selections are active. For example, if the VSM server is
highlighted, the Right Pane displays all of the file systems on the server.
If the server is highlighted and you select Edit on the Menu Bar, you will find that only
one selection is active, as shown in the following figure.
Left Pane
The Left Pane (or Tree) displays the tree structure of the VSM server
and its configured hierarchies.
To expand or contract the information displayed in the Left Pane,
click + or -.
Right Pane
When you highlight an item in the tree on the left, the panes on the right display
information about that item. Clicking the column headings on the right Pane sorts the
information in the Pane according to the column on which you click, toggling from
ascending to descending sorts.
You will find it informative to highlight various elements in the Left Pane to see how the
Right Pane changes.
When you highlight the server, information about all
the file systems is displayed.
From left to right, the Right Pane displays the name,
VSM state for managed file systems, and the
percentage of space used. For managed file systems,
the state shown can be Idle, Idling, Maintenance,
or Inactive. If the state field is blank, the
managed file system state is Active.
If you highlight another item in the Left Pane, you
will see details about that item. For example, when
you highlight Hierarchy: hsm1 in the Left Pane,
the Right Pane displays details about the hsm1
hierarchy.
Bottom Pane
The bottom Pane displays the progress of VSM commands. Most of the commands
invoked from the Actions pull-down menu run asynchronously, and the Bottom Pane
displays a summary of their progress. To run a system status report, select View > System
Status.
To see more job detail, highlight an activity in the in the Bottom Pane. The recent output
for that job is displayed in the Right Pane, as shown in the following figure.
The Right Pane displays recent output from the System Status, which the Progress
column shows as being 6% complete.
Administration Toolbar
The VSM-Java Administration Toolbar is located near the top of the main screen, just
below the Menu bar. Select View > Show Toolbar to toggle whether the toolbar is
displayed.
Which tools can be selected and run depends on what you have highlighted in the Left
Pane and the state of the VSM server and file systems.
The following figure shows the Toolbar when the VSM server is highlighted in the Left
Pane and there are file systems that are not configured to be managed.
Toolbar when Server Is Highlighted and some File Systems not Configured
You can see that the Delete and Change Properties icons (the sixth and seventh from the
left) are grayed out or stippled. The grayed out icons cannot be selected. In this case, they
are not selectable because the functions those tools provide do not apply to the VSM
server.
If you highlight a Hierarchy in the Left Pane all of the tools become active, although the
configuration tools are active only if there are file systems that can be configured The
following figure shows the toolbar when a Hierarchy is highlighted and there are other
file systems that could be configured.
New Icon
When the server is highlighted in the Left Pane, click the New icon to add a new
hierarchy. When a hierarchy is highlighted in the Left Pane, click the New tool
to add a migration level to the hierarchy. When a Level is active in the Left Pane,
click the New tool to add a stripe. When a stripe is active in the Left Pane, click
the New tool to add a volume.
Delete Icon
Click the Delete icon to remove an element from the configuration. This tool is
not active when the server or an unmanaged file system is highlighted in the
Left Pane.
Refresh Icon
Click the Refresh icon to refresh the display. When you invoke this tool, the
display returns to the opening screen with the server highlighted.
File Menu
Use the File menu to change servers or exit VSM-Java. If you select
Change VSM Server, a confirmation dialog appears. If you confirm
your choice, the Login dialog appears. If you select Exit, VSM-Java
exits. This menu is not affected by what is highlighted in the Left
Pane.
Edit Menu
Use the Edit menu to add, change, or delete properties in the VSM configuration. The Edit
menu provides different selections depending on what is highlighted in the Left Pane, as
the following figure shows.
View Menu
Use the View menu to control the main VSM-Java window and to gather system status.
You can toggle the display of the Toolbar, set your preference for obtaining and displaying
granule counts when viewing information about a volume, refresh the display, and clear,
detach, or cancel a job you have highlighted in the Bottom Pane.
Volume Preferences
Select View > Volume Preferences to control whether VSM-Java will gather and report
information about granule counts when it displays information about volumes in a stripe.
The default behavior is to display no granule
counts. When you highlight a stripe, the Right
Pane displays the volume label, the space it
uses, the flags that are set on it, and the volume
pool to which it belongs.
To see how the View > Volume Preferences
selection changes the display, highlight a stripe and
select View > Volume Preferences > Wait for
Granule Count.
System Status
If you select View > System Status, VSM-Java will begin to gather data about VSM
managed file system activity. A new System Status job appears in the Bottom Pane. If you
highlight the system status job, the system status output will begin to display in the Right
Pane, as shown in “View Menu Selections” on page 99.
Actions Menu
The Actions menu provides access to VSM configuration and
management tools. The use of these tools is described in the
subsequent chapters of this manual, as follows:.
◆ The use of the Configure selection is described in “Configuring
VSM” on page 103.
◆ The Server, Filesystem, Level, and Volume selections are
described in “Managing VSM” on page 189.
◆ The Schedule, File Browser, File System Analyzer, and Reports
selections are described in “VSM-Java Tools” on page 151.
Configure
Select Actions > Configure to activate VSM
configuration wizards or to activate the
Manage Archive Redo Logs interface.
The Basic Configuration Wizard,
Advanced Configuration Wizard, and
Database Configuration Wizard step you
through your configuration process; they
are described in “Configuring VSM” on
page 103.
The Database Configuration Wizard and
the Manage Archive Redo Logs interfaces provide special tools for managing Oracle
archive redo logs in a file system. The archive redo log management tool is described in
“Managing Oracle Archive Redo Logs” on page 151.
Management Actions
You can always select the first-level Actions menu choices, but for the second-level Server,
Filesystem, Level, and Volume choices that you expand to the right, the what is
highlighted in the Left Pane helps determine what you can select.
For example, if you have the server highlighted in the Left Pane and you select Actions >
Level, you cannot make any further selections. If you have multiple migration levels
configured and highlight a Level in a Hierarchy, you can make any of the selections
available from the Actions > Level menu.
VSM Tools
The bottom four selections on the
Actions menu launch new interfaces
to VSM tools.
◆ The Schedule selection lets you schedule running the VSM commands migbatch,
migmove, or mignewlog and collecting data for Reports. This interface is described
in “Scheduling Tool” on page 173.
◆ The File Browser selection lets you view the files in a managed file system or perform
tasks such as migrating or purging files. The File Browser is described in “File
Manipulation with the File Browser” on page 167.
◆ The File System Analyzer selection lets you scan file systems on the VSM server. This
interface helps you visualize how files age and grow on your managed file systems.
The File System Analyzer is described in “File System Analyzer” on page 179
◆ The Reporting selection opens the Storage Migrator Reporting interface. This tool
gives you access to information that was collected when Report information was
scheduled to be collected. The graphical user interface lets you easily monitor file
system activity and trends. “Reporting Tools” on page 158 provides information on
the interface.
Help Menu
Use the Help menu to bring up the online help window and to display the VSM-Java
interface version information.
VSM-Java help is context-sensitive when you have a dialog open that
displays a Help button. If you click Help, you will go directly to
information about that window.
103
Basic Configuration Wizard
Use the Configure pulldown menu or click the Basic Configure tool to activate
the Basic Configuration Wizard.
Note This chapter does not explicitly tell you to click Next to move forward to the next
dialog in the Wizard after you have completed your selections. When instructions
for one dialog are complete, it is assumed you will click Next.
1. Specify a path name for the directories in which VSM databases reside. You must
provide a value. Click Default Path to use the default /usr/openv/hsm/database.
Note If you use the default values for database and log file paths, you must monitor the
size of the files to ensure that the /usr directory does not become full.
2. Specify a path name for the directories in which VSM logs reside. You must provide a
value. Click Default Path to use the default /usr/openv/hsm/logs. The full path
cannot be more than 1023 characters.
3. The checkbox for migrating files daily is checked by default. Migrating files daily
ensures that if something such as a power failure were to prevent migration one day,
migration could still occur the next day without intervention, and your migrated data
will be acceptably current. You can select times on the hour.
4. The checkbox for collecting report data daily is checked by default. Collecting VSM
report data daily ensures that if something such as a power failure were to prevent
report data collection one day, the collection could still occur the next day without
intervention, and your report data will be acceptably current. You can select times on
the hour.
Caution The NetBackup (nb) method will not be supported in the next release of VSM.
Choosing this method will require conversion for the next release.
1. Desired Percentage Free Space: Select the percentage of free space below which VSM
makes more space available by initiating migration operations. The default value is 10
(percent).
2. Minimum Age in Days: Provide a value to specify that VSM will not migrate files
accessed or modified within this time. Set this to a value greater than 0 to prevent files
from migrating the same day they are created. The default is 7 days.
3. Minimum Size in Kilobytes: Provide a value to specify that VSM will not migrate
files smaller than this size. The default is 8 KB.
4. Number of Copies: Select whether you want one or two (which is the default) copies
migrated to secondary storage.
Caution Configuring one copy rather than two can result in data loss should the media
that holds the copy fail in any fashion.
Note If only one tape or optical device with a single drive is attached, the default is one
copy.
The Basic Wizard allows you to create only one copy for the ad, ft, and nb
methods.
5. First copy: Select the storage medium for the first (primary) copy.
6. Pool Name: Select the volume pool name for the first (primary) copy. The pool name
must exist or be created using Media Manager.
7. Second Copy: Select the storage medium for the second (alternate) copy (if
configured).
8. Pool Name: Select the volume pool name for the second (alternate) copy (if
configured). The pool name must exist or be created using Media Manager.
and/or reading to or from the symbolic link file created by tpreq. After migcopy is
finished, VSM issues the tpunmount command to send a signal to the robot to unmount
the drive. After the unmount completes, VSM removes the symbolic link.
1. Desired Percentage Free Space: Select the percentage of free space below which VSM
will make more space available by initiating migration operations. The default value
is 10 (percent).
2. Minimum Age in Days: Provide a value to specify that VSM will not migrate files
accessed or modified within this time. Set this to a value greater than 0 to prevent files
from migrating the same day they are created. The default is 7 days.
3. Minimum Size in Kilobytes: Provide a value to specify that VSM will not migrate
files smaller than this size. The default is 8 KB.
4. Number of Copies: This field is not selectable. The wizard does not allow you to
configure more than one copy for the FTP method.
5. Server Name: Specify the name of the remote server. This can be the fully qualified
host name or the IP address of the server. VSM uses this name on the ftp open
command as the host parameter. It must be a valid FTP host.
6. Directory: Specify the full path name of the file system directory on the remote server.
The VSM user name on the VSM server must have read and write permissions to this
remote directory. You can specify any directory on the remote server that is not
already registered for VSM.
7. User Name: Specify the user name that VSM will use when accessing the remote
server from the VSM server through FTP. This name must be valid on the remote
server and also must have read and write access to the remote file system that you are
using for migration.
8. Password: Specify the password for the user name on the remote server that you
already specified.
1. Desired Percentage Free Space: Select the percentage of free space below which VSM
will make more space available by initiating migration operations. The default value
is 10 (percent).
2. Minimum Age in Days: Provide a value to specify that VSM will not migrate files
accessed or modified within this time. Set this to a value greater than 0 to prevent files
from migrating the same day they are created. The default is 7 days.
3. Minimum Size in Kilobytes: Provide a value to specify that VSM not will migrate
files smaller than this size. The default is 8 KB.
4. Number of Copies: This field is not selectable. The Basic Configuration wizard does
not allow you to configure more than one copy for the alternate disk method.
5. Volume Directory Name: Specify the file system mount point. Make sure the
specified file system is mounted before registering the volume. Do not register a disk
partition for a directory below the mount point because the entire capacity of the file
system at the mount point is assumed.
Caution The NetBackup (nb) method will not be supported in the next release of VSM.
Choosing this method will require conversion for the next release.
Select the properties for the storage method. The following figure shows the default
values provided.
1. Desired Percentage Free Space: Select the percentage of free space below which VSM
makes more space available by initiating migration operations. The default value is 10
(percent). See the figure “The NetBackup Properties Dialog” on page 111.
2. Minimum Age in Days: Provide a value to specify that VSM not migrate files
accessed or modified within this time. Set this to a value greater than 0 to prevent files
from migrating the same day they are created. The default is 7 days.
3. Minimum Size in Kilobytes: Provide a value to specify that VSM not migrate files
smaller than this size. The default is 8 KB.
4. Number of Copies: This field is not selectable. The Basic Configuration does not
allow you to configure more than one copy for the NetBackup method.
5. Storage Unit: Select the storage unit from the list box. Values in the list box reflect
storage units available from the NetBackup configuration.
The selected storage unit will be used to create a new NetBackup policy. The
NetBackup policy name is made by concatenating the hsmname with the string
nbhsm, as in hsm1nbhsm. This policy will be used to copy migrated data whenever
files are migrated from the managed file system. If a policy with the same name
already exists in the NetBackup configuration, it will be replaced with the newly
created policy without warning.
The newly created policy has its attributes set as follows:
- Policy name: hsmnamenbhsm
- Storage Unit: Select from the list box
- Volume Pool: HSM-NB
- Schedule Type: UBAK (a user-directed backup with the retention level of 9).
◆ Default values for free space, file space and file age
◆ Migrates files daily at 2:00 a.m.
◆ Generates report data daily at 4:00 a.m.
1. Review the summary and make sure you are satisfied with the configuration.
2. Click the Finish button. The wizard will not commit the configuration information
until after you click Finish.
Note To change an existing configuration, use the Edit menus described in “Editing the
Configuration” on page 145. If all of the file systems that are mounted for VSM
management are already managed, the configuration wizards are greyed out and
cannot be selected.
Use the Configure > Advanced Configuration Wizard pulldown menu or click
the Advanced Configure tool to activate the Advanced Configuration Wizard.
❖ Select the file system you want to configure as a managed file system (hierarchy).
1. Specify a path name for the directories in which the VSM databases reside. You must
provide a value. Click Default Path to use the default /usr/openv/hsm/database.
VSM-Java appends /hsmname/database to the end of the path name you specify.
For example, if you use the default path and your managed file system is named
beta, the database files will reside in
/usr/openv/hsm/database/beta/database.
Note If you use the default values for database and log file paths, you must monitor the
size of the files to ensure that the /usr directory does not become full.
2. Specify a path name for the directories in which VSM logs reside. You must provide a
value. Click Default Path to use the default /usr/openv/hsm/logs. The full path
cannot be more than 1023 characters. The log file name in this directory will be
hsmname.log.
3. The checkbox for migrating files daily is checked by default. Migrating files daily
ensures that if something such as a power failure were to prevent migration one day,
migration could still occur the next day without intervention, and your migrated data
will be acceptably current. You can select times on the hour.
4. The checkbox for collecting report data daily is checked by default. Collecting VSM
reporting data daily is useful for the same reasons as migrating files daily. You can
select times on the hour.
1. Specify the name of the hierarchy in alphanumeric characters; it cannot be more than
14 characters.
2. Dual Copies: Leave this box checked if you want to migrate two copies to secondary
storage (which is the default). Deselect this box only if you want VSM to migrate just
one copy to secondary storage.
Caution Configuring one copy rather than two can result in data loss should the media
that holds the copy fail in any fashion.
You will define a Primary Level for the selected hierarchy. If you select Dual Copies,
you will also define an Alternate Level. If you want to configure more Levels, you can
do so later by selecting Edit > Change Filesystem Properities.
❖ Define a Primary level for the selected hierarchy. If you intend to use two migration
(dual) copies, you will define an Alternate Level after you have defined the Primary
Level.
When the Primary Level is defined, it appears in the Left Pane as a child of the
Hierarchy that is named Primary Level: 1.
To define more levels for multilevel migration, follow the procedure in “Adding to
Configured Systems” on page 145.
1. Method: Select the storage method from among the following alternatives:
- Tape 1, Tape 2, Tape 3: Your choice of tape method depends on the type of device
you have on your site. If you have more than one type of device, you can analyze
their characteristics to determine the method to use for a managed file system.
The values shown after the tape methods reflect the default values for tapes. You
can change them to reflect other devices by changing the media density on the
Physical tab of the Stripe Properties dialog, as described in “Physical Tab (Tape
and Optical Media)” on page 120.
- Optical Disk: Rewritable optical disk method.
- WORM Disk: Write once, read many optical disk method.
- Alternate Disk: The alternate magnetic disk method is used for migrating files to
another file system mounted on the same VSM server or as a remote method
when used with NFS.
- FTP: Remote method using File Transfer Protocol.
- NetBackup: Use the the NetBackup storage method.
Caution The NetBackup (nb) method will not be supported in the next release of VSM.
Choosing this method will require conversion for the next release.
2. Pool: Specify the Media Manager pool for tape and optical volumes; the default is
HSM. This pool must exist or be created using Media Manager.
Note In the Stripe Properties dialogs for tape and optical media, you must click on the
tabs to move forward in the stripe configuration rather than clicking Next at the
bottom of the dialog. Clicking on Next will go forward in the configuration without
changing default stripe properties. Next does not go forward to the next tab. It goes
forward to volume properties configuration.
General Tab, Stripe Properties Dialog for Tape and Optical Disk
.
1. Method: Indicates the storage method you selected in the New Stripe dialog.
2. Pool: Indicates the name of the Media Manager pool you specified in the New Stripe
dialog.
3. Append checkbox: If checked, place multiple migrations on the same volume until it
reaches full capacity. Always check this box. If it is not checked, each migration
always starts on an empty volume.
4. End of Tape checkbox: Applies to tape methods, and only appears on those dialogs.
If checked, place multiple migrations on the same volume until end of tape (EOT) is
encountered. Always check this box.
5. WORM Tape checkbox: Applies to tape methods, and only appears on those dialogs.
Check this box if you will use WORM tape.
This feature has been tested with StorageTek 9840 write-once-read-many (WORM)
tape using Imation 9840 VolSafe cartridges and an AIT drive unit with Sony
SDX2-50C Advanced Intelligence tape.
1. Media Density: Specify the density of the tape or optical disk. Pull down the menu
and select the type of storage media for this stripe.
2. Capacity: Capacity of the media. During labeling, VSM records this value on the tape
volume.
This field applies only to tape and alternate disk methods.
VSM automatically determines the capacity of an optical disk volume when the
volume is labeled. You specify the capacity of the FTP and NetBackup methods when
you register volumes.
4. Granule Size: Specifies the size of each granule that VSM writes to the device.
VSM divides files into granules. Each granule must fit on one volume. Granule size is
a power of 2 and an integral of the block size; valid values range from 128 KB to 64
MB. You can only select valid values.
1. Deadman Timeout: Specify the maximum time in seconds that VSM waits for a
volume request to complete. The default is 3600 seconds (one hour). This field is not
used for the alternate disk method.
2. Demand Delay: Specify the maximum time in seconds that a mount request waits
before VSM unmounts a similar unused volume.
If VSM identifies a mounted but unused volume of the same density whose unmount
delay has not yet expired, it unmounts that volume as soon as the demand delay
occurs. Otherwise, the mount request remains active until a drive becomes available.
This field is not used for the alternate disk method. The defaults are 3 minutes for tape
and 20 seconds for optical disk.
3. Unmount Delay: Specify the maximum time that a volume mounted in read mode
remains mounted pending another read request (the time is in seconds). If no read
request arrives prior to the expiration of this time delay, VSM unmounts the volume.
The default value is 3 minutes. A single unmount delay value pertains to all stripes in
this configuration using the tape and optical disk methods.
The Method indicates the storage method you selected in the New Stripe dialog. To
complete this part of the configuration, you may select the following:
1. Obsolete checkbox: Always check this box. It specifies that the media supports
granule obsoleting.
2. Capacity: Specify the capacity of the method as being bytes, kilobytes, megabytes, or
gigabytes.
3. Granule Size: Specifies the size of each granule that VSM writes to the device.
The Method indicates the storage method you selected in the New Stripe dialog.
1. Obsolete checkbox: Always check this box. It specifies that the stripe supports
granule obsoleting.
2. FTP Port Number: Specify the port number for FTP. The default value is 21.
3. Deadman Timeout: Specify the maximum time in seconds that VSM waits for an FTP
request to complete. The default is one hour (3600 seconds).
Caution The NetBackup (nb) method will not be supported in the next release of VSM.
Choosing this method will require conversion for the next release.
The Method indicates the storage method you selected in the New Stripe dialog.
1. Obsolete checkbox: Always check this box. It specifies that the stripe supports
granule obsoleting
2. Granule Size is not selectable because granule size does not affect the NetBackup
method.
3. Deadman Timeout: Specify the maximum time in seconds that VSM waits for a
request to complete. The default is one hour (3600 seconds).
1. Volume Label: Specify the unique name of the volume to be recorded on the volume
and in the VSM volume database (VOLDB). VSM restricts volume names to an
alphabetic character followed by up to five alphanumeric characters, and converts all
lower case input to upper case.
2. Force Registration: Check this box to force the registration of a previously labeled
volume. If this box is not checked, previously labeled volumes are not reregistered.
3. Delayed Labeling: Check this box to delay labeling of media until needed. If not
checked, the media is labeled immediately.
4. Add Volume To: Select either Current Stripe or Volume Set 0. If you select Current
Stripe, the volume is added to the current stripe. If you select Volume Set 0, it
becomes an extra volume available for use should a stripe not have a free volume it
can access (see “Keeping a Supply of Unused Volumes” on page 202 for more
information).
2. Volume Directory Name: Specify the file system directory required when registering
a volume. Ensure the file system is mounted before registering the volume. The
directory should be a mount point, because VSM assumes it can store enough files to
fill the entire capacity of the file system at the mount point.
3. Force Registration: Check this box to force the registration of a previously labeled
volume. If not checked, previously labeled volumes are not reregistered.
4. Add Volume To: Select either Current Stripe or Volume Set 0. If you select Current
Stripe, the volume is added to the current stripe. If you select Volume Set 0, it
becomes an extra volume available for use should a stripe not have a free volume it
can access (see “Keeping a Supply of Unused Volumes” on page 202).
1. Volume Label: Specify unique name of the volume to be recorded on the volume and
in the VSM volume database (VOLDB). VSM restricts volume names to an alphabetic
character followed by up to five alphanumeric characters, and converts all lower case
input to upper case.
2. Server: Specify the name of the remote server. This can be the fully qualified host
name or the IP address of the server. VSM uses this name on the ftp opencommand
as the host parameter. It must be a valid FTP host.
3. Directory: Specify the full path name of the file system directory on the remote server.
The user name on the VSM server must have read and write permissions to this
remote directory. You can specify any directory on the remote server that is not
already registered for VSM.
4. Username, Password, and Reenter Password: Specify the user name and password
VSM will use when accessing the remote server from the VSM server through FTP.
This name and password must be valid on the remote server and also must have read
and write access to the remote managed file system that you are using for migration.
Keystrokes into the password field are echoed as asterisks (*). Because you cannot see
the password, it must be entered twice.
5. Force Registration: Check this box to force the registration of a previously labeled
volume. If not checked, previously labeled volumes are not reregistered.
6. Add Volume To: Select either Current Stripe or Volume Set 0. If you select Current
Stripe, the volume is added to the current stripe. If you select Volume Set 0, it
becomes an extra volume available for use should a stripe not have a free volume it
can access (see “Keeping a Supply of Unused Volumes” on page 202 for more
information).
Caution The NetBackup (nb) method will not be supported in the next release of VSM.
Choosing this method will require conversion for the next release.
1. Volume Label: The unique name of the volume to be recorded in the VSM volume
database (VOLDB). VSM restricts volume names to an alphabetic character followed
by up to five alphanumeric characters, and converts all lower case input to upper
case.
4. Schedule: The name of the schedule defined for the NetBackup policy. The backup
window for this schedule must be 24 hours per day, seven days per week.
5. Force Registration checkbox: Check this box to force the registration of a previously
labeled volume. If the box is not checked, previously labeled volumes are not
reregistered.
6. Add Volume To: Select either Current Stripe or Volume Set 0. r Volume Set 0. If you
select Current Stripe, the volume is added to the current stripe. If you select Volume
Set 0, it becomes an extra volume available for use should a stripe not have a free
volume it can access (see “Keeping a Supply of Unused Volumes” on page 202 for
more information).
To complete the dialogs, follow the steps in the procedures beginning with “Advanced
Configuration - New Level Dialog” on page 116.
1. Slice: Specify the number of bytes at the beginning of the file that VSM leaves stored
on disk after a file is purged. These bytes are also migrated, but VSM keeps a copy of
them on local disk when it purges the associated file. If the file is accessed, this
number of bytes can be read without caching the entire file. The value 0 implies that
no bytes will be kept in the managed file system (which is the default).
2. Quota: Specify the maximum number of bytes that users can restrict from migration.
The default is just over 9.5 MB (for the entire file system). VSM ignores this quota for
file systems configured to manage Oracle archive redo logs.
3. Partial File Caching checkbox: Check this box if you want to allow VSM to have read
access to the beginning of a purged file without caching the entire file.
4. Read Ahead: Specify the minimum number of kilobytes beyond the current read
request that VSM will partially cache to disk. Setting the value to -1 disables partial
file caching (which is the default).
5. Managed Directory: This field is informative. It displays the name already specified
for the managed file system.
Note Accelerated file system availability is only used if the file system is over the free
space value. A migbatch or miglow command does not use accelerated file system
availability.
1. Files: Specify the maximum number of files that will be processed before users can
resume accessing available free space. A value of 0 signifies no limit (which is the
default).
2. Minutes: Specify the maximum time increment that will be processed before users
can resume accessing available free space. The default is 60. A value of 0 signifies no
limit.
3. Kilobytes: Specify the minimum amount of disk space freed with Accelerated File
Space Availability enabled before users can resume accessing available free space. The
default is 1,048,576 (1 MB). A value of 0 signifies no limit.
4. Hsmname: This field is informative. It displays the name already specified for the
managed file system.
5. Logfile path: This field is informative. It displays the log file already specified for the
managed file system.
1. Desired Percentage Migrated checkbox: (also called the low-water mark.) Specify the
percentage of free disk space at which VSM stops selecting files for migration. If the
checkbox is not checked, the percentage bar is not shown. The default is 100, which is
interpreted as none.
2. Desired Percentage Purged checkbox: (also called the purge mark.) Check this box if
you want to specify the percentage of free disk space at which VSM stops deleting
purge candidates . The percentage bar is not shown if you do not check the box.
The default is 100, which is interpreted as none.
The Desired Percentage Purged must be equal to the Desired Percentage Migrated
or between the Desired Percentage Migrated and the Desired Percentage Migrated.
If the checkbox is not checked, the slider is not shown.
3. Desired Percentage Free Space checkbox: (also called the free space value or high-water
mark.) Check this box if you want to specify the percentage of free disk space at which
VSM initiates migration operations. The default value is 10 (percent).
Desired Percentage Free Space must be selected and configured.
Use the dialog shown in the following figure to set purge criteria.
The following procedure walks through filling in the fields in both tabs.
- Weighted Calculation: Specifies that you want to select files to migrate or purge
based on a modified weighted algorithm that you can specify which factors both
file size and file age. The algorithm follows:
threshold = ((age)(age weight)) [x or +] ((size)(size weight))
The age is in days and the size is in kilobytes.
- Site-defined Script: Specifies that you want to select files to migrate or purge
based on the site-defined algorithm different from the one used in the Weighted
Calculation. This algorithm is defined in the migsweep.site script, as
described in “Customizing Migration, Purging, and Moving Criteria” on page 84.
- Oracle: Specifies that you want to select Oracle archive redo logs for migration or
purging. For more information, see “Managing Oracle Archive Redo Logs” on
page 151.
2. Minimum Age in Days: Provide a value to specify that VSM will not migrate or
purge files accessed or modified within this time. Set this to a value greater than 0 to
prevent files from migrating or being purged the same day they are created or
modifed. The default is 7 days for migration and 0 days for purging.
3. Minimum Size in Kilobytes: Provide a value to specify that VSM will not migrate or
purge files smaller than this size. The default is 8 KB for migration and 0 for purging.
4. Threshold: Specifies that you want to select files to migrate or purge if the weighted
algorithm output is equal to or greater than this threshold. The default is 0 for
migration and for purging.
6. .Specify the weighting factor for file age used in the algorithm. The default is 1 for
migration and for purging.
Note The Managing Oracle Redo Logs feature is not available on SGI IRIX platforms.
The wizard will not commit the configuration information until you click on the Finish
button in the Configuration Summary dialog.
To launch the Database Configuration Wizard, use the Actions > Configure > Database
Configuration Wizard menu selection.
The Enter username and password dialog has the following fields:
You will see a dialog like the one in the following figure.
1. Database Name: Specify the name of the Oracle database that you want to configure.
If VSM-Java finds values in /var/opt/oracle/oratab, it will provide those names
in its drop-down list. If you select a name from the drop-down list, VSM-Java fills in
the home directory that you configured.
You can also type a value that is not on the drop-down list. You must also provide the
home directory.
1. Database User: Provide the user name for Oracle database administration.
2. Database Password: Provide the password for the Oracle database administration
user name.
3. Database home directory: If you the select a database name from the drop-down list,
this field is filled in by VSM-Java. If you specified a database name not on the
drop-down list, specify the home directory for Oracle.
4. Check for Backup before migration using: Specify if you use NetBackup or RMAN
to perform your database backups. VSM checks to ensure a backup exists before
deleting files. VSM does not perform backups; you must use NetBackup or RMAN to
backup your files.
5. If you choose NetBackup, the NetBackup Server field becomes active. Specify the
NetBackup server name.
6. If you choose RMAN, you can choose to use RMAN with or without the catalog
option.
- RMAN without the catalog option checks for the existence of backup copies. If
you make this selection, you provide the UNIX id with DBA privilege to run
RMAN in the appropriate field. This user ID runs the script that runs RMAN.
- RMAN with the catalog option checks for the existence of backup copies using the
catalog option.
The RMAN Catalog Net Service Name value is used as a target database for
RMAN.
The RMAN Catalog Database User Name and RMAN Catalog Database
Password values are used to connect to the catalog database and check for a
backup copy of the archive redo log files.
The UNIX id with DBA privilege to run RMAN is the user ID for running the
script that runs RMAN.
1. Specify a path name for the directories in which VSM databases reside. Click
Default Path to use the default /usr/openv/hsm/database. You must provide a
value.
Note If you use the default values for database and log file paths, you must monitor the
size of the files to ensure that the /usr directory does not become full.
2. Specify a path name for the directories in which VSM logs reside. Click Default Path
to use the default /usr/openv/hsm/logs. You must provide a value. Using the
default value is the best choice in nearly all circumstances. The full path cannot be
more than 1023 characters.
3. The checkbox for migrating files daily is checked by default. Migrating files daily
ensures that if something such as a power failure were to prevent migration one day,
migration could still occur the next day without intervention, and your migrated data
will be acceptably current. You can select times on the hour.
4. The checkbox for collecting report data daily is checked by default. Collecting VSM
reporting data daily ensures that if something such as a power failure were to prevent
data collection one day, the collection could still occur the next day without
intervention, and your reporting data will be acceptably current. You can select times
on the hour.
Caution The NetBackup (nb) method will not be supported in the next release of VSM.
Choosing this method will require conversion for the next release.
The information you are asked to supply in this dialog depends on your selection in the
Select Method dialog. This section describes each of the dialogs that are possible as Select
Properties dialogs.
1. Desired Percentage Free Space: Select the percentage of free space below which VSM
makes more space available by initiating migration operations. The default value is 10
(percent).
2. Archived redo log destination directory: Specify the full directory path for the
intended final destination of all Oracle archived redo logs.
3. Naming Convention: Specify the format you want to use for the archived redo log
files. The format T%TS%S_HAY.ARC will use the wildcard convention
T*S*_HAY.ARC to determine the names of the files for migration.
4. Migrate files older than (days): Provide a value to specify that VSM will not migrate
files accessed or modified within this time. Set this to a value greater than 0 to prevent
files from migrating the same day they are created. The default is 7 days.
5. Number of Copies: Select whether you want one or two copies migrated to secondary
storage.
Note The default number of copies is two, unless only one tape or optical device with a
single drive is attached. In that case, the default is one copy.
Caution Configuring one copy rather than two can result in data loss should the media
that holds the copy fail in any fashion.
6. First copy: Select the storage medium for the first (primary) copy.
7. Pool Name: Select the volume pool name for the first (primary) copy.
8. Second Copy: Select the storage medium for the second (alternate) copy (if
configured).
9. Pool Name: Select the volume pool name for the second (alternate) copy (if
configured).
1. Desired Percentage Free Space: Select the percentage of free space below which VSM
will make more space available by initiating migration operations. The default value
is 10 (percent).
2. Archived redo log destination directory: Specify the full directory path for the
intended final destination of all archived redo logs for the Oracle database.
3. Naming Convention: Specify the format you want to use for the archived redo log
files. The format T*S*_HAY.ARC will use the wildcard convention T*S*_HAY.ARC to
determine the names of the files for migration.
4. Migrate files older than (days): Provide a value to specify that VSM will not migrate
files accessed or modified within this time. Set this to a value greater than 0 to prevent
files from migrating the same day they are created. The default is 7 days.
5. Migrate files every: Select how often you want VSM to initiate file migration.
6. Number of Copies: This field is not selectable. The wizard does not allow you to
configure more than one copy for the FTP method.
7. Server Name: Specify the name of the remote server. This can be the fully qualified
host name or the IP address of the server. VSM uses this name on the ftp open
command as the host parameter. It must be a valid FTP host.
8. Directory: Specify the full path name of the managed file system directory on the
remote server. The VSM user name on the VSM server must have read and write
permissions to this remote directory. You can specify any directory on the remote
server that is not already registered for VSM.
9. User Name: Specify the user name VSM will use when accessing the remote server
from the VSM server through FTP. This name must be valid on the remote server and
also must have read and write access to the remote managed file system that you are
using for migration.
10. Password: Specify the password for the user name you already specified.
1. Desired Percentage Free Space: Select the percentage of free space below which VSM
will make more space available by initiating migration operations. The default value
is 10 (percent).
2. Archived redo log destination directory: Specify the full directory path for the
intended final destination of all archived redo logs for the Oracle database.
3. Naming Convention: pecify the format you want to use for the archived redo log
files. The format T%TS%S_HAY.ARC will use the wildcard convention
T*S*_HAY.ARC to determine the names of the files for migration.
4. Migrate files older than (days): Provide a value to specify that VSM will not migrate
files accessed or modified within this time. Set this to a value greater than 0 to prevent
files from migrating the same day they are created. The default is 7 days.
5. Number of Copies: This field is not selectable. The wizard does not allow you to
configure more than one copy for the alternate disk method.
6. Volume directory Name: Specify the managed file system mount point required
when registering a volume. Make sure the managed file system is mounted before
registering the volume. Do not register a disk partition for a directory below the
mount point, because the entire capacity of the managed file system at the mount
point is assumed.
Caution The NetBackup (nb) method will not be supported in the next release of VSM.
Choosing this method will require conversion for the next release.
1. Desired Percentage Free Space: Select the percentage of free space below which VSM
will make more space available by initiating migration operations. The default value
is 10 (percent).
2. Archived redo log destination directory: Specify the full directory path for the
intended final destination of all archived redo logs for the Oracle database.
3. Naming Convention: pecify the format you want to use for the archived redo log
files. The format T%TS%S_HAY.ARC will use the wildcard convention
T*S*_HAY.ARC to determine the names of the files for migration.
4. Migrate files older than (days): Provide a value to specify that VSM will not migrate
files accessed or modified within this time. Set this to a value greater than 0 to prevent
files from migrating the same day they are created. The default is 7 days.
5. Number of Copies: This field is not selectable. The wizard does not allow you to
configure more than one copy for the NetBackup method.
6. Storage Unit: Select the storage unit from the list box. Values in the list box reflect
storage units available from the NetBackup configuration.
The selected storage unit will be used to create a new NetBackup policy. The
NetBackup policy name is made by concatenating the hsmname with the string
nbhsm, as in hsm1nbhsm. This policy will be used to copy migrated data whenever
files are migrated from the managed file system. If a policy with the same name
already exists in the NetBackup configuration, it will be replaced with the newly
created policy without warning.
The newly created policy has its attributes set as follows:
- Policy name: hsmnamenbhsm
- Storage Unit: Select from the list box
- Volume Pool: HSM-NB
- Schedule Type: UBAK (a user-directed backup with the retention level of 9).
Caution It is highly recommended that you do not to change any attributes of the
VSM-created policy. Doing so may cause unpredictable consequences for VSM
operation.
2. Make any necessary changes by pressing the < Back button until you reach the dialog
you wish to change. Update it accordingly and press the Next > button to return to the
Summary Dialog.
Note If you click the < Back button to make changed, you must start the configuration
again and re-enter your changes for all the dialogs that you went past as you found
the dialog that needed the change.
3. After you are satisfied with your choices, click Finish. You have successfully
configured VSM to manage your archived redo logs.
Adding Hierarchies
You can add a hierarchy as follows:
3. Define the hierarchy, the storage levels, and the stripes for the hierarchy by
following the steps in the dialogs, as described in “Advanced Configuration
- Hierarchy Properties Dialog” on page 116.
4. After you create the hierarchy, it appears in the Left Pane as a child under the Server
and has the form Hierarchy: hsmname.
5. To add a nonmanaged filesystem to the new hierarchy, highlight the Filesystem in the
Left Pane.
7. Choose the hierarchy from the popup menu. When the file system name is assigned,
in the Left Pane it is a Managed Filesystem and a child of the Hierarchy node.
You can use the Edit pulldown menu or Change Properties tool to change managed file
system properties.
Adding Levels
You can add a level as follows:
1. To add levels to a hierarchy, highlight in the Left Pane the Hierarchy that you want to
have multilevel migration.
5. Select the number you want to associate with the level. You can choose only numbers
that are not in use.
6. After you have added the level, add stripes to it as described in “Adding Stripes” on
page 147.
Adding Stripes
You can add stripes and make more volumes available for VSM use as follows:
1. In the Left Pane, highlight the Level to which you want to add stripes.
5. To add volumes to the newly created stripe, go to the Left Pane and select the Stripe
you just added.
7. Provide volume labels and other information relevant to the storage method this
volume will use, as described in “Advanced Configuration - Volume Registration
Dialogs” on page 124.
2. Select Edit > Change Hierarchy Properties or click the Change Properties tool, as
shown in the following figure.
3. Select or deselect the Dual copies checkbox. The database path that is displayed is
informational only. the procedures described in “Advanced Configuration - Hierarchy
Properties Dialog” on page 116.
2. Select Edit > Change Filesystem Properties or click the Change Properties tool, as
shown in the following figure.
You edit the file system properties using the procedure described in “Advanced
Configuration - File System Properties Dialog” on page 129. You are not actually in the
Advanced Configuration wizard when you edit the file system. All configuration steps are
done separately if you use the Edit menu to change the configuration.
2. Select Edit > Change Level Properties or click the Change Properties tool, as shown
in the following figure.
The resulting dialog has much in common with the dialogs described in “File System
Properties - Migration Criteria and Purge Criteria Tabs” on page 133. However, rather
than setting criteria for migrating or purging files, this dialog sets criteria for moving files
for multilevel migration. The default values for moving files are also different from those
for migrating or purging files. For information on the defaults, see “Criteria for Moving
Migrated Files” on page 81
In addition to the selections described in “File System Properties - Migration Criteria and
Purge Criteria Tabs” on page 133, this dialog also includes the Flags buttons, as follows:
◆ Dead: Specifies that you want to mark FHDB entries for file copies at the source
migration level as dead.
◆ Active: Specifies that you want to mark FHDB entries for file copies at the source
migration level as active.
◆ Obsolete: Specifies that you want to mark FHDB entries for file copies at the source
migration level as obsolete.
The default is Dead for the tape and optical disk methods. For the alternate disk method,
the default is Obsolete. Move flags are not applicable to the FTP and NetBackup methods,
because these methods do not support multilevel migration.
2. Select Edit > Change Stripe Properties or click the Properties too.
Editing the configuration by selecting Change Stripe Properties is the same procedure as
the one described in “Stripe Properties Dialog for Tape and Optical Media” on page 119.
Oracle archive redo logs let you recover a database that has experienced instance or media
failure. This section explains the VSM tool that allows you to use VSM to manage your
Oracle archive redo logs.
The following major topics are discussed:
◆ “Oracle Archive Redo Logs” on page 152.
◆ “Database Configuration Overview” on page 152
◆ “Manage Archive Redo Logs Dialog” on page 153.
151
Managing Oracle Archive Redo Logs
Note To use the VSM Oracle Archive Redo Logs features, you must run NetBackup and
the NetBackup Database Agent for Oracle.
If you accept the default values offered by the Database Configuration Wizard, the file
system that contains your archive redo logs will be managed as follows:
◆ VSM will start premigrating and then purging files from local disk if the file system’s
open space drops below 10%.
◆ Files that have not been accessed or modified within 7 days are eligible for migration.
◆ Every eight hours, VSM will scan the file system to determine if it has enough open
space and take appropriate action.
◆ Reporting information will be generated daily at midnight.
Note VSM will not cache archive redo logs for database backup. A process is run to
determine if the files have been backed, and VSM does not migrate the files unless
backup copies have been made.
If you have different Oracle databases that save archived redo logs to the same file system,
you do not configure the managed file system twice. Instead, you configure it once for one
database, and then use the management tools to set up what files you want migrated.
To access the Manage Archive Redo Logs interface, select Actions > Configure > Manage
Archive Redo Logs from the VSM-Java Administration menu bar.
The initial dialog is similar to the initial dialog of the Database Configuration wizard. As
part of the Manage Archive Redo Logs tool, this dialog lets you update what files you
want to manage and how they are backed up, as follows:
◆ The Database name field controls what database you will manage with the tool. If
you select a name from the drop-down list, VSM-Java fills in the username, password,
home directory, and backup values that you configured.
If you enter a value that is not on the drop-down list, you fill in the username,
password, home directory, and backup values that you configured. VSM-Java informs
you if the file system you entered is not managed by VSM.
◆ The Check for Backup before migration using field lets you choose between
NetBackup and RMAN to perform your database backups.
The values you configured for backups are displayed in the Right Pane.
If you want to change how backups are done, you make changes and select Update
Backup Values.
◆ The Query database and show files button brings up the Manage redo log files
dialog, which lets you change file management.
1. Select the name of the database from the Database name drop-down list, or enter the
name of the database.
2. If you select a name from the drop-down list, VSM-Java fills in the username,
password, home directory, and backup values that you configured for that database. If
you entered the name of the database, you provide those values.
2. Provide the UNIX id with DBA privilege to run RMAN in the appropriate field. This
user ID runs the script that runs RMAN.
3. Provide the RMAN Catalog Net Service Name in the appropriate field. This value is
used for the catalog database.
4. Provide the RMAN Catalog Database User Name and RMAN Catalog Database
Password in the appropriate fields. These values are used to connect to the catalog
database and check for a backup copy of the archive redo log files. VSM does not
perform backups; it only checks for a backup copy. You must back up files using
RMAN or NetBackup.
5. Provide the UNIX id with DBA privilege to run RMAN in the appropriate field. This
user ID runs the script that runs RMAN.
1. Verify that the Database name and its associated values correspond to the database
you want to query.
2. Click Query database and show files. You will see a screen
like the one in the following figure.
VSM-Java fills in the Archive redo log destination directory field based on the database
you queried in the Manage Archive Redo Logs dialog immediately preceding this dialog.
2. Click on the active button to change whether the files are migrated.
1. After you have searched a managed database and listed files in the Files selected
based on naming convention Pane, you can delete them from the file system.
Reporting Tools
This section describes the VSM-Java Reporting tools that allow you to view file system
details collected by the migrd migration daemon and to generate reports about
performance and past trends.
The time span the reports can detail depends on the type of report you display. You can
display hourly reports and user ID reports that span a maximum of one year. You can
display all other reports that span a maximum of five years.
You can display reports of the frequency and number of files copied and cached, the space
used, and the general use and performance of VSM.
Major topics discussed in this section are as follows:
◆ “Starting the Reporting Tool” on page 158.
◆ “Reporting Tool Main Window” on page 158
◆ “Reporting Tool Pull-Down Menus” on page 159
◆ “Server Reports” on page 161
◆ “Managed File System Reports” on page 162
◆ “Response Reports” on page 163
◆ “Performance Reports” on page 165
Menu Bar
Left Pane
Right Pane
The Menu bar lets you choose among options to print, close the display, set preferences,
and display help.
The Left Pane displays the tree to select report types.
The Right Pane displays the reports for the area you highlighted in the Left Pane.
Setting Preferences
1. Select View > Preferences to set preferences for
bar charts. Under Chart Labels, select On to have
labels appear or Off to have no labels appear.
a. Click the Start Date calendar button to invoke the Select Dates dialog. Select the
month and year, then select the date you want to begin reporting.
Server Reports
▼ To display the details of the file systems managed by the server
▼ To display details about files and space used for all managed file systems
To zoom in on an area of the chart, click the left mouse button. To restore the chart to
its original size, type the lowercase letter r.
1. In the Left Pane, select a managed file system name under Files and Space Details.
The report displayed in the Right Pane shows migration trends in the managed file
system over the dates you specified under Preferences.
You can display the results in a plot format or a bar chart format. The displays by
server or by file system are essentially the same in the data they display, except that
the data is gathered for all managed file systems for the server display and only for
the managed file system you highlight in the Right Pane for the managed file system
display.
On a color display, the number of purged files is shown in red, migrated files in yellow,
and non-migrated files in blue.
Response Reports
Response reports let you view information about requests VSM made to cache or copy
data from or to secondary storage.
All of the response reports display the following:
◆ The managed file system where the requests originated
◆ The number of requests
◆ The number of requests that failed
◆ The average time of the requests, in seconds
◆ The maximum time of any request, in seconds
◆ The amount of data moved
The response By Day reports include information about the you will also see the mount
time and positioning time for requests to which these are applicable.
1. Select Response
> Cached > By
Day to display
daily data
retrieval
information for
all file systems by
day.
2. Select Response
> Cached > By
Filesystem to
display data
retrieval
information by
file system.
3. Select Response
> Cached> By
Hour to display
data retrieval
information for
all file systems by
hour.
1. Select
Response >
Copied > By
Day to
display copy
request
information
for all file
systems by
day.
2. Select
Response >
Copied > By
Filesystem to
display copy
request
information
by file system.
3. Select
Response >
Copied > By
Hour to
display copy
request
information
for all file
systems by
hour.
Performance Reports
Copied and Cached performance reports let you view the amount of data that VSM has
copied and cached between secondary storage and this server.
Performance reporting offers a separate selection to view by user ID, which lets you see
how much data individual users moved between secondary storage and local disk.
1. Select
Performance >
Copied and
Cached > By Day
to display copied
and cached data
for all file systems
by day.
2. Select
Performance >
Copied and
Cached > By
Hour to display
copied and
cached data for
all file systems by
hour.
3. Select
Performance >
Copied and
Cached > By
User ID to
display copied
and cached data
for all file
systems by user
ID.
4. Select
Performance >
Copied and
Cached > By
Filesystem to
display copied
and cached data
by file system.
Left Pane
Both the Left Pane and the Right Pane use icons to illustrate the type of file that you are
seeing in the display, as shown in the following table:
Grouped Directory: a directory that has been grouped so its files and
those in its subdirectories will be premigrated and cached as a group.
Regular File: a file that resides on disk and is neither premigrated nor
migrated.
Purged File: a migrated file that has been purged from local disk.
Note You must provide the proper permissions before nonroot users can use the File
Browser.
▼ To manage directories you want to keep together through migration and caching
2. To defragment a directory before grouping it, select Actions > Directory Groups >
Defragment and Group.
Any migrated files in the directory are cached and their database entries are marked
obsolete.
After the cache of purged files completes, the files and subdirectories are premigrated
as a group.
Performing this action does not guarantee that all grouped files will migrate together.
Other migration activity may cause other files to be intermingled on the same media.
3. To ungroup a previously grouped directory, select Actions > Directory Groups >
Ungroup. Subsequently any accessed files are cached individually.
1. To migrate highlighted files, select Actions > Migration > Migrate. VSM copies
premigrated files to secondary storage during its next migration operation.
No files listed in the global stop file or a local stop file will be premigrated unless the
stop file is overridden.
2. To purge highlighted files that are copied to secondary storage, select Actions >
Migration > Purge.
This action makes disk space available without waiting for normal purging
operations to occur. If the slice value is nonzero, VSM will leave that much data from
the file on disk.
3. To stage (precache) highlighted files that have been purged, select Actions >
Migration > Stage. Staging purged files in anticipation of accessing them in the near
future avoids caching delays at the time of access.
4. To locate highlighted files, select Actions > Migration > Locate. This operation is
informational only. It does not change the location or migration status of the file.
Scheduling Tool
You can use the VSM-Java Scheduling tool to add, revise, or delete a scheduled VSM
management task for a managed file system.
Note The screen differs, depending on whether you have set up any tasks.
If you have not set up any tasks, you will see a screen such as the one on the left in the
following figure, in which not all of the buttons are active.
If you have set up task schedules and select one, you will see a screen such as the one
on the right in the following figure, in which Schedule ID and Schedule Names are
visible, and the buttons to update or delete the schedule and to view its properties are
active.
- An icon next to an option indicates there are no additional sub-options. Select the
icon to display the option in the Configuration pane. Each option has its own
icon.
◆ The Configuration pane on the right changes
when you click on an options in the Options
tree list. When you have selected an option on
the left, this pane lets you configure settings for
that option.
◆ The button bar at the bottom of the dialog
enables you to accept settings and close the
dialog box, cancel settings, or get help about
the pane currently displayed. The Summary
button displays a summary of your current task
settings.
◆ The buttons on the bottom of
the screen have the following
effects:
- Select Summary to see the characteristics of the task you are setting up as it is
defined when you select the button.
- Select OK to save the task you have set up as it is defined and return to the main
Schedule Jobs dialog
- Select Cancel to end this configuration session and return to the main Schedule
Jobs dialog.
- Select Help to bring up the Scheduling tool help display.
◆ The icons next to the tasks have the following meanings:
- The grayed-out task icon indicates that no Effective Date has been
configured for the task.
- The standard task icon indicates that an Effective date has been
configured for the task.
- The arrow icon indicates that the Effective Date pane is currently
displayed and can be configured.
Tip After making changes, you can view a summary of the modified schedule by
selecting the Summary button.
❖ Click the
Summary
button
beneath the
schedule
options tree.
The Summary
dialog box is
displayed.
This is a
read-only
dialog box that
cannot be
edited.
The Summary
dialog displays the
run days and time window defined for a task during the current summary period. If you
scheduled a task to repeat during the day, the restart interval is shown as well. Run days
are highlighted; in the example, the task runs on the eleventh, twenty-first, and last day of
each month.
After viewing the current summary, you can advance the calendars.
▼ To advance a calendar
1. Select the month button (labeled the starting month for the current six-month
summary).
A drop-down listbox displays starting months of the two six-month summaries for
this task.
The File System Analyzer gathers statistical information about the size and age of files in
file systems and presents this information in graphical form. The File System Analyzer is a
read-only application; it will not alter your file system in any way.
You must run the File System Analyzer with superuser privileges. On large file systems,
gathering statistics can be time consuming and should be scheduled accordingly. After the
File System Analyzer retrieves the necessary statistics, you can view analysis of how
various “what if” scenarios can improve your system. You can repeatedly use this
analyzer to analyze any number of file systems.
To use the File System Analyzer, you can select Actions > File Browser from the VSM
Administration interface or select Start > VERITAS Storage Migrator > File System
Analyzer on a Windows system.
◆ The Tool bar lets you choose among options to change servers, analyze file systems,
delete scans, print the display, and refresh the display.
◆ The Selection Pane displays the tree to select managed file systems you want to
analyze.
◆ The Graph Display Pane shows you information about the file systems you choose to
analyze. What appears in this pane is dependent on what you select in the Selection
Pane.
More details on this screen are provided in the following sections:
◆ “File System Analyzer Pull-down Menus and Tool Bar” on page 181
◆ “Using the File System Analyzer” on page 182
◆ Actions > Analyze performs the scan of the file system(s) you have
selected in the Selection Pane. It is equivalent to the Analyze button.
1. Select Actions > File System Analyzer from the VSM-Java Administration interface.
Tip Hold your cursor over any bar in any graph to see the actual number of files or
actual size.
▼ To display the relationship of a specific criterion with the data on your file system
2. Select Number by access time to display the number of files in comparison to the time
since they were last accessed.
The following figure shows, for example, that the file system has about 2000 files that
were last accessed one month ago. All of these files have been migrated.
4. Select Number by size to display the number of files in comparison to their size.
The following figure shows, for example, that the file system has over 2000 files that
are 16 KB and one file over 512 MB.
5. Select Size by access time to display the total size of data in all files in comparison to
the time that data was last accessed.
In the following figure, for example, approximately 2 GB of data were last accessed 1
month ago; all of that data is migrated.
6. Select Size by modification time to display the total size of data in all files in
comparison to the time that data was last modified.
Much of the information in this graph is similar to the Size by access time graph;
however, in the example graphs in this section you can see that approximately 1 MB
of data was accessed but not modified 2 weeks ago.
7. Select Size by size to display the total size of data in all files of the specified size.
In the following figure, for example, you can see that slightly under 7 MB of data is
contained in migrated files that are between 128 and 512 KB.
1. To experiment with a minimum size for migrated files, select a different value from
the Migrate files greater than menu.
2. To experiment with dates of last access, select a different value from the Migrate files
not accessed in menu.
3. To experiment with dates of last modification, select a different value from the
Migrate files not modified in menu.
The graph changes as you make selections.
1. Expand the file systems in the Selection Pane until you see the date of an obsolete or
unwanted scan.
3. Select Actions > Delete or click the Delete button. Confirm your choice.
The scan disappears from the Selection Pane.
189
Backing up VSM Databases and Managed File Systems
Caution If you migrate files with the NetBackup (nb) method, do not back up managed
file systems to a NetBackup policy used by VSM.
Note The NetBackup (nb) method will not be supported in the next release of VSM.
Caution Do not use the FlashBackup feature of NetBackup (if supported on the
client/server) to back up managed file systems.
Caution If your FNDB and FHDB do not match each other, you will encounter problems
with VSM operations.
When you back up the database directory for a managed file system you must exclude the
hsmname.IHAND (Inode-to-Handle) file.
If you do back up the IHAND file, never restore it. Restoring a VSM file system that you
previously backed up automatically creates the correct IHAND file for the file system. For
details, see “Administering Inode-to-Handle (IHAND) Files” on page 198.
Note After restoring a managed file system and its FHDB/FNDB, you should run
migdbcheck to verify that the file system and the databases are in sync.
1. Make sure the migd migration daemon is running and the VSM state is Active or
Maintenance.
Caution Restoring part of a managed file system can cause problems because there is no
way of partially restoring the corresponding FHDB.
NetBackup restore sets all slice values to 0, which forces VSM to cache files the next time
they are accessed, in order to reestablish the slice data.
If a file is a purge candidate (its data resides on secondary storage), NetBackup backs up
only the inode with the VSM file handle, not the data itself. Restoring such a file restores
only the inode and VSM file handle, and VSM must then cache the data back to disk
before you can access it. See the problem solving section “Restoring Managed File
Systems” on page 255 for more information.
When purged files are removed from the managed file system (usually by the user
running rm), VSM marks the files as obsolete in the FHDB.
You can run either migrc or migmdclean to remove obsolete entries from the FHDB that
are older than the specified age variable (the default is 7 days).
Caution Be sure to set the age variable for the migrc and migmdclean commands at a
value higher than the longest NetBackup backup retention period on the
managed file system.
You cannot use NetBackup to restore files unless they have a valid FHDB entry.
The following migrc command removes obsolete entries in the FHDB that are older than
10 days, assuming that the longest NetBackup backup retention is 7 days:
# /usr/openv/hsm/bin/migrc -O FHDB -a 10
You can use the following migdbclean command, with the same effect:
# /usr/openv/hsm/bin/migdbclean -a 10
You can also edit the commands, although this method is not recommended.
To change the default age of 7 days for the migrc command, edit
/usr/openv/hsm/bin/migrc and change the 7 in AGE=7 to a value higher than the
longest NetBackup backup retention period.
To change the default age of 7 days for the migmdclean command, edit
/usr/openv/hsm/bin/migmdclean and change the 7 in FLAGS="$FLAGS -a -7" to
a value higher than the longest NetBackup backup retention period.
Starting VSM
The next VSM management task is to familiarize yourself with its startup scripts and to
modify yours if necessary.
The startup scripts are copied into place as part of the installation procedure. They reside
in /etc/init.d/hsm, and have unique names according to platforms. You can find copies
of these scripts in /usr/openv/hsm/bin/goodies:
Startup/Shutdown Scripts
4. If necessary, runs fsck on managed file systems, and mounts the file systems.
5. Runs migVSMstartup.
By default the startup script calls migVSMstartup without options, which provides the
fastest startup script execution time. You can edit the script to use options if you prefer, as
described in “Customizing Startup” on page 194.
During startup, the action migVSMstartup takes depends on the current state of each file
system:
◆ If a managed file system is in Inactive or Maintenance state, the migVSMstartup
leaves the state unchanged.
◆ If a managed file system is in Idle state, migVSMstartup changes it to Active or
Inactive, depending on the value in the global configuration file for that managed file
system. Idle indicates that the file system was cleanly shut down.
◆ If a managed file system was in Idling or Active state, it was not cleanly shut down. In
this case, migVSMstartup checks for missing trailer labels, locks, and sufficient free
space.
If migVSMstartup finds no problems, it changes the state to Active and logs the
following message in /tmp/hsm.log:
INFO: HSMNAME hsmname appears intact; state set to ACTIVE
However, if migVSMstartup does find problems, it changes the state to Maintenance
and logs the following message in /tmp/hsm.log:
ERROR: HSMNAME hsmname has problems; left in state MAINTENANCE
If VSM is left in Maintenance state, read “Starting and Stopping VSM Daemons” on
page 197 to determine what action you should take.
1. Start VSM-Java:
- On a Windows system, select Start > Programs> VERITAS Storage Migrator >
UNIX Administration. If you use SGI IRIX on your VSM server, you run
VSM-Java on Windows, Solaris, or HP-UX.
- On Solaris or HP-UX, run the following command (you can also use Windows to
run VSM-Java if you prefer):
# usr/openv/java/migsa &
2. If you have not already done so, configure VSM as described in “Configuring VSM”
on page 103.
3. The hsmname of all managed file systems is shown in the Left Pane of theVSM-Java
administration dialog.
Note Usually, the hsmname is the same as the file system mount point.
The state of the managed file systems is shown in the second column of the VSM-Java
Left Pane. You can also obtain the state of managed file systems by running
/usr/openv/hsm/bin/migVSMstate.
If any managed file systems are in Maintenance state do not resume normal
operations. Read “Customizing Startup.”
4. Start copy operations on active file systems. migcopy makes the required copies of
migrated files and migrates files from one level to another.
To start copy operations, do one of the following:
- In VSM-Java, highlight the managed file system and select Actions > Filesystem
> Restart Migrations and Moves for Filesystem.
- Run /usr/openv/hsm/bin/migrc -RM hsmname
Customizing Startup
You can edit the startup script (as found in “Startup/Shutdown Scripts” on page 192) to
call migVSMstartup with any or all of the options -D, -T, or -N. These options cause
migVSMstartup to initiate corrective actions if necessary, as follows:
-D Run migdbcheck if there appear to be database problems.
-N Run mignospace if the file system open space is less than the configured
threshold.
-T Run migadd_trailer.sh on volumes that have missing trailers.
Using the options lengthens the time needed to complete the startup script.
To modify the script, use an editor to open the startup script and search for
$MIGVSMSTARTUP. Add the options you want to run at the end of the line that contains
that string.
After you have started VSM, determine if any managed file systems are in Maintenance
state by checking the global log file or by running the command
usr/openv/hsm/bin/migVSMstate.
A managed file system does have startup problems when you see the following error
message in your global log file:
ERROR: HSMNAME hsmname has problems; left in state MAINTENANCE
Caution Contact Technical Support if you see database and/or file system errors in the
log file. Data loss is very possible if you try to correct such problems without
experienced support.
Do not run migdbcheck -r to repair FHDB entries unless you are certain you
know how the command affects databases.
If VSM is in Maintenance state after startup, do not resume normal VSM operations on
that file system. Try the following, but use caution:
1. When a managed file system is left in Maintenance state, check for consistency of the
databases and the file system. In VSM-Java, highlight the managed file system and
select Actions > Filesystem > Check DB Consistency for Filesystem.
The command-line equivalent is /usr/openv/hsm/bin/migdbcheck.
Checking database consistency can be a time-consuming operation. If you want the
database consistency check to happen automatically when a managed file system is
left in the Maintenance state, edit the startup script and change it so that
migVSMstartup is called with the -D option.
If migdbcheck reports problems, see the migdbcheck man page for procedures you
can use.
The following commands provide tools for database problem correction:
- migalter to change DMAPI attributes.
- ihprint to modify the hsmname.IHAND file entry.
Caution Changing the IHAND file incorrectly with the ihprint command or any other
way can hang the VSM or produce inconsistent results.
2. To check that the file system has enough free space to satisfy the configured threshold,
run /usr/openv/hsm/bin/miglow hsmname.
The miglow command reports the percentage of space used in the file system and the
percentage of open space you configured. If more space is used than you configured,
mignospace processing begins for the file system.
To ensure free space is available before the file system becomes Active, edit the startup
script and change it so that migVSMstartup is called with the -N option.
3. If VSM was interrupted, the ct, dt, and mt methods require trailer labels to added to
any tapes that were being written. This can be done at any time before you run out of
tapes in the pool for the method.
a. To identify volumes that need trailer labels, use the migdbrpt command, as in
the following example for the managed file system tao:
# /usr/openv/hsm/bin/migdbrpt -a tao
c. To set the write flag on a volume after you have added the trailer label, use the
the migsetdb command, as in the following example for the managed file
system tao:
# /usr/openv/hsm/bin/migsetdb -V -w tao SM0001
4. After you have completed manual recovery and maintenance activities on a managed
file system, you must make it Active. Using VSM-Java, highlight the managed file
system in the Left Pane of the Administration dialog and select Actions > Filesystem
> Set State > Active
The command-line equivalent is migVSMstate -s active hsmname
◆ The migd migration daemon must be running for many VSM functions to work,
including file caching.
◆ The migvold volume daemon must be running to manage media that is mounted for
reading.
The following commands stop or start the VSM daemons:
◆ The startmigd command starts VSM daemons. The -m, -r, and -v options start
migd, migrd, and migvold, respectively, as described in the startmigd(1M) man
page.
◆ The stopmigd command stops the migd and the migvold daemons. The -m and -v
options start migd and migvold, respectively, as described in the stopmigd(1M)
man page.
◆ The stopmigrd command stops the migrd daemon.
If migrd is running, you can use VSM-Java to start and stop the migd and migvold
daemons:
1. Verify that VSM-Java is logged in to the server that has the daemons you want to start
or stop, and highlight the server in the Left Pane.
3. To stop VSM daemons, select Actions > Server > Stop Daemons.
Setting up Utilities
The following sections describe VSM management utilities.
The full path of the IHAND file for each managed file system (hsmname) is
dwpath/database/hsmname.IHAND.
The file is indexed by inode number. Entries show the migration state of each file VSM
migrates from the file system. They contain the following information:
◆ machid
Machine ID
◆ handle
File handle assigned
◆ flags
State flags (in hexadecimal)
01 reloading (not migstage)
02 removing
04 partial cache
08 cached, unmodified
10 reloading by migstage
◆ slice
Size of the file slice (in bytes) at the time of migration. If you use partial file caching,
the configured slice size may have been replaced by the effective slice size, as
described in.“File Slices” on page 15.
◆ DM_handle
DMAPI handle
◆ DM_length
Total size of the DMAPI handle (in bytes)
◆ highest_read
For partial file caching only, this value is the read event offset plus length (in bytes)
The size of each IHAND entry is 64 bytes on Solaris and HP-UX systems, and 56 bytes on
IRIX systems. The size of the hsmname.IHAND file is approximately the
number_of_inodes * (64 | 56). The number_of_inodes is equal to the number of migrated
files. You can expand the size of an existing file system by increasing the number of
available inodes. If you do add inodes to a managed file system, the IHAND file will grow
as needed.
The VSM command ihprint will allow you to display and alter entries in the IHAND
file. Only use ihprint to fix the file if you are certain the IHAND entry is incorrect.
Caution Never make changes to the IHAND file outside of those made with ihprint
(to fix the file) and rebuild_ihand (to recover the file).
Any differences in IHAND format that may occur between software releases are
accommodated automatically when you upgrade.
Caution The IHAND file must NOT be restored with the FHDB, FNDB, and VOLDB
databases.
Typical error messages that indicate rebuild_ihand needs to be run are as follows:
05/15 22:17:45 [142]migd[343]: ERROR: Handle mis-match for inode 1440
05/15 22:17:45 [142]migd[343]: ERROR: could not convert DM to mig
See the rebuild_ihand man page for detailed usage information.
Setting up fstab/vfstab
Update the fstab file (vfstab file on Solaris) to include all managed file systems. This
update ensures that the VSM server mounts these file systems at start up. If the mount is
not done at startup, you must mount the managed file systems individually or with a
special script.
Example vfstab entries from a Solaris system follow:
/dev/dsk/sds1 /dev/rdsk/c1t6d0s1 /hsm2 vxfs - yes -
/dev/dsk/sds6 /dev/rdsk/c1t6d0s6 /hsm3 vxfs - yes -
/dev/dsk/sds0 /dev/rdsk/c1t3d0s0 /db vxfs 2 yes -
/dev/dsk/sds1 /dev/rdsk/c1t3d0s1 /hsmdb vxfs 2 yes -
/dev/dsk/sd3 /dev/rdsk/c1t3d0s3 /hsmbig vxfs 2 yes -
/dev/dsk/sds6 /dev/rdsk/c1t3d0s6 /auspex vxfs 2 yes -
On IRIX systems, the startup script creates the following symbolic link:
ln -s /usr/var/openv/hsm/global.log /tmp/hsm.log
See “Managing Logs” on page 247 for information using and managing this log file.
Control Files
You can control the migration of specific files by including them in one of two global
control files:
◆ The global migrate file (/usr/var/openv/hsm/database/migrate) contains a
list of the files or directories of files that VSM will migrate each time automatic
migration occurs.
◆ The global stop file (/usr/var/openv/hsm/database/migstop) contains a list of
the files that VSM will not migrate.
These global control files apply to all managed file systems on the server. For more
information how to create and use these global VSM control files, see “Controlling Global
Migration” on page 218.
Managing Volumes
Volume management tasks that you perform as a VSM administrator include the
following:
◆ “Monitoring Volume Usage” on page 202
◆ “Keeping a Supply of Unused Volumes” on page 202
◆ “Cleaning nb Volumes” on page 203
Caution Never use media containing VSM migrated files in a device that is not under
control of NetBackup Media Manager. Doing so can result in loss of data due to
the media being used by non-VSM processes.
After VSM uses all previously registered media, it automatically registers additional tape
and optical disk media for writing the files on the work list to secondary storage. The
registered media can be from one or more volume pools specified for the storage method
in VSM-Java. If no volume pool is specified, VSM uses the default volume pool HSM.
If there are no unassigned volumes in the specified pool, VSM registers a volume from the
Media Manager scratch pool and changes the pool name of that volume to match its own
volume pool name. For this to occur, include the following statement in the Media
Manager configuration file, /usr/openv/volmgr/vm.conf:
SCRATCH_POOL = scratch_pool_name
The scratch_pool_name is the pool name for all volumes currently unassigned in the
Media Manager scratch pool.
Cleaning nb Volumes
Note The NetBackup (nb) method will not be supported in the next release of VSM.
When VSM migrates files using the nb method, it attempts to identify the NetBackup
imageID for the migrated files. This imageID takes the form of the NetBackup client name
and the UNIX timestamp.
When a file is cached from an nb volume, VSM informs NetBackup of the UNIX
timestamp in order to help locate the file image on the volume.
If VSM cannot find the imageID when attempting to cache the file, it enters a default
timestamp of 0 in the FHDB. A timestamp of 0 slows restore operations for such files,
because no time range is indicated.
If all file images from a given timestamp are obsolete, the migmdclean command notifies
NetBackup to delete the images from its database. You are responsible for determining
when all the images on a NetBackup volume have been deleted and for expiring the
volume.
If the timestamp is 0, VSM cannot correctly inform NetBackup which images to delete,
and migmdclean cannot clean the nb volume.
The following procedure resets the time stamp so VSM can inform NetBackup which
images to delete.
▼ To fix timestamps for the nb method by substituting imageIDs for all files
1. To run the mignbscan command and merge its FHDB.label output file with the
FHDB, run the /usr/openv/hsm/bin/goodies/dbconstruct.sh script.
The remaining FHDB entries have the proper timestamp, and migmdclean will correctly
inform NetBackup which images to delete.
Consolidating Volumes
Note Consolidation is not applicable for ft or nb volumes.
1. Run migmdclean to change obsolete entries to dead, so that you write only active
files to another volume.
3. VSM does a feasibility check ensure the output volume has adequate capacity for the
files to be consolidated.
You can force consolidation to occur regardless of the outcome of the feasibility check.
If the output volume capacity is inadequate, VSM automatically registers additional
media. The new output volumes are registered in the same volume pool as the first
input volume being consolidated.
4. VSM removes all entries for file granules from the FHDB.
6. Register and label the volume for reuse by VSM, as described in “Recycling Empty
Volumes” on page 213.
The frequency with which you must perform consolidation depends primarily on the rate
at which migrated files are changed or deleted on the local file system.
Note Although you can consolidate ow volumes (write once, read many), you can not
recycle them.
In addition to using consolidation to recover wasted space, you can use consolidation to
move data from one set of volumes to another set.
The following figure illustrates what occurs as VSM writes and caches files to an optical
disk (methods op and ow) or tape volume (methods ct, dt, and mt). The process is the
same for alternate disk volumes (method ad) except that there is no EOV label to rewrite.
After files that have been cached are modified or removed, volumes may need to be
consolidated.
Labeling media creates a volume label at the front of the tape or optical media after the
BOT (beginning-of-tape label). On tape media it creates an EOV (end-of-volume label)
after the volume label. VSM also creates an entry for the volume in the VOLDB.
VOLn label
BOT VOLn Label EOV Media
When you migrate files to the volume, VSM writes them behind the header. On tape, it
rewrites the EOV after the last file. VSM updates entries in the FHDB for each file; these
files are marked “active.” This process continues until the media is full. The example
below writes three files.
If a file is modified or removed, VSM marks the FHDB entry for the file as obsolete. In the
following example, file A and file C have been cached and modified, and VSM makes their
FHDB entries obsolete. VSM rewrites the space for file A and file C only after the media is
recycled.
1. On the Left Pane of the VSM-Java Administration dialog, click the + sign for the
hierarchy and expand it until you see the volume you wish to consolidate.
2. In the Right Pane, highlight the volume you want to consolidate, as shown in the
following figure.
3. Verify that the volume full flag is set to full in the Flags column
in the Right Pane. If it is not set, select Actions > Volume > Set
Flags > Full. Confirm your choice.
1. Run migmdclean on the volumes you are consolidating. This process cleans the
media and databases by changing obsolete FHDB entries to dead and then removing
the dead entries from the FHDB.
Note For the ad and ft methods, migmdclean attempts to remove files from the media
if the MFLAG_OBSOLETE flag for these methods is set in the configuration (which it
is by default). For the ct, dt, mt, op, and ow methods, migmdclean never attempts
to remove files from the media, but makes the data inaccessible.
3. Register and label the input volumes for future use by using the migreg command:
4. The following example for the managed file system delta registers the two cartridge
tapes that were consolidated in step 2 and assigns them to volume set number 2:
# migreg -D delta ct 2 V00001 V00002
Consolidating the volumes makes all data on the input volume inaccessible.
The following figure shows what occurs during the consolidation of optical disk or tape
volumes (the ad method process is the same, except that there is no EOV label to rewrite).
Files 1A and 1C on VOL1 are dead. VSM cannot reuse the space until all files on the tape (that
is, file 1B) become dead and the tape is recycled.
migcons copies file 1B from VOL1 to VOL2 and then makes file 1B obsolete on VOL1.
FHDB entry
VOLDB entry
migreg labels the media and registers the volume for reuse by VSM by creating an entry for it
in VOLDB. The example below relabels the media as VOLn, removes the files, and rewrites
the EOV after the label.
1. To mark obsolete files dead, run migmdclean on the input volumes. If you do not run
migmdclean, obsolete files will be consolidated to the output volumes along with the
active files.
Note For the ad and ft methods, migmdclean attempts to remove files from the media
if the MFLAG_OBSOLETE flag for these methods is set (which is the default
configuration for these methods). For the ct, dt, mt, op, and ow methods,
migmdclean never attempts to remove files from the media. It makes the data
inaccessible.
2. Ensure the ad volumes you register have enough space to hold the data being copied
from the input volumes. You can estimate this by examining the output from
migdbrpt for all input volumes. The space the volume occupies is listed in bytes
under the GRAN_USE column
3. To register one or more alternate disk volumes to volume set 0, use the migreg
command, as in the following example.
# migreg epsilon ad 0 /diskAA diskAA
4. To consolidate volumes by moving the data from disk to tape, use the migcons
command.
The following example for the managed file system named epsilon consolidates ct
volumes. The embedded migselect command selects ct volumes with occupancy
limits ranging from 1.00 through 80.00 percent full. The volumes are consolidated first
on diskAA using the ad method and then to new cartridge tapes (method ct) that
VSM selects:
# migcons epsilon two ct 1 ’migselect epsilon 01.00-80.00 1 ad’
5. Register and label the input volumes for future use by using migreg.
The following example for the managed file system epsilon registers the cartridge
tapes selected in step 4 and assigns them to volume set number 1:
# migreg -D epsilon ct 1 C00001 C00002 C00003
Consolidating the volumes makes all data inaccessible on the input volume (but
accessible on the output volume for active and obsolete granules.
The following figure shows what occurs during the consolidation of optical disk or tape
volumes. The process is the same for alternate disk volumes (method ad), except that
there is no EOV label to rewrite.
Two-Step Consolidation
Files 1A and 1C on VOL1 are dead. VSM cannot reuse the space until all files on the
tape (that is, file 1B) become dead.
ad Volume file
FHDB entries
VOLDB entry
migreg labels the media and registers the volume for reuse by creating a VOLDB
entry for it. The example below relabels the media as VOLn, removes the files, and
rewrites the EOV after the label.
BOT VOLn label EOV Media
1. In the Left Pane of the VSM-Java Administration dialog, click the + signs to expand
the hierarchy until you see the volume you wish to recycle.
2. In the Right Pane, highlight the volume you want to recycle, as shown in the
following figure.
Deleting Volumes
If a volume is lost, destroyed, becomes unreadable, or all FHDB entries within it are
obsolete, you can remove the entry from VOLDB, using either VSM-Java or the command
line.
Note To ensure data is not lost, it is safest to duplicate the tape before deleting volumes.
1. In the Left Pane of the VSM-Java Administration dialog, click the + signs to expand
the hierarchy until you see the volume you want to delete. The Right Pane will show
the volume.
❖ Force valid FHDB entries to be obsolete, then to be dead, and finally remove the
VOLDB entry use a command such as the following example for VOL1, dt method:
# migmdclean -O -R VOL1.dt
Caution If you want to duplicate a tape volume, make certain that another copy of each
file exists on another volume that is neither an ft nor an nb volume.
Note
1. Identify the volume handle (VOL_HAND) of the damaged tape volume. The
VOL_HAND is found in each FHDB entry for files that are on the volume. To print a
report of all volumes, use the following command:
# migdbrpt -a hsmname
In the following example, the VOL_HAND for tape label TP0004 is 00001008.
# migdbrpt -a vdm2
2. To mark all files as dead in the FHDB that have all or part of their data on the
damaged tape volume, remove all of these dead FHDB entries, and remove the
damaged tape volume from the VOLDB, use the following command:
# migmdclean -O -R hsmname label.method.volume_set
The following example removes the database entries for tape TP0004:
# migmdclean -O -R vdm2 TP0004.dt.3
After you have removed the damaged volume and files from the VSM databases, you can
duplicate the files in different ways. The first of the following procedures uses
migdbcheck and the second and third use migmove.
▼ To create another copy of all files on a damaged tape volume using migdbcheck
2. To find and repair problems on the tape volume, run the following command:
# migdbcheck -F hsmname
The output of this command is a set of files in /tmp that begin with the string
migdbcheck and end with a process ID.
The problems described in these results files must be fixed before you go on to step 3.
Caution You could lose data if you do not repair the problems described in the
/tmp/migdbcheck* files from step 2 before you start step 3.
3. To produce a work list of all files that do not have enough copies, run the following
command:
# migdbcheck -F -r hsmname
a. In the Left Pane, highlight the level that has a good copy of the files that were on
the damaged tape.
c. In the Level Properties dialog, set all the fields to 0. Changing the values sets the
move threshold, the move minimum age, and the move minimum size to 0.
e. In the resulting dialog, the first field is the source level. Specify the number of the
level that still has an undamaged copy of the files.
The second field is the destination level. Specify the number of the level that has
the damaged files.
Confirm your choice.
a. To make another copy of the files that were on the damaged tape, run the
following command:
# migmove -fa -A -s source_level -d destination_level hsmname
The -fa option causes the source level files to remain active.
The source_level is the level that still has a good copy of the files.
Managing Migration
This section describes migration management tasks.
◆ The .migrate and .migstop files closest in the directory structure to the migration
candidate completely replace more remote control files in the directory tree. Local
control files take precedence over global control files if the same file or directory is
listed in both.
◆ If the same file or directory is listed in both a .migrate file and a .migstop file at
the same level, the .migrate file takes precedence over the .migstop file.
◆ Directories listed in a control file apply to all files and subdirectories residing in that
directory unless replaced by another control file closer in the directory structure to the
listed file or directory.
See “Control File Example” on page 220 for more information how VSM determines the
priority of control files.
◆ Special characters including a backslash (\) can be escaped with a backslash if they
are to be matched explicitly in a file name or directory.
◆ Files listed in global control files are not subject to the quota limit.
◆ If files are excluded from automatic migration by listing them in a .migstop file or
global stop file, the super user or the file’s owner can still force their migration by
running migrate -F filename.
/beta
kali
.migstop .migrate
files in /beta/kali/.migstop: files in /beta/kali/.migrate:
/beta/kali/nomig1 /beta/kali/yesmigrate1
/beta/kali/nomig2 /beta/kali/yesmigrate2
/beta/kali/*proj*/nomig* /beta/kali/*proj*/yesmigrat*
kali_proj1
The migsweep process checks for control files in the directory where it is trying to locate
migration candidates. If there are none, it searches for control files further away in the
directory structure. If it finds a control file in the local directory, it looks creates work lists
for migration based on the information it finds in that local file.
Now assume that user kali creates a .migstop file in /beta/kali/kali_proj1/ that
contains the following entries:
/beta/kali/kali_proj1/nomigrate1
/beta/kali/kali_proj1/nomigrate2
/beta/kali/kali_proj1/yesmig1
◆ The existence of this file changes the set of migration candidates in
/beta/kali/kali_proj1/ as follows:
Scheduling Migrations
VSM allows you to schedule automatic, unattended migration of files either by using the
scheduling feature of VSM or by using cron to invoke the migbatch command. When
setting up schedules, the two main considerations are as follows:
◆ What time of day migration will occur, as described in “Best Times for Migrating
Files” on page 53
◆ Which days migration will occur, as described in “How Often to Migrate Files” on
page 54
Note For information in the VSM Scheduling tool you can use to create these schedules,
see “Scheduling Tool” on page 173.
1. In the Left Pane of the VSM-Java Administration dialog, click the + signs to expand
the display of the hierarchy that contains the files you want to copy, and highlight the
managed file system.
3. Repeat these steps for each managed file system with files that you wish to migrate.
1. In the Left Pane of the VSM-Java Administration dialog, click the + signs to expand
the display of the hierarchy that you want to change and highlight the managed file
system.
2. Select Edit > Change Filesystem Properties to open the Managed Filesystem
Properties dialog. Click on the Water Marks tab. You will see a screen such as the one
in the following figure.
4. Repeat these steps for each managed file system you wish to change.
1. In the Left Pane of the VSM-Java Administration dialog, click the + signs to expand
the display of the hierarchy that contains the files you want to purge, and highlight
the managed file system.
3. Repeat these steps for each managed file system with files that you wish to purge.
Note If your managed file system has only one migration level, this option is not
available to you. It is grayed out in VSM-Java.
In multilevel migration, the initial migration to secondary storage sends the Primary copy
of a file to migration level 1. If dual copies are configured, the Alternate copy goes to
migration level 2. Because you can configure up to eight migration levels in VSM, you can
move files between levels in a variety of ways. See “Criteria for Moving Migrated Files”
on page 81 for an explanation of multilevel migration.
Note You can move files between migration levels in VSM-Java either by selecting the
managed file system to complete moves on all levels or by selecting a single level
within the managed file system that contains files want to move to another level.
This procedure describes the options for moving files from a single level to another.
1. In the Left Pane of the VSM-Java Administration dialog, click the + signs to expand
the display of the hierarchy that contains the files you want to move to a different
level, and highlight the level.
2. Select Actions > Level. You have three options you can use to migrate files between
levels.
1. To change the state of the affected managed file system, highlight the file system in the
Left Pane of the VSM-Java Administration window and select Actions > Filesystem >
Set State > Maintenance.
The command-line equivalent is migVSMstate -s maintenance hsmname.
2. To ensure all required copies have been made by the current method, run the
following command:
migbatch -s hsmname
Wait until this command finished before proceeding to the next step.
4. If there are not enough copies, and you are asked to run migrc -R also, do so.
Note When the migrc command completes, other background processes may still be
running. To ensure all recovery work is finished, check the log file for a
migrecover.sh completion message.
5. Use multilevel migration to move any files you want to move from the current level,
as described in “Move Files between Migration Levels” on page 226. (This step is
optional.)
a. Highlight the level in the Left Pane of the VSM-Java Administration window and
select Edit > Delete Level.
b. Highlight the hierarchy in the Left Pane of the VSM-Java Administration dialog
and select Edit > New Level. Configure the level as described in “Adding to
Configured Systems” on page 145.
8. To change the state back to Active, highlight the file system in the Left Pane of the
VSM-Java Administration window and select Actions > Filesystem > Set State >
Active.
The command-line equivalent is migVSMstate -s active hsmname.
Files will now be migrated according to the reconfigured storage method. Files previously
migrated under the old storage method for the level can still be cached.
To move copies of migrated files from one managed file system to another managed file
system, use the export and import feature of VSM. NetBackup is required for file export
and import with VSM.
Note The mignbexport command does not support embedded special characters in file
names, such as newline, backslash, vertical bar (pipe), tab, question mark, asterisk,
parenthesis, square brackets, or curly braces.
Make sure that each of the file systems for exporting or importing file is configured with a
unique machine ID. This convention prevents the possibility of importing files that have
the same file handles as files that have been previously migrated on the importing file
system.
Configure an appropriate migration level and corresponding method on both the
exporting system and the importing system. Copy files to that level before exporting
them, and access them from that level when importing them.
Although VSM writes data in the same format on all platforms, platform-specific device
drivers can be incompatible. For example, tapes written on HP-UX or Solaris platforms
cannot be imported to IRIX platforms in all cases. If you are exporting to optical media,
the exporting and the importing file systems must run on identical platform types and
operating systems.
reserved
reserved
obsdate 00000000 Date the file was changed or removed, making the
entry obsolete.
reserved
reserved
reserved
reserved
reserved
reserved
comment Auto HSM run Auto HSM run, User selected, or the
group name used by migtie.
Note The NetBackup (nb) method will not be supported in the next release of VSM.
For optical disk, the lt_file field holds the next byte address available, and the
server_password field holds the large sector size flag.
The following VOLDB is for an optical disk:
000001086|000E7C03|00000000|00000000|OP003A|op||0|3BB30833|001E4DC0|
0000038A|001E4986|0000046F|00000003|003C915B|0|0||||HSM|||2|
The following table describes the values for each field.
a
The migreg command redefines three VOLDB fields
when it registers a NetBackup policy as a volume for
the nb method. The location field holds policy_name,
the server_user filed holds schedule, and the
server_password field holds client_name.
lock 00000000 pid of the process that has this entry locked.
path %000000000080009400 Path name associated with the file. Possible formats
0000570000000000000 follow:
00000000002000001ff - % indicates that a DMAPI handle follows
00000034,@tiny/kcm/
d3/f.c
- @ indicates that a safe path follows (a safe path
has any special characters replaced as necessary to
make the path UNIX-readable).
- If the first character is % and the next nonnumeric
characters are ,@ the path is a DMAPI handle
followed by a safe path.
Note The filename is not a safe path name as used in the FNDB.
The script must echo a true false migration flag to stdout. Files are migrated if the output
is 0 and not migrated if the output is anything else.
The migsweep.site file can be any type of program or script.
The migsweepm.site is very much like the migsweep.site file, except that it lets you
intercept standard migsweepm processing if you want to use something other than the
default move_threshold calculation. This intercept calls migsweepm.site for each file
that meets minimum move_age and move_size parameters. The input to
migsweepm.site is one parameter in the following format:
file_name|age_in_days|size_in_kilobytes|current_threshold|method|level
Note The filename is not a safe path name as used in the FNDB.
The script must echo a true false migration flag to stdout. Files are moved if the output is
0 and not moved if the output is anything else.
The migsweepm.site file can be any type of program or script.
migconf
The migconf file is the configuration file containing migration criteria for the file systems
using this database. It is created when you configure VSM.
Note It is not best practice to edit the migconf file directly, because it can introduce
errors that produce unpredictable results. You should use VSM-Java to edit your
configuration. If you choose to edit migconf, however, do not do so while
VSM-Java or migrd is active.
FLUSH
The hsmname.FLUSH file controls how often VSM writes tape marks during file
migration. See “Performance Tuning with Tape Marks” on page 229 for more information.
Solving Problems
This section discusses actions you can take to solve problems with VSM operations at
your site.
1. Select Actions > Server > View Log. You will see a screen like the one in the
following figure.
▼ To view the VSM log file for a managed file system, do the following:
1. In the Left Pane of the VSM-Java Administration dialog, click the + signs to expand
the display of the hierarchy. Highlight the managed file system that contains the log
file you want to view.
2. Select Actions > Filesystem > View Log. You will see a screen like the one in the
following figure.
Automatic Update
You can select Automatic Update to continuously update the display with the latest
information in the log file.
1. Click the Search button. The Search Log Messages dialog appears. You will see a
screen like the one in the following figure.
3. To continue to see all messages and highlight the specified string in each message,
click Search.
4. To filter out any messages that do not contain the string, click the checkbox next to
Filter messages and click Search.
5. To make the search case-insensitive, click the checkbox next to Ignore Case and click
Search.
Note The command-line equivalent for viewing error and warning messages in log files
is the migchecklog command.
Managing Logs
VSM logs can require management if they become too large or too verbose for your needs.
1. Select Actions > Server > Set Logging Level. A confirmation dialog will appear.
Values can be from 1 to 8; the default value is 3. The
higher the number, the more verbose the logging is.
1. To activate the Scheduling tool interface, select Actions > Schedule from the
Administration dialog.
2. From the Programs pane, select mignewlog and click New Schedule from the
Administration dialog.
3. Set up the schedule for creating new logs by following the procedures in
“Configuring Schedule Settings” on page 176.
The command-line equivalent is mignewlog hsmname.
If this path exists before you start migrd, VSM will log information to it. You do not need
to take any other action to activate migrd logging. However, if you do not create the file
before you start migrd, you must stop migrd and restart it in order for VSM to start
logging information to migrd.log.
The log file is never created by VSM; you must always create it. After you start migrd
logging, monitor the migrd.log file size to prevent over filling the /usr file system.
1. In the Left Pane of the VSM-Java Administration dialog, click the + signs to expand
the display of the hierarchy. Highlight the managed file system for which you want to
change the state.
To obtain a volume scan report in VSM-Java, expand the hierarchy in the Left Pane,
highlight a stripe, and then highlight the volume in the Right Pane. Select Actions >
Volume > Scan.
To obtain a database report in VSM-Java, expand the hierarchy in the Left Pane, highlight
a file system, and select Actions > Filesystem > Check DB Consistency for Filesystem.
The following table lists the commands used to obtain for informational reports. Man
pages have details on command syntax and use.
Command Description
Volume Scan Reports include data about the volume as a whole (for example, total capacity) and
about individual granules on each volume (for example, granule size). You can use the
information to resolve inconsistencies in the VSM databases.
Migration Database Reports include information on files and volumes. They can, for example, list all
the files on all volumes in a specific volume set or specific file handle or file path.
Volume Usage Reports include information to help you determine when to consolidate volumes.
miggetvol Lists volumes, sorted by method name, in ascending order of percentage used
Global Configuration Reports include data about a specific managed file system, such as displaying
the database path and file systems.
Database Problems
Like any other file, the VSM databases are susceptible to errors due to system crashes or
premature termination of programs that lock and unlock database entries.
Caution The FHDB, FNDB, and VOLDB are text files that you can view and modify with
a text editor. However, before modifying any VSM database, be sure to stop the
VSM daemons and any VSM processes that are running.
Note The man pages for commands used in the following steps include detailed syntax
and usage information.
2. Clear all locks and complete any interrupted migrations in VSM-Java by highlighting
the managed file system in the Left Pane and selecting Actions > Filesystem > Clear
Old Locks.
Wait for the job shown in the Bottom Pane to complete. After it is done, select Actions
> Filesystem > Restart Migrations and Moves for Filesystem
Alternatively, you can run the following command:
# migrc -LR hsmname
3. Verify consistency between the FHDB and the managed file system in VSM-Java by
highlighting the managed file system in the Left Pane and selecting Actions >
Filesystem > Check DB Consistency for Filesystem
Alternatively, you can run the following command:
# migdbcheck hsmname
Either action checks the following:
- All migrated files on the specified managed file systems have an FHDB entry.
- The FHDB contains entries only for files that exist in the managed file system.
Note Repairing a managed file system requires thorough knowledge of VSM. Do not
attempt it unless you are aware of the consequences of running the necessary
commands.
VSM creates numerous output files in /tmp related to migdbcheck. These files
have the format /tmp/migdbcheck-*. You must review each output file and take
appropriate action before repairing the file system by running the migdbcheck -r
hsmname command. You do not have to run migdbcheck -r under normal
conditions.
4. Verify consistency between the media and the FHDB by running the following
command:
# mediacheck hsmname
This command verifies that files recorded on the media also have entries in the FHDB.
- Ensure that the managed file system is in Maintenance state and select Actions >
Filesystem > Clear Old Locks. Wait for the job shown in the Bottom Pane to
complete.
Alternatively, you can run the following command:
# migrc -L hsmname
1. In VSM-Java, highlight the managed file system that has the problem in the Left Pane
and select Actions > Set State > Maintenance. Wait for the job shown in the Bottom
Pane to complete.
2. To ensure no locks are set, select Actions > Filesystem > Clear Old Locks.
Alternatively, you can run the following command:
# migrc -L hsmname
3. To ensure that there are no premigrated files, select Actions > Filesystem > Batch
Purge.
Alternatively, you can run the following command:
# mignospace -i hsmname
4. To check for consistency among the VSM databases, select Actions > Filesystem >
Check DB Consistency for Filesystem.
Alternatively, you can run the following command:
# migdbcheck hsmname
Caution Do not restore the hsmname.IHAND file when you restore the other databases.
Caution If you do not restore the FHSEQF file, you may re-use existing file handles.
1. Shutdown VSM completely for the managed file systems that need to be restored:
# /usr/openv/hsm/bin/migVSMshutdown hsmname
3. Restore the databases from the latest backup at the dwpath/database level. Check
and reconcile each file in the restored directory against the original database files.
Under certain circumstances, a manual rebuild of the database may be required. To do
this, you scan the VSM storage volumes as needed (as described in “Commands for
Media and Database Reports” on page 250). Contact VERITAS Customer Support any
time you are attempting to rebuild your VSM databases.
4. After you have rebuilt databases, rebuild the .IHAND file as described in the
rebuild_ihand(1M) man page. Read the man page before you rebuild the .IHAND
file.
5. Before you attempt further migration, run migdbcheck complete a file system
consistency check on the VSM managed file system. Read the migdbcheck(1M)
before you run the command.
1. Ensure that the migd, migrd, and migvold daemons are running and that the
managed file system is in Maintenance state.
a. In the Left Pane of the VSM-Java Administration dialog, highlight the managed
file system.
b. Start the purge operation by migrating all premigrated files. Select Actions >
Filesystem > Batch Migrate and confirm your choice. Wait until the Bottom Pane
reports that the operation succeeded.
c. Complete the purge operation by deleting all purge candidates. Select Actions >
Filesystem > Batch Purge and confirm your choice. Wait until the Bottom Pane
reports that the operation succeeded.
To complete the steps from the command line, do the following:
a. Start the purge operation by migrating all premigrated files. Run the following
command:
# migbatch hsmname
b. Complete the purge operation by deleting all purge candidates. Run the following
command:
# mignospace -i hsmname
1. Change the state of the damaged managed file system you want to restore to
Maintenance.
3. Use mkfs or newfs to create a new file system to which you will restore undamaged
migrated files.
6. If the undamaged copy of the file system you are restoring has an hsmname.IHAND
file in the database directory, remove it.
7. Restore the copy of the file system from before the damage occurred. A fairly common
error is to restore a copy of the damaged file system, so ensure you have the correct
one.
8. If you restore migrated files that were removed from the file system, the FHDB entries
for those files are marked as obsolete. To reactivate those entries, use the following
command:
# migactivate hsmname
10. To clear locks and remove obsolete and dead database entries, select Actions >
Filesystem > Clear Old Locks in VSM-Java or run the following command:
# migrc -L -O hsmname
Caution Stop all activity on the managed file system before extending it.
If you add inodes, the hsmname.IHAND file will grow as needed to accommodate the
larger file system.
1. Check the FNDB to find the file handle that VSM assigned to the file.
For example, assume that you are trying to reload file /home2/jdoe/tprog/proga
from the server greek2me. This file is under the management of iota and the
machine ID is 3E8 (1000 decimal). You find the following FNBD entry for proga:
000012D2|000E03E8|00000000|00000000|00000463|00000001|000001A4|
Auto HSM run |||@home2/jdoe/tprog/proga|
The first field is the file handle (000012D2) and the second is the machine ID
(000003E8)
There must also be at least one FHDB entry for this file. It must not be a dk method
entry (an online copy) or a pl method entry (a placeholder). FHDB entries do not
contain the file path name. The FHDB entries for this file will have the same file
handle and machine ID in the first two fields:
000012D2|000E03E8|00000000|00001048|00000000|00028000|00000000|000
28000|00000001|||3B17DF57|3B17DF7C|00000000|ct|||||l|59 0
00002235|00000000|||00000000|00000001|
This entry represents a copy using the ct method (field 15, shown in bold type face).
2. Use the examples in the migreconstruct man page to help you reconstruct deleted
migrated files.
After migreconstruct completes, try to cache the file.
3. If you cannot cache the file after running migreconstruct, do the following:
5. Use the migactivate command to make sure the FHDB entries are active. This can
be a slow process.
Note A file restored in this manner is no longer considered a migrated file. The command
fls -l filename will show no VSM machine ID or file handle.
Restarting Migrations
If VSM fails during migration or of migration does not finish (for example, if there were
not enough tapes), first correct cause of the system failure. After the problem is corrected,
complete the following procedure.
a. Select Actions > Filesystem > Restart Migrations and Moves for Filesystem
Alternatively, you can run the following commands:
a. For tape or optical storage, start the device manager daemon by run the following
command:
# /usr/openv/volmgr/bin/ltid
b. For ft remote volumes, ensure that the VSM server is able to access the file
system on the remote volume server.
1. Check the dwpath/workdir directory for the name of the requested tape file.
1. Register additional media. Tapes can automatically be registered from a free pool. The
migreg man page provides information on registering media for VSM.
2. Ensure that there are no premigrated files in VSM-Java by selecting Actions >
Filesystem > Batch Migrate and confirm your choice.
Alternatively, you can run the following command:
# migbatch hsmname
261
fls(1)
fls(1)
NAME
fls - list contents of a directory and indicate whether files are migrated
SYNOPSIS
/usr/openv/hsm/bin/fls [-l]
DESCRIPTION
The fls command is a version of the standard ls command, modified to work with VSM.
It supports most of the options supported by the standard ls command.
The fls command lets you list the contents of your directories, and, when used with the
-l option, indicates which of those files have been migrated or purged.
For example, assume you have a migrated file named tproga in your current working
directory, and you run the following command:
# /usr/openv/hsm/bin/fls -l tproga
The response is as follows:
mrwxr-xr-- 1 root 23 Nov 29 14:30 tproga [000003e8 0000100e]
The m in the mode bit field indicates that the file has been migrated. The numbers to the
right of the file name indicate the machine ID and file handle, respectively.
If tproga has also been purged, the fls command output is as follows:
mrwxr-xr-t 1 root 23 Nov 29 14:40 tproga [000003e8 0000100e]
The t in the mode bit field indicates that the file has been purged and no longer resides on
disk. The t flag is the UNIX “sticky” bit. It is visible using the standard ls command. If
the VSM server exports managed file systems via NFS, the sticky bit on the NFS client can
indicate that the file is purged and make take some time to access.
If tproga has been cached but not been changed, the fls command output is as follows:
-rwxr-xr-- 1 root 23 Nov 29 15:30 tproga [000003e8 0000100e]
The m and the t in the mode bit field are removed to indicate that the file has been cached
back to disk. The machine ID and the file handle are displayed.
If tproga has been cached and also changed, it is no longer a migrated file. The fls
command output is as follows:
-rwxr-xr-- 1 root 23 Nov 29 15:40 tproga
The machine ID and file handle are removed to indicate that the cached file has been
changed, which renders the migrated copy in secondary storage invalid.
CAVEATS
◆ When fls is run with the -F option, it causes directories to be marked with a trailing
/, sockets with a trailing =, symbolic links with a trailing @, executable files with a
trailing *, and migrated files with a trailing %. The fls command does not mark fifos.
◆ fls has other options corresponding to those of the standard ls command, but those
options have not been tested.
SEE ALSO
ls(1), migloc(1)
gethsm(1)
NAME
gethsm - display the hsmname for all managed file systems or for a specified file or
directory
SYNOPSIS
/usr/openv/hsm/bin/gethsm [filename | dirname]
DESCRIPTION
The gethsm command identifies and displays the hsmname assigned to managed file
system containing the file or directory specified in the command. If no file or directory is
specified, gethsm identifies and displays the hsmnames for all managed file systems.
Output is displayed to standard output. Error messages go to standard error.
This command may be run without regard to whether the migd migration daemon is
running, but the VSM state must be Active if an option is specified.
This command is intended for both administrators and users.
OPTIONS
filename The full pathname of the file for which to display the hsmname.
dirname The full pathname of the directory for which to display the hsmname.
EXAMPLES
To display all managed file systems, type the command without options:
# gethsm
alpha beta gamma delta
To display the managed file system for a particular file or directory, include the filename
or dirname option in the command:
# gethsm /hsmrel/dir/subdir/filename
alpha
Error messages are returned if the filename or dirname are not valid:
In the following example, /usr is not a managed file system (/usr should not be a
managed file system because of its contents).
# gethsm /usr
ERROR: Path not configured for VSM.
In the following example, the beta file system state is Inactive, and gethsm cannot obtain
information.
# gethsm /beta/tom/file1
Error: hsmname is inactive.
FILES
dwpath/database/migconf
Configuration file for managed file systems
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
SEE ALSO
VSM(1M)
HSMKiller(1M)
NAME
HSMKiller - end active VSM processes
SYNOPSIS
/usr/openv/hsm/bin/HSMKiller [hsmname]...
DESCRIPTION
The HSMKiller command ends VSM processes and unmounts secondary storage
volumes that are left mounted by any ended processes.
If one or more hsmnames are specified, HSMKiller ends all active processes listed in
HSMKiller.kill_list for the specified hsmnames, but not the daemons migd and
migvold. The HSMKiller.kill_list is located in the admincmd directory of
/usr/openv/hsm/bin.
The HSMKiller also unmounts secondary storage volumes left mounted by any ended
process, and signals migvold to clean up the mount table.
If no hsmname is specified, HSMKiller ends all active processes listed in
HSMKiller.kill_list and HSMKiller.global.kill_list, located in the
admincmd directory of /usr/openv/hsm/bin. It also ends the daemons migd and
migvold, unmounts all secondary storage volumes, and removes the VSM mount table.
Use stopmigd if you want to terminate just the VSM daemons migd and migvold.
Note After running HSMKiller, run migrc to clean up any locks left set by the ended
processes.
The migcleanup command should be used to see if there are left over DMAPI sessions
(migcleanup -e). Left over DMAPI sessions should be cleaned up with the
migcleanup -k command.
A tape volume that was being written when ended by HSMKiller, will have the T flag
set in its VOLDB entry. (The T flag can be seen with the migdbrpt command. The flag
means that a trailer label is needed on the tape volume.) The command
/usr/openv/hsm/bin/goodies/migadd_trailer.sh should be used to add trailer
labels to such volumes.
Note Any process that cannot be terminated by a kill-9 command after three attempts
remains active, and a failure message is placed in the global log file.
OPTIONS
hsmname Configured VSM name for the managed file system for which you want
to end processes. More than one hsmname may be included on the
command line. The default is all hsmnames if none are specified.
CAVEATS
◆ HSMKiller searches for processes to end which are executing using the full
pathname for VSM binaries, /usr/openv/hsm/bin. All VSM processes which call
other VSM processes use this convention. For HSMKiller to work properly, all VSM
processes called by customer defined scripts or cron schedules should follow this
same convention instead of depending on PATH variables to allow shorthand
command names.
◆ Use care either when deleting unused processes from
/usr/openv/hsm/bin/admincmd/HSMKiller.kill_list to speed HSMKiller
processing or when otherwise editing the two lists. This may result in a less
comprehensive termination of active processes.
FILES
/usr/openv/hsm/bin/admincmd/HSMKiller.kill_list
HSMKiller kill list
/usr/openv/hsm/bin/admincmd/HSMKiller.global.kill_list
HSMKiller global kill list
SEE ALSO
migVSMshutdown(1M), migVSMstartup(1M), migconfg(1M), migrc(1M),
startmigd(1M), stopmigd(1M)
ihprint(1M)
NAME
ihprint- print or alter an IHAND (inode-to-handle) file entry
SYNOPSIS
/usr/openv/hsm/bin/ihprint [-m machid] [-h handle] [-f flags] [-c
slice] [-d dmhandle] [-H highest] [-I ihandfile] hsmname
[inode | pathname]
Caution ihprint is intended only for customer support engineers who are trained in its
use--this especially applies to changing the IHAND file. All other users should
rely on the rebuild_ihand command to verify and change IHAND entries.
DESCRIPTION
The ihprint command prints the IHAND entry for an inode in a managed file system. If
any options are specified, ihprint sets the indicated field of the IHAND entry, prints the
new entry to stdout, and updates the IHAND file.
To make changes, the managed file system state must be Active or Maintenance. The file
system must be mounted for ihprint to run.
OPTIONS
-m machid Set the machine id field of the appropriate IHAND entry to machid. The
value is assumed to be hexadecimal.
-h handle
Set the file handle field of the appropriate IHAND entry to handle. The
value is assumed to be hexadecimal.
-f flags Set the flags field of the appropriate IHAND entry to flags. The value is
assumed to be hexadecimal.
01 reloading
02 removing
04 parital_cache
08 cached, unmodified
10 being cached by migstage
-c slice Set the slice field of the appropriate IHAND entry to slice.
-I ihandfileSpecifies an alternate path to an IHAND file in which an entry is to be
modified and/or printed. If ihandfile is specified, hsmname and inode
must also be specified and pathname cannot be specified.
EXAMPLE
The following command and resulting output show how to print the IHAND entry for the
inode at /iota/file94:
# ihprint /iota/file94
Current IHAND entry for file94:
HANDLE MACHID FLAGS SLICE HIGHEST
13D2 2C70C0 10 0 0
DMHANDLE-LENGTH DMHANDLE
20 00000000400000090000000842042dc
00000000000000180000016963000001
The following command and resulting output show how to change the machine ID field
of this same IHAND entry to 3E8:
# ihprint -m 3E8 /iota/file94
Current IHAND entry for magic:
HANDLE MACHID FLAGS SLICE HIGHEST
13D2 2C70C0 10 0 0
DMHANDLE-LENGTH DMHANDLE
20 00000000400000090000000842042dc
00000000000000180000016963000001
Modified IHAND entry for file:
HANDLE MACHID FLAGS SLICE HIGHEST
13D2 3E8 10 0 0
DMHANDLE-LENGTH DMHANDLE
20 00000000400000090000000842042dc
00000000000000180000016963000001
The following command and resulting output show how to clear the flags field of the
IHAND entry for handle 13D4 in managed file system iota:
# ihprint -f 0 iota 13D2
Current IHAND entry for iota inode 13:
HANDLE MACHID FLAGS SLICE HIGHEST
0 0 10 0 0
DMHANDLE-LENGTH DMHANDLE
0
Modified IHAND entry for iota inode 13:
HANDLE MACHID FLAGS SLICE HIGHEST
0 0 0 0 0
DMHANDLE-LENGTH DMHANDLE
0
Do you want the IHAND entry reset? [yn] y
IHAND entry modified.
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/hsmname.IHAND
Inode-to-handle file for VSM
dwpath/database/FHDB
File handle database for VSM
dwpath/database/FNDB
File name database for VSM
SEE ALSO
rebuild_ihand(1M)
mediacheck(1M)
NAME
mediacheck - check the media and file handle database (FHDB) for consistency
SYNOPSIS
/usr/openv/hsm/bin/mediacheck hsmname label method
DESCRIPTION
The mediacheck command verifies that all files recorded on the secondary storage
media are also recorded in the VSM file handle database (FHDB). The label is scanned
(using migadscan, migtscan, migopscan, migftscan, or mignbscan) and compared
with the file handle database entries.
You can use the migdbrpt command to display a summary of information from the
FHDB. You can use the migdbcheck command to verify consistency between the file
system and FHDB and also to verify the consistency between the volume database
(VOLDB) and FHDB.
To run this command, the VSM state must be Active or Maintenance.
OPTIONS
hsmname Configured VSM name of the managed file system containing the
database files you want to check. This parameter is required.
label Label of the volume that is to be checked.
method Method the label is registered for. The allowed methods are ad, ct, dt,
mt, op, ow, ft, and nb.
EXAMPLE
The following example verifies the media on optical disk OP001A, which is registered in
the database specified by the configured VSM name alpha.
# mediacheck alpha OP001A op
ERRORS
-- FHDB entry 00001098 is locked by 0007700
An entry is locked by the indicated process. Ensure that VSM is not being actively
used and the VSM migration daemon (migd) is not running (see stopmigd(1M)).
Run migrc to clear any leftover locks. Then, rerun mediacheck.
-- FHDB entry 00001097 is out of order
The FHDB is maintained in sorted order. If an entry is reported out of order, sort the
FHDB according to the first two fields of each line.
-- Missing FHDB gran 00001098, offset 1000, file
/home/gls/wiggins
A portion of the file recorded on the media is no longer in the FHDB. If the file is still
in the active file system, you may have to reconstruct the FHDB entries as described in
migdbcheck.
-- Missing FHDB entry for file /home/gls/wiggins
The media contains a file that does not have an entry in the FHDB. If the given file is
still in the active file system, you may have to reconstruct the FHDB entries as
described in migdbcheck.
-- Missing media granule 00001098, offset 1000, file
/home/gls/bird
A portion of the file recorded in the FHDB is no longer on the media. If the file still
exists in the active file system, the file data may be lost if you cannot recover it from a
backup.
-- No media file for orphan FHDB entry
A file recorded in the FHDB is no longer on the media. If the given file still exists in
the active file system, the file data may be lost if you cannot recover it from a backup.
SEE ALSO
VSM(1M), migdbcheck(1M), migadscan(1M), migconfg(1M), migdbrpt(1M),
migftscan(1M), mignbscan(1M), migtscan(1M), migopscan(1M), migrc(1M),
stopmigd(1M)
migactivate(1M)
NAME
migactivate - activate FHDB entries for files with VSM file handles
SYNOPSIS
/usr/openv/hsm/bin/migactivate [-E loglevel] [-v] hsmname
DESCRIPTION
The migactivate command activates all dead or obsolete file handles in the FHDB for
all files in a managed file system that have VSM file handles. migactivate must be run
before you use migrc or migmdclean to remove obsolete or dead FHDB entries.
Dead or obsolete file handles result whenever two files share an identical VSM file handle
and one file is deleted. For example, if you backup and restore migrated files to an
alternate path, and then remove one of these files, you will have a file with an obsolete
VSM file handle.
OPTIONS
-E loglevel
Sets the log level used by migactivate. The numeric value for the log
level you want to use for this command; this is used instead of the
configured VSM setting. The configured default setting is found in the
VSM configuration log file.
Note If the VSM log level is set to 8, migactivate lists all FHDB handles, and assigned
inode numbers, of all FHDB handles that were made active.
EXAMPLE
The following example sets the log level to 8 for migactivate and lists all activated
FHDB entries.
# ./migactivate -E 8 -v xi
starting migactivate xi
INFO: activated FHDB entry 3E8M13A0 inode = 107
SEE ALSO
VSM(1M), migmdclean(1M), migrc(1M), migconfg(1M)
migadscan(1M)
NAME
migadscan - scan alternate disk volumes under VSM for file granules
SYNOPSIS
/usr/openv/hsm/bin/migadscan -F [-n] [-s] hsmname label
mount_point
/usr/openv/hsm/bin/migadscan [-n] [-s] hsmname label
DESCRIPTION
The migadscan command scans an alternate magnetic disk (ad) volume and displays
information about the volume as a whole in addition to information about each granule
on the volume.
If you specify the -F option, the media can be scanned without a VOLDB entry. You must
supply an alternate magnetic disk mount_point with the -F option.
The migadscan command creates three output files: FHDB.label, FNDB.label, and
VOLDB.label, in the dwpath/database directory. The structure of these files is the same
as the FHDB, FNDB, and VOLDB database files. These files may be used to rebuild the
FHDB, FNDB, and VOLDB if they are corrupted or damaged (see migdbcheck(1M)).
You can sort and merge FHDB.label and FNDB.label files for different magnetic disks in
order to recreate the FHDB and FNDB. Similarly, you can merge and sort the VOLDB.label
files for different magnetic disks to recreate the VOLDB database.
Note When you recreate the VOLDB, you must merge the old and new VOLDB files to
include the entry for the dk method.
OPTIONS
-F Force a scan of the volume for VSM granules. This is useful when the
volume identity is not in the volume database. This parameter is optional.
If omitted, the volume must be registered in the volume database. If
specified, mount_point must also be specified.
-n Do not compress the FHDB entries for files found on the volume. When
the -n option is used, no FNDB.label file is produced. This option is
useful for examining what is actually written on the media. The
FHDB.label file produced with the -n option must be run through
migfhdbconvert before it can be merged into the real FHDB and
FNDB.
-s Silently scan the volume and create FHDB.label and VOLDB.label files.
Do not display information on stdout.
hsmname Configured VSM name of the managed file system specifying the path to
the database files that contain entries for the volume you want to scan.
label Label of the volume you are scanning. This parameter is required. For a
force scan, you can specify any name for the label.
mount_point
Indicates the mount point for the alternate magnetic disk. Specify
mount_point if and only if using the -F option. If using NFS, make sure
the file system has been mounted.
CAVEATS
Scanning an alternate magnetic disk volume that contains files that are not VSM granules
will produce informative messages such as the following:
<filename> ***Not a Valid Granule*** 10
EXAMPLE
The following example scans alternate magnetic disk volume pjrad1 registered under ad
method and displays a list of granule information for files migrated to the volume. Files
FHDB.PJRAD1 and VOLDB.PJRAD1 are created in the VSM database directory.
# /usr/openv/hsm/bin/migadscan hsm2 AD0001
VOLUME AD0001 registered to HSM
Volume Particulars
------------------
000E7C00V00001003 AD0001 ad 00050000 00006288 #16
Volume Label Found ====> AD0001-------------------------------
E7C00M8D.2.0 <=> 00826C00 00200000 Wed Jan 9 17:48:55 2002 /Xa/sv/h1
E7C00M8D.1.0 <=> 00826C00 00000000 Wed Jan 9 17:48:55 2002 /Xa/sv/hx
E7C00M8D.5.0 <=> 00826C00 00800000 Wed Jan 9 17:48:55 2002 /Xa/sv/hs
E7C00M8D.4.0 <=> 00826C00 00600000 Wed Jan 9 17:48:55 2002 /Xa/sv/ha
E7C00M8D.3.0 <=> 00826C00 00400000 Wed Jan 9 17:48:55 2002 /Xa/sv/h4
Under Volume Particulars you see displayed (in order): volume handle
(000E7C00V00001003), volume label (AD0001), method (ad), total capacity of the volume
(00050000), total space in use on the volume (00006288), and number of granules on the
volume (16).
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/FHDB
File handle database for VSM
dwpath/database/FNDB
File name database for VSM
dwpath/database/VOLDB
Volume database for VSM
dwpath/database/migconf
Configuration file for managed file systems.
dwpath/database/FHDB.label
File handle database for current volume
dwpath/database/FNDB.label
File name database for current volume
dwpath/database/VOLDB.label
Volume database for current volume
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
SEE ALSO
migdbcheck(1M), migconf(1M), migconfg(1M), migdbrpt(1M), migftscan(1M),
migtscan(1M), migopscan(1M)
migalter(1M)
NAME
migalter - display or alter regions, events, or attributes for a file or managed file system
SYNOPSIS
/usr/openv/hsm/bin/migalter [-F] [-e event]... [-d event]...
[pathname | -f filelistpath]
/usr/openv/hsm/bin/migalter [-O] [-r region] [-h handle] [-m
machid] [-p slice] [pathname | -f filelistpath]
/usr/openv/hsm/bin/migalter -I [pathname | -f filelistpath]
/usr/openv/hsm/bin/migalter -R [pathname | -f filelistpath]
Caution migalter is intended only for customer support engineers who are trained in
its use.
DESCRIPTION
When the used with file pathnames, migalter displays or alters managed regions,
displays or enables events, displays or alters DM attributes, or punches a hole.
For managed file systems, migalter displays or alters events or DM attributes.
If no options are specified, migalter displays the enabled events for the managed file
system, and the managed regions, DM attributes, file attributes, allocation information
and DMAPI handle information for the file. If a file is partially cached, this is noted with
the allocation information.
OPTIONS
-F Display or alter enabled events for the managed file system of pathname.
Default is display or alter enabled events, managed regions, and DM
attributes for the file pathname.
The -F option can not be used with -r, -h, -m, -p, or -u.
-e event Add the specified event to the pathname. Valid values for event are as
follows:
event = CREATE, POSTCREATE, REMOVE, POSTREMOVE, RENAME,
POSTRENAME, LINK, POSTLINK, SYMLINK, POSTSYMLINK, DESTROY,
NOSPACE, ATTRIBUTE, PREUNMOUNT, UNMOUNT, or NOEVENT.
NOEVENT clears all events.
Multiple instances are allowed. If both -e and -d are specified, events are
added before they are deleted. See Examples.
-d event Delete the specified event from the pathname. Valid values for event are
as follows:
event = CREATE, POSTCREATE, REMOVE, POSTREMOVE, RENAME,
POSTRENAME, LINK, POSTLINK, SYMLINK, POSTSYMLINK, DESTROY,
NOSPACE, ATTRIBUTE, PREUNMOUNT, UNMOUNT, or NOEVENT.
Multiple instances are allowed. If both -e and -d are specified, events are
added before they are deleted. See Examples.
-O Specifies that migalter should use the rules for interpreting the DMAPI
attribute that it used before VSM version 4.5. If you use -O, migalter
will regard a file that is migrated by VSM version 4.5 as a cached file.
-r region Add the managed region to the file pathname. Valid values for region are
as follows:
region = READ, WRITE, TRUNCATE, NOREGION, MIGRATED, PURGED, or
CACHED
NOREGION clears all regions
MIGRATED sets WRITE, TRUNCATE
PURGED sets READ, WRITE, TRUNCATE
CACHED sets WRITE, TRUNCATE
NOREGION, MIGRATED, PURGED, and CACHED all change the DM attributes
for the pathname
region offset and size are always set to 0; thus, the region applies to the
whole file
Note Before VSM version 4.5, MIGRATED set READ, WRITE, TRUNCATE events.
-h handle Set the file handle field of the DM attributes to handle for the file
pathname. The value is assumed to be hexadecimal.
-m machid
Set the machid field of the DM attributes to machid for the file pathname.
The value is assumed to be hexadecimal.
-p slice Punch a hole in the file pathname from the offset slice to the end of the
file, where slice is specified in bytes. The value is assumed to be decimal.
-I Initialize DM attributes on the managed file system or file pathname. You
must first mount the file system before running migalter -I. Once
migalter -I is run, you must have the migd migration daemon
running to mount the manged file system.
The -I option can not be specified with any other option. It is only
available on Solaris and HP-UX implementations.
EXAMPLE
A single command statement can both add and delete events. The following example first
adds the REMOVE event and then deletes the DESTROY event for the managed file
system kappa:
# migalter -F -e REMOVE -d DESTROY /kappa
The following example clears the regions for the file /omega/file6:
# migalter -r NOREGION /omega/file6
The following example initializes DM attributes on managed file system theta and
prevents it from being mounted unless the migd migration daemon is running:
# migalter -I /theta
The following example removes DM attributes from managed file system theta and
allows it to be mounted whether or not the migd migration daemon is running:
# migalter -R /theta
The following example displays the enabled events for file system sigma, and the
managed regions, DM attributes, file attributes, allocation information and DMAPI
handle information for the file /sigma/projects/file1:
# migalter /sigma/projects/file1
SEE ALSO
migcleanup(1M)
migbatch(1M)
NAME
migbatch - control migration of files from file system to secondary storage
SYNOPSIS
/usr/openv/hsm/bin/migbatch [hsmname] | [file_system]
DESCRIPTION
The migbatch command controls the migration of files to secondary storage. It can
sweep all file systems, the file system indicated by hsmname, or the specified file_system.
A migbatch command searches for files that meet specified age and size criteria. A file
in a managed file system is considered a migration candidate if all of the following are
true:
◆ It is a regular UNIX file (for example, not a device file or symbolic link). The nb
method does not support asterisk, backslash, parenthesis, question mark, right curly
brace or square bracket characters in file names.
◆ The file’s computed threshold value is greater than or equal to the migration
threshold value specified in migconf.
◆ It is not already migrated.
◆ The pathname of the file does not appear either in the global stop file or in a local stop
file, .migstop, unless the stop file is overridden. See CAVEATS.
◆ The file does not reside in nonmanaged file system, even if that file system is mounted
in a VSM-managed directory.
◆ The full pathname length is under 1024 characters.
If the migconf file specifies a low-water mark, migbatch stops selecting files when this
is reached. Otherwise, all files that meet the selection criteria are selected. This could
result in migrating almost every regular file from the managed file system.
VSM then premigrates the data for each selected file. The site configure the Primary Level
(an optionally the Alternate Level) to specify the type of media, volume set, volume set
availability, and volume pool to which the premigrated files are written. VSM then writes
the specified number of copies of the file to the specified secondary storage media.
After files are copied to secondary storage, files may be purged by mignospace to make
disk space available. mignospace starts under any of the following conditions:
◆ The migd migration daemon periodically checks the high-water mark threshold and
starts mignospace if the threshold is exceeded.
◆ The command responds to preset schedule that you established using the VSM
Scheduling tool.
◆ You execute mignospace from the system prompt.
◆ You execute miglow from the system prompt.
◆ You start migration in VSM-Java.
This command may be run without regard to whether the migd migration daemon is
running, but the VSM state must be Active.
OPTIONS
hsmname Configured VSM name of the managed file system that specifies the file
system you want migbatch to process.
file_system
Full path name of the file system on which to initiate migration.
If you do not specify either file_system or hsmname, then migbatch reads all
configuration files and sweeps all file systems.
CAVEATS
◆ The migration process only migrates regular file data. It is not a substitute for a
backup process which copies all directories and files. You must backup your system,
including VSM databases, so you will be able to restore the system to that level
following a catastrophic failure or loss of files.
◆ If you use cartridge tapes or optical platters, the ltid daemon must be running. If the
ft method name is used, the remote file system must be available.
◆ If VSM transfers files greater than 2 GB with the ft method, the remote volume server
must be configured to accept and process files of this size.
◆ Migration waits for caching operations to complete when migrating and caching from
the same tape or optical volume. Migration and caching operations can occur in
parallel for the ft and ad method names.
◆ The .migrate and .migstop files most local to the listed file override more remote
control files in the directory tree. Local control files override global control files if the
same file or directory is listed in both. If the same file is listed in both a .migrate file
and a .migstop file at the same level, the .migrate control file overrides the
.migstop file.
◆ Some processes spawned by migbatch create large temporary files and there may
not be enough space in the /tmp directory to store these files. You can avoid this
problem by defining the environment variable TMPDIR to contain the pathname of a
directory in a file system that has sufficient space available. Then, if the process checks
TMPDIR, it creates any temporary files in the specified directory instead of in the
default /tmp.
EXAMPLES
◆ The following example starts the migration for hsmname alpha.
# migbatch alpha
◆ The following example starts the migration for all file systems on the VSM server:
# migbatch
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/migconf
Configuration file for managed file systems
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
/usr/var/openv/hsm/database/migrate
Global migrate file for VSM
/usr/var/openv/hsm/database/migstop
Global stop file for VSM
SEE ALSO
VSM(1M), migconf(1M), migconfg(1M), miglow(1M), mignospace(1M), migreg(1M),
migrc(1M), startmigd(1M), stopmigd(1M)
migcat(1)
NAME
migcat - concatenate and display migrated files without caching them to disk
SYNOPSIS
/usr/openv/hsm/bin/migcat file [file]...
DESCRIPTION
The migcat command is a modified version of the standard UNIX cat command.
The migcat command sends the migrated file or files to stdout one granule at a time,
and does not cache the file to disk. The user does not have to wait until the entire file is
cached before reading it.
The standard UNIX cat command caches the entire file data to disk before the user can
read it. This delay is reduced by using migcat instead of cat, particularly for large files;
however, the I/O transfer rate may be lower for a migcat than for a normal cache
operation.
This command may be run without regard to whether the migd migration daemon is
running, but the VSM state must be Active.
This command is intended for both administrators and users.
OPTIONS
file Specifies the file or list of files to concatenate. Wildcards are recognized.
This parameter is required.
CAVEATS
◆ Files migrated with method ft or nb will be cached.
Note The nb method will not be supported after the VSM 4.5 release.
EXAMPLE
The following command reads the migrated files report21a, report21b, and report33 to
stdout:
# migcat rep*21? report33
SEE ALSO
cat(1), migstage(1)
migchecklog(1M)
NAME
migchecklog - list the most recent error messages from an error log file
SYNOPSIS
/usr/openv/hsm/bin/migchecklog [-d time_in_minutes] [-h] [hsmname
| GLOBAL]
DESCRIPTION
The migchecklog command checks the specified VSM log file and displays the 20 most
recent error messages logged.
Using the -d option runs migchecklog periodically following a variable delay. If
subsequent checks find newer error messages, older messages are dropped from the
input. The display indicates that new errors exist and appends them to the list of up to
twenty error messages.
OPTIONS
-d time_in_minutes
Check logs, and then delay for the sleep time specified by the variable
time_in_minutes before checking logs again. Default is 0, which checks
logs only once.
-h Print Help information.
hsmname The VSM name configured to use the log file you want migchecklog to
check. Checking the global log file on the VSM server (/tmp/hsm.log) is
the default. See migconfg(1M) for more information on the global
configuration file.
CAVEATS
◆ Because migchecklog lists only the latest 20 error messages, it is possible some error
messages could be missed by this command. If the listing shows 20 new errors, the
administrator is advised to check the actual log in question for any errors that may not
have been reported.
EXAMPLES
◆ The following example checks the global log file once:
# migchecklog
◆ The following example checks the log file for the managed file system nu:
# /usr/openv/hsm/bin/migchecklog -d 6 nu
------- Fri Jan 11 10:52:48 CST 2002 --------
01/11 10:14:27 [1164]migtie[4937]: ERROR: groupfile .fd
not found above tie file /nu/ag/f1.
01/11 10:14:27 [1164]migtie[4937]: ERROR: groupfile .fd
not found above tie file /nu/ag/f2.
01/11 10:14:27 [1164]migtie[4937]: ERROR: groupfile .fd
not found above tie file /nu/ag/f3.
01/11 10:25:20 [1164]migin[5949]: ERROR: No FHDB entries
for 2912448M5BDE
After 6 minutes, migchecklog prints the list again, appending any new messages
and dropping older messages as necessary to maintain a maximum list of 20
messages:
------- Tue Jan15 15:11:58 CDT 2002 --------
New errors
01/12 14:36:25 [12]migmkspace[113]: ERROR No entries
in FHDB for filehandle 1000
01/12 14:36:25 [12]migmkspace[113]: ERROR No entries
in FHDB for filehandle 107C
01/12 14:40:13 [22]migcopy[413]: ERROR choose_src_gran
no gran for as_filep=x0
01/12 14:40:13 [22]migcopy[413]: ERROR read_data: no
good source granules found
01/12 14:40:13 [22]migcopy[143]: ERROR copy_file()
/copy_gran fail
01/12 14:40:13 [22]migcopy[143]: ERROR ** FAILED TO
COPY: X107C
01/12 14:40:13 [22]migcopy[143]: ERROR ** copy_for_
method() ret=1
01/12 14:41:43 [25]migcopy[149]: ERROR choose_src_gran
no gran for as_filep=x0
01/12 14:41:43 [25]migcopy[149]: ERROR read_data: no
good source granules found
01/12 14:41:43 [25]migcopy[149]: ERROR copy_file()
/copy_gran fail
01/12 14:41:43 [25]migcopy[149]: ERROR ** FAILED
TO COPY: X107C
01/12 14:41:43 [25]migcopy[149]: ERROR ** copy_for_
method() ret=1
01/12 14:42:42 [12]migmkspace[166]: ERROR No entries
in FHDB for filehandle 1000
01/12 14:46:17 [12]migmkspace[202]: ERROR No entries
in FHDB for filehandle 1000
01/12 15:08:21 [14]mignospace[239]: ERROR: No threshold
specified.
01/12 15:09:03 [12]migmkspace[249]: ERROR No entries
in FHDB for filehandle 1000
FILES
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
/tmp/hsm.log
Global log file for the VSM server
SEE ALSO
migconfg(1M), mignewlog(1M), migrc(1M), startmigd(1M)
migcleanup(1M)
NAME
migcleanup - displays or cleans up DMAPI sessions
SYNOPSIS
/usr/openv/hsm/bin/migcleanup [[-e] | [-l] | [-k] | [-g]| [-r
token]] [-R reply] [-s sid]
Caution migcleanup is intended only for customer support engineers who are trained
in its use.
DESCRIPTION
The migcleanup command cleans up orphaned DMAPI sessions. migcleanup prints all
generated token and session lists to standard output. The lists exclude the current session.
OPTIONS
-e List all outstanding event tokens for all sessions only if sid is not
specified. Otherwise, list all outstanding event tokens for the sid. Tokens
are listed in decimal. If there are no tokens, the output list is identical to
the one generated with the -l option.
-l List all sessions only if sid is not specified. Otherwise, list sid.
-k Ends all sessions initiated by VSM for which the creating process no
longer exists only if sid is not specified. Otherwise, end sid
unconditionally. Responds to all oustanding tokens.
Note The -k option will only kill the session belonging to migd if you specify migd’s sid.
-g Get all undelivered events for all sessions only if sid is not specified.
Otherwise, get all undelivered events for sid.
Note The -g option does not respond to events. You must run migcleanup a second
time with -k or -r to respond to events
CAVEATS
A session can not be canceled if there are undeliverable events or if it has outstanding
tokens with exclusive rights. Use the -g option to get all undeliverable events. Use the -r
option to respond to tokens with exclusive rights.
EXAMPLE
The following example lists all outstanding event tokens for all sessions:
# migcleanup
Session (37100) name: OVT.25719.tar-create
Session (37098) name: OVT.25714.tar-create
Session (37097) name: OVT.25713.tar-create
Session (37096) name: OVT.25712.tar-create
Session (36959) name: OVT.20137.migd
The following example kills session 37100 unconditionally:
# migcleanup -k -s 37100
Responding to events for sid 37100, tokens:
227
Destroying session 37100: OVT.25719.tar-create
To list the remaining sessions, execute migcleanup again:
# migcleanup
Session (37098) name: OVT.25714.tar-create
Session (37097) name: OVT.25713.tar-create
Session (37096) name: OVT.25712.tar-create
Session (36959) name: OVT.20137.migd
The following example kills all sessions initiated by VSM for which the creating process
no longer exists:
# migcleanup -k
Destroying session 37098: OVT.25714.tar-create
Destroying session 37097: OVT.25713.tar-create
Destroying session 37096: OVT.25712.tar-create
The following example replies continue to token 6 for session 36959:
# migcleanup -r 6 -s 36959 -R c
SEE ALSO
migalter(1M)
migconf(1M)
NAME
migconf - VSM managed file system configuration file
SYNOPSIS
dwpath/database/migconf
DESCRIPTION
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
Migration parameters for each VSM-managed file system reside in a
dwpath/database/migconf file. Use the VSM-Java GUI to make changes to this file
based on your site’s needs.
The managed file system configuration file is divided into six general parameter blocks:
◆ DEFAULTS
Describes general parameters for controlling the operation of VSM. For example, in
this section you define whether to make one or two copies of each migrated file.
◆ METHOD1 and METHOD2
Indicates the storage method (including types of media, volume sets, hints, and
volume pools) to use for migrating the Primary (first) and Alternate (second) file
copies. For example, a site may choose to write the first copy to optical disk and the
second copy to magnetic tape.
These parameters refer to the Primary Level and Alternate Level in VSM-Java.
◆ METHOD3 through METHOD8
Indicates the storage method (including types of media, volume sets, volume
availability, and volume pools) to use for migrating the Primary (first) and Alternate
(second) file copies. For example, a site may choose to write the first copy to optical
disk and the second copy to magnetic tape.
These parameters are set via Level Properties in VSM-Java.
◆ METHOD
This information is provided as a reference. You are encouraged to use the LEVEL
parameter to describe characteristics for migration levels.
◆ LEVEL
Describes characteristics of migration levels, including types of media, volume sets,
volume availability, and volume pools. Generally, you do not need to change the
defaults in this section. Some parameters, however, may be configured, including the
criteria associated with each method for moving migrated files to another migration
level.
These parameters are set via Level Properties in VSM-Java.
Note Move criteria for migration levels, if specified, take precedence over move criteria
for method names, if specified.
◆ FILESYS
Defines a managed file system directory and its associated migration parameters such
as the percentage of free space that should be remaining when VSM starts migrating
files. Sites must change this section to specify the file systems and policies VSM is to
use for selecting files for migration. There is a separate FILESYS entry for each
managed file system that uses the migconf file.
Comments within a parameter block are currently not allowed. Parameters are separated
by newline characters or commas.
On startup, the migration daemon reads the configuration files. If you manually change
the configuration file while the daemon is up, you can stop and restart the daemon so that
it picks up the changes or you can signal the daemon as follows:
# kill -INT ‘cat /usr/var/openv/hsm/workdir/migd.pid*‘
If you use the VSM-Java interface to make the changes, it signals the daemon for you.
Some parameter values for size or time in migconf can be specified as a base number
followed by an optional multiplier. Possible multipliers are as follows:
B 1 Block (512 bytes)
K 1 kilobyte (1,024 bytes)
M 1 megabyte (1,048,576 bytes)
G 1 gigabyte (1,073,741,824 bytes)
d 1 day (86400 seconds)
h 1 hour (3600 seconds)
m 1 minute (60 seconds)
s 1 second (1 second)
DEFAULTS SECTION
The parameters you can specify in the DEFAULTS section are as follows:
mach_id Integer (nonzero) identifier for each VSM-managed file system. All file
systems exporting or importing files between them must be distinct; each
must have a unique mach_id. Valid values range from 1 to FFFFFF.
quota Maximum number of bytes a user may exclude from migration. The
default is 10,000,000 bytes.
copies Number of migration copies of the disk file to be made. The maximum
value is 2. The default is 2. You can change this value to 1.
unmount_delay
Time in seconds a volume that is mounted in read mode remains
mounted if no read request is received during that time. The default is
180.
checksum
If you set checksum to 1, VSM calculates a check sum for each granule
that is written. If checksum is set to 0, VSM does not calculate a check
sum. The default is 1. During a read, VSM checks the check sum only if
the granule was written with a check sum.
The following is an example DEFAULTS entry:
DEFAULTS quota=400000, copies=1, unmount_delay=300,
checksum=1
The configuration has been set to make one copy of migrated files (copies=1).
mt Tape
op Optical disk as tape with random seek - rewritable
ow Optical disk as tape with random seek - write once, read many
ft Remote method using ftp
nb NetBackup
Default attributes for tape method names are platform-dependent. Tape method names
may be used interchangeably and optical disk method names may be used
interchangeably if the default method attributes in migconf are modified to match the
site configuration.
If you use VSM-Java, it assigns the volume_set_number for you. The volume_set_number
specifies the number for the set of media IDs from which to choose the volume. VSM uses
different method names or volume set numbers for Primary and Alternate Levels.
The hint parameter is the volume set availability, which is part of how VSM calculates how
log it will take to cache a file (that is, recall it from secondary storage). It may be any of the
following three values:
library Access is immediate.
operator Access requires operator action. 15 minutes is added to access time.
vault Access is off-site and requires 24 hours.
The volume_pool parameter designates volume pools other than HSM (the default). The
same volume set cannot exist in more than one volume pool.
If the DEFAULTS parameter is copies=1, the migconf file has an entry such as the
following:
METHOD1="ct.1.library"
METHOD2="" .
If the DEFAULTS copies parameter is copies=2, you will see an entry such as the
following:
METHOD1="ct.1.library"
METHOD2="ct.2.vault"
Multiple volume sets may be specified in the same METHOD1 or METHOD2 parameter to
allow VSM to use more than one drive at the same time. This speeds up the migration
process although only one copy of the file is being made.
METHOD SECTION
Each block of parameters in the METHOD section specifies the characteristics of all
supported device method names. Generally, sites do not need to change the defaults in
this section, but may want to modify the criteria associated with each method name for
moving files from one migration level to another migration level.
The following METHOD parameters are available:
name The name of the device method. Valid values are ct, dt, mt, op, ow, ad,
ft, and dk. Method name dk, used for premigration, is mandatory but
not configurable.
flags Flags set for this method.
MFLAG_OBSOLETE
Media supports obsoleting granules (see migmdclean(1M)). This option
applies only to the ad, ft, nb, and dk methods.
Note If the storage method is ct, dt, or mt, the MFLAG_OBSOLETE flag is also used to
indicate that the method is using write-once-read-many (WORM) tapes.
MFLAG_APPEND
Applies only to the ct, dt, mt, op, and ow methods. This flag allows VSM
to place multiple migrations on the same volume by appending them to
that volume until it is full to its configured limit. When writing to tape or
optical media and MFLAG_APPEND is present, VSM continues to append
to a volume until it is full and then writes on the next empty volume. This
allows smaller migrations without wasting space. When MFLAG_APPEND
is not present, each migration always starts on an empty volume.
When MFLAG_APPEND is present, VSM performs the following two steps
to select a volume for a new migration:
Note The nb method will not be supported after the VSM 4.5 release.
speed Relative rate at which the device can transfer data in bytes per second. As
mentioned in the description for the access parameter, VSM uses speed
when determining which copy of a file to cache.
gran_size
VSM divides files into granules. Each granule must fit on one volume.
The gran_size parameter specifies the number of bytes in each granule
that VSM writes to the device. The allowable granule sizes are 128KB,
256KB, 512KB, 1MB, 2MB, 4MB, 8MB, 16MB, 32MB, and 64MB. Granule
size is a power of 2 and an integral multiple of block size.
block_size
Block size in bytes to use when writing to the device. The allowable block
sizes are 512, 1KB, 2KB, 4KB, 8KB, 16KB, 32KB, 64KB, 128KB, and 256B.
The value must be a power of 2. Do not change this parameter after the
initial configuration. It is not necessary to configure block size for method
names op or ow because VSM determines the actual physical block size of
optical volumes each time they are mounted or opened.
density Density of the tape or optical disk medium.
dead_man_timeout
The maximum period of time in seconds that VSM should wait for an ftp
or NetBackup request to complete or for a tape or optical mount to
complete. The default is 3600 (one hour).
port_number
ftp port number and used only for the ft method.
demand_delay
The time a mount request waits before VSM unmounts a similar unused
volume. If VSM identifies a similar mounted but unused volume whose
unmount delay has not yet expired, it unmounts that volume as soon as
the demand delay occurs. Otherwise, the mount request remains active
until a drive becomes available. This is used only for the ct, dt, mt, op,
and ow method names. Default values are 1 minute for method name ct,
3 minutes for method names dt and mt, and 20 seconds for method
names op and ow.
Note Move criteria for migration levels, if specified, take precedence over move criteria
for method names, if specified.
move_badness
The criterion that VSM uses to move files from one migration level to
another after skipping those that are less than the minimum move age or
size. VSM computes the move badness for each migrated file, and then
selects those with a move threshold factor that equals or exceeds the
configured value. The VSM move threshold formula is as follows:
move_badness=(move_age_weight x (move_age)) + or x [as specified
by move_weight_operator] (move_size_weight x (move_size))
The default value is 30.
move_age Age of file (in days). VSM does not move files that have been migrated,
moved, or accessed within this time. The default is 7. (Express value as a
base number without a multiplier.)
move_sizeSize of file (in kilobytes). VSM does not move files smaller than this. The
default is 0. (Express value as a base number without a multiplier.)
move_age_weight
Weighting to be used for age in the move threshold formula. The
default is 1.
move_size_weight
Weighting to be used for size in the move threshold formula. The
default is 1.
move_weight_operator
The operator to be used (add or multiply) in calculating the threshold
factor. The default is multiply.
Configuring move_weight_operator = Site specifies a site selected
threshold algorithm.
move_flags
Mark FHDB entries for file copies at the source migration level either
dead, acitve, or obsolete. The default is to mark then dead for method
names ct, dt, mt, op, and ow, and to mark them obsolete for method
name ad.
Be sure to delete or comment out method names not used at your site because extra
unused methods cause additional processing. dk is always needed.
Method names ct, dt, and mt may be used interchangeably if the default method
attributes in migconf are modified to match the site configuration. Method names op
and ow may be used interchangeably if the default method attributes in migconf are
modified to match the site configuration.
/usr/var/openv/hsm/example/database/migconf, the example migconf file,
supports the following METHODs:
◆ Disk File (dk)
This method is required for premigration. The access time for the staging area is always 0
to ensure that it is preferred over all other methods.
METHOD
name=dk,
access=0,
capacity=50M,
speed=1M,
gran_size=1M,
block_size=64K
◆ Tape (ct)
METHOD
name=ct,
flags=MFLAG_APPEND | MFLAG_EOT
block_size=32K,
access=15s,
gran_size=2M,
capacity=20G,
speed=10M,
density=hcart,
dead_man_timeout=3600,
demand_delay=3m
◆ Tape (dt)
METHOD
name=dt,
flags=MFLAG_APPEND | MFLAG_EOT
block_size=32K,
access=2m,
gran_size=2M,
capacity=35G,
speed=5M,
density=dlt,
dead_man_timeout=3600,
demand_delay=3m
◆ Tape (mt)
METHOD
name=mt,
flags=MFLAG_APPEND | MFLAG_EOT,
block_size=32K,
access=30s,
gran_size=2M,
capacity=50G,
speed=6M,
density=8mm,
dead_man_timeout=3600,
demand_delay=3m
◆ Alternate Magnetic Disk (ad)
METHOD
name=ad,
flags=MFLAG_OBSOLETE,
block_size=1K,
access=10s,
gran_size=2M,
capacity=320M,
speed=800K
Note The nb method will not be supported after the VSM 4.5 release.
LEVEL SECTION
Each block of parameters in the LEVEL section specifies the criteria associated with each
migration level for moving files from one migration level to another migration level.
Note Move criteria for migration levels, if specified, take precedence over move criteria
for method names, if specified.
move_badness
The criterion that VSM uses to move files from one migration level to
another after skipping those that are less than the minimum move age or
size. VSM computes the move threshold for each migrated file, and then
selects those with a move threshold factor that equals or exceeds the
configured value. The VSM move threshold formula is as follows:
move_badness=(move_age_weight x (move_age)) + or x [as specified
by move_weight_operator] (move_size_weight x (move_size))
The default value is 30.
move_age
Age of file (in days). VSM does not move files that have been migrated,
moved, or accessed within this time. The default is 7. (Express value as a
base number without a multiplier.)
move_size
Size of file (in kilobytes). VSM does not move files smaller than this. The
default is 0. (Express value as a base number without a multiplier.)
move_age_weight
Weighting to be used for age in the move threshold formula. The
default is 1.
move_size_weight
Weighting to be used for size in the move threshold formula. The
default is 1.
move_weight_operator
The operator to be used (add or multiply) in calculating the threshold
factor. The default is multiply.
Configuring move_weight_operator = Site specifies a site selected
threshold algorithm.
move_flags
Mark FHDB entries for file copies at the source migration level either
dead, active, or obsolete. The default is to mark them dead for method
names ct, dt, mt, op, and ow, and to mark them obsolete for method
name ad.
FILESYS SECTION
The FILESYS section specifies a managed file system directory and its associated
migration parameters. VSM uses these parameters to manage space in the managed file
system. There is a separate FILESYS entry for each managed file system that uses the
migconf file. FILESYS parameters are as follows:
name The path to the directory in the file system that VSM manages. It must be
the real name and not a link name, and must not contain a trailing slash.
The default is /hsm1.
If you configure more than one name, each managed file system must be
unique and its name must be uniqye.
freespace
Specifies the percentage of space to be kept free on the file system. If file
system free space falls below this amount, migration should be restarted.
The default is 10.
lowwater
The percentage of free space that stops the selection of files to be
migrated. If specified, lowwater must be greater than or equal to the
value specified for freespace. The default is 0 (the parameter is
ignored).
Files listed in a user’s .migrate file are selected after lowwater is
reached, so the percentage of free space may be larger than expected.
Space in premigration is not considered free. migbatch makes only one
pass through the file system with the current threshold as it tries to
achieve lowwater. Each time mignospace executes and finds no files in
premigration to purge, the current threshold is cut in half, causing more
files to be selected. migrc and migbatch reset the current threshold to
the value you initially configured in the migconf file.
purgemark
The percentage of free space that stops the purging of premigrated files. If
specified, purgemark must be greater than or equal to the value
specified for freespace and less than lowwater unless lowwater=0.
The default is 0 (the parameter is ignored).
badness The criterion that VSM uses to select files for migration after skipping
those that are less than the minimum age or size. Files with a threshold
factor that equals or exceeds this value are selected for migration.
FILESYS
name=/lamda,
freespace=10, badness=2000,
min_age=1, min_size=1,
age_weight=1, size_weight=1,
weight_operator=multiply,
slice=8192, purgemark=0
In the above example, VSM manages the file system /lamda. With the above parameter
values, VSM does not migrate files on the same day they were created (because
min_age=1), nor files under a kilobyte (because min_size=1). If VSM encounters a
100-KB file that has not been accessed or modified for 30 days, it computes the threshold
to be 3000 (30 days x 100 KB). Because the threshold value is set to 2000 in this example,
this file would be a migration candidate.
SEE ALSO
VSM(1M), migconfg(1M), miglow(1M), migmdclean(1M), migreg(1M),
migtestbadness(1M), startmigd(1M)
migconfg(1M)
NAME
migconfg - global configuration file for the VSM server
SYNOPSIS
/usr/var/openv/hsm/database/migconfg
DESCRIPTION
The VSM global configuration file, migconfg, has one or more entries, each starting with
the string HSMDEV followed by one or more parameters. Not all parameters are required.
The parameters specified in this file let you partition VSM into easily manageable
partitions by name (hsmname) and define location of files for each hsmname. Use
VSM-Java to make changes to migconfg.
The following parameters are available:
hsmname The logical name for the managed file system. hsmname must be a
unique alphanumeric value, such as projectx or zeta. Although
numeric values such as 1234 are accepted, their use is not recommended
as the hsmname is embedded in path names and some utilities may not
work correctly. The maximum length is 32 characters.
fspath The path name of the managed file system for this hsmname. It is used
for computing the device number of the file system. fspath is the mount
point for the file system. It cannot be the full path to the FILESYS name if
the FILESYS name is a subdirectory in fspath. This parameter is required.
Caution Always create the database directory in a local file system that VSM does not
manage. This eliminates the possibility of migrating files from the database or
workdir directories.
dwpath The path name of the directory containing the database and workdir
directories for the hsmname you specify. The default is
/usr/openv/hsm/database/hsmname.
lgpath The path name of the log file for the hsmname you specify. The default is
/usr/openv/hsm/logs/hsmname.log. The hsmname hsmname is the
value you supply for hsmname.
state Specifies whether VSM processes hsmname when it automatically
migrates or caches files from the file system indicated by fspath. The
state parameter can have a value of either 1 or 0, where 1 is on and 0 is
off. Default is 1 (on). If you set state to 0 (off), users cannot access
migrated files and an error is returned to the user’s application program.
The following lists VSM files in the dwpath/database directory (for a configured VSM):
FHDB: The file handle database contains at least one entry for each copy of a
migrated file. When VSM must split storage of a file over more than one volume, it
creates an FHDB entry for each volume the file is stored on.
FHSEQF: The file-handle-sequence file contains the eight-digit hexadecimal value
that VSM assigns to the next file handle.
FHDB.LK: The file-handle-database lock file used by the VSM database merge
process to provide a master lock on the file handle database.
FNDB: The file name database contains one for each copy of a migrated file.
VOLDB: The volume database contains an entry for each volume registered with
VSM.
VOLSEQF: The volume-sequence file contains the eight-digit hexadecimal value that
VSM assigns to the next volume ID (handle).
VOLDB.LK: The volume-database lock file. The VSM database merge process uses
this file to provide a master lock on the volume database.
NEXTVOL1: Next volume set to use for the primary copy of a migrated file.
NEXTVOL2: Next volume set to use for the alternate copy of a migrated file (if
applicable).
NEXTVOL3 ... NEXTVOL8: Next volume set to use for moving a migrated file to
migration level 3-8 (if applicable).
migsweep.site: Site-specific migration and purge criteria control.
migsweepm.site: Site-specific move criteria control for files (if applicable).
migconf: The configuration file that specifies migration criteria for file systems
using this database. You set up this file during the configuration process.
hsmname.IHAND: Inode and handle information about migrated files
hsmname.FLUSH: Controls how often VSM writes tape marks when making copies
during file migration.
hsmname.merge_badness_count: If present, an ASCII file containing the
minimum number of DVDB entries that must be waiting to be merged before VSM
will trigger a merge operation.
hsmname.merge_time_delay: If present, an ASCII file containing the minimum
number of seconds between merge operations.
hsmname.gran_retry: If present, VSM will try to read the same granule twice if it
encountered a read error.
The files in the VSM directory workdir are as follows for a configured VSM:
mig.lck: Used by migbatch and mignospace to lock the managed file system
while sweeping and premigrating files.
hsmname.copydb.method_name.volume_set_number.hint: Work list files used to
copy premigrated files to storage and move migrated files to destination levels.
hsmname.idling: Exists if hsmname is idling down
hsmname.last_merge: If present, its last modification time is when the last FHDB
merge operation completed.
hsmname.migsweep: List of files selected to be premigrated
hsmname.nospace: Exists if mignospace is running with the -N option.
hsmname.p_badness: Current purge threshold value
hsmname.s_badness: Current threshold value.
hsmname.state: Current VSM state if the state is Idle, Iding, or Maintenance
hsmname.sweep.restart: Path of the last file selected by migsweep before
reaching the low-water mark.
hsmname.VxFS_34_vsmstate: If non-zero, VSM detected VxFS version 3.4. The
contents (ASCII 0 or 1) indicate the value assumed for hsm_write_proalloc.
The following files are present if the command process is running:
hsmname.migbatch.running: Processs ID (pid) of migbatch.
hsmname.migcons.running: Process ID of migcons.
hsmname.migconsweep.running: Process ID of migconsweep .
hsmname.migdbcheck.running: Process ID of migdbcheck.
hsmname.miglow.running: Process ID of miglow.
hsmname.migmdclean.running: Process ID of migmdclean.
hsmname.migmove.running: Process ID of migmove.
hsmname.mignbexport.running:Process ID of mignbexport.
hsmname.mignbimport.running: Process ID of mignbimport
hsmname.mignospace.running: Process ID of mignospace.
hsmname.migrc.running: Process ID of migrc.
hsmname.migreconstruct.running: Process ID of migreconstruct.
hsmname.migrecycle.running: Process ID of migrecycle.
hsmname.migsetdb.running: Process ID of migsetdb.
To find the actual file names used in your system, use gethsm and migdbdir.
VSM uses a global log file to log messages from the migration daemon and volume
daemon, and a log file for each hsmname to log messages from migration processes
running on behalf of hsmname. The path name of the global log file is /tmp/hsm.log.
You can initiate logging for the VSM-Java request daemon by creating a file with the path
name /usr/openv/hsm/logs/migrd.log. If this path exists before you start migrd,
VSM will log information to it.
You can obtain the values of migconfg parameters by using the migdbdir command.
For example, the following prints the value of the lgpath parameter for the managed file
system alpha:
# migdbdir alpha 3
On startup, the migration daemons read the configuration files. If you change the global
configuration file while the daemons are running, you can stop and restart the daemon so
that it picks up the changes, or you can signal the daemon as follows:
# kill -HUP ‘cat /usr/var/openv/hsm/workdir/migrd.pid*‘
If you use the VSM-Java interface to make the changes, it signals the daemon for you.
EXAMPLE
The following are example /usr/openv/hsm/database/migconfg entries.
HSMDEV
hsmname=hsm1,
fspath=/sd7,
dwpath=/usr/openv/hsm/database/hsm1/database,
lgpath=/usr/openv/hsm/hsm1.log,
state=1
HSMDEV
hsmname=hsm2,
fspath=/hsm2,
dwpath=/usr/openv/hsm/database/hsm2/database,
lgpath=/usr/openv/hsm/hsm2.log,
state=1
SEE ALSO
VSM(1M), migconf(1M), migdbdir(1M), migVSMshutdown(1M), migVSMstate(1M),
migVSMstartup(1M), migactivate(1M)
migcons(1M)
NAME
migcons - consolidate VSM tape and optical disk volumes
SYNOPSIS
/usr/openv/hsm/bin/migcons [-F] [-N] hsmname one | two
out_method out_volume_set label.method.volset
[label.method.volset]...
DESCRIPTION
The migcons command consolidates one or more input volumes onto a set of output
volumes. Input volumes can belong to different storage methods. Output volumes must
belong to a single method.
Periodic volume consolidation is necessary because VSM does not release unusable
volume space automatically. As files are migrated, cached, and modified, the amount of
unusable space on a volume grows. Run miggetvol or migdbrpt to determine which
VSM volumes have low space utilization or otherwise are candidates for consolidation.
Unusable space is occupied by file data that has been marked obsolete or dead. Obsolete
data represents an earlier version of a modified file. It is possible to retrieve obsolete data
up until the time these entries are marked dead. To mark obsolete entries dead, run
migmdclean before consolidating volumes.
The migcons command does the following:
◆ Copies active and obsolete data from the input volume(s) onto the output volume(s).
Because migmdclean removes expired and obsolete data, running it before you run
migcons will prevent your copying obsolete data. The migcons command does not
copy data marked dead in the FHDB.
◆ Removes all references to the file granules on input volumes from the FHDB.
◆ Removes the volume entry for the input volume from the volume database (VOLDB).
◆ Deassigns the volume and returns it to the HSM pool for use by any managed file
system.
Note When one side of an optical disk is consolidated, the volume entry for that input
volume is marked dead and not removed from the VOLDB unless the other side of
that optical disk is also marked dead.
After consolidation, all data other than dead entries is available on the output volumes.
The input volumes must be reregistered before VSM will use them again (see the
migreg(1M) man page). For optical volumes, if the volume still exists in the VOLDB as a
dead entry, then migrecycle(1M) must be run before VSM can use the volume again.
Although it is possible to consolidate ow volumes (write once, read many), it is not
possible to recycle them.
migcons can use two drives simultaneously for reading and writing volumes. If
sufficient drives are not available, migcons supports a two-step consolidation process,
which is described in the options section.
You can use migselect to generate a list of volumes that need to be consolidated.
OPTIONS
-F Perform consolidation without feasibility check to assess the capacity of
the output volumes. See CAVEATS.
-N Selects a new (empty) volume for output, disregarding the
MFLAG_APPEND flag for the method. If you do not specify -N, migcons
selects the output volume based on the MFLAG_APPEND flag:
- If MFLAG_APPEND is set, migcons selects and appends the data to the
volume currently being written.
- If MFLAG_APPEND is not set, migcons selects a new volume.
hsmname Configured VSM name of the file sytem containing the database files for
the volumes you want to consolidate.
one | two Specifies whether the consolidation occurs in one or two steps. This
parameter is required.
• One-step consolidation copies files directly from the input media to
volumes under the output method.
• Two-step consolidation copies from the input media to alternate
magnetic disk media (method ad) and then to volumes under the
specified output method.
VSM-Java does not support two-step consolidation; you must use
migcons if you need two-step consolidation.
One-step consolidation is always faster. However, sites that consolidate
input volumes using the same method as the output method but have
only one device for the output method must use a two-step process. For
example, a site that uses cartridge tape but has only one cartridge-tape
drive available must use a two-step process.
Prior to performing two-step consolidation, the site must register a
volume in alternate magnetic disk (ad) volume set 0 (see migreg(1M)).
out_method
Output method name for consolidation. This parameter is required. Valid
values are ad, ct, dt, mt, op, or ow. See CAVEATS for details on the ad
method.
out_volume_set
Output volume set to use for consolidation. Volumes selected for writing
belong to this volume set. You can use this parameter to ensure that
multiple copies of the same file are consolidated on different volumes.
This parameter is required.
label.method.volset
Label, method, and volume set of the input volume (for example,
CWra01.mt.1). You must supply at least one volume. The volumen
cannot have the w flag set.
Do not specify output volumes here; VSM automatically selects output
volumes. Valid method values are ct, dt, mt, op, or ow.
CAVEATS
◆ You cannot consolidate volumes that use the ft or nb method.
◆ The migcons command performs a feasibility check before attempting to consolidate
media, and it does not consider volumes in the scratch pool during this check. No
additional media is registered. Then, migcons consolidates media only if the empty
volumes for the output method have sufficient space for data from the input volumes.
◆ If consolidation is forced with the -F option and output volume capacity is
inadequate, available tape or optical disk media in the same volume pool as the first
input volume being consolidated are registered automatically as needed to provide
adequate output volume capacity for writing the data from the input volumes. If
output volume capacity is still inadequate, the command will fail when output
volumes become full. These output volumes are marked full in the VOLDB, but no
FHDB changes occur for input volumes being consolidated.
◆ Locked VOLDB entries for the input volumes fail the feasibility check and prohibit
consolidation. Run the migrc command prior to consolidation to clear the locks.
◆ Do not run migcons and migmove simultaneously if they both are taking source
from the same volumes. The results of such an action are undefined.
◆ If the output volume uses the ad method, an empty ad volume is required.
EXAMPLE 1
The following example uses a one-step process to consolidate REEL01 and REEL02
cartridge tape volumes (method ct) to new cartridge tapes selected by VSM.
# migcons alpha one ct 1 REEL01.ct.1 REEL02.ct.1
EXAMPLE 2
If a site has just one tape device under method ct, the following example would
consolidate volumes REEL01 and REEL02 under method ct to volume(s) under
out_method ct. This occurs in two steps, with ad volumes used as staging volumes.
# migcons alpha two ct 1 REEL01.ct.1 REEL02.ct.1
EXAMPLE 3
The following example selects input volumes from ct volume set 2 based on volume
occupancy limits ranging from 0.00 through 5.50 percent full. The consolidation is a
one-step process to output method ct.
# migcons alpha one ct 2 ‘migselect alpha 0.00-5.50 2 ct‘
EXAMPLE 4
The following example consolidates volumes under multiple input methods ct and dt to
volumes under output method ct.
# migcons alpha one ct 1 ‘migselect alpha 0.00-5.50 1 ct dt‘
FILES
The dwpath is the directory in that contains the database and workdir directories.
dwpath/database/VOLDB
Volume database.
dwpath/database/FHDB
File handle database.
dwpath/database/FNDB
File name database for VSM
dwpath/database/CONS_INVOL
Consolidation input volume list file generated during consolidation.
dwpath/database/CONS_OUTVOL
Consolidation output volume list file generated during consolidation.
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
SEE ALSO
migconfg(1M), migdbrpt(1M), miggetvol(1M), migmdclean(1M), migreg(1M),
migrc(1M), migselect(1M), migrecycle(1M)
migconsweep(1M)
NAME
migconsweep - enable constant file system sweeping
SYNOPSIS
/usr/openv/hsm/bin/migconsweep [-s sleep_time] hsmname
DESCRIPTION
The migconsweep command enables constant sweeping of the managed file system
instead of the normal sweeping process performed by VSM. Sweeps occur periodically,
following interruptions determined by the sleep_time variable. This makes it less likely
that the file list of migration candidates will be empty when needed.
Constant sweeping attempts to keep the list of migration candidates from becoming
empty by periodically checking the list and resuming sweeping if necessary.
If mignospace is running when the file system is swept by migconsweep, the
accelerated file space availability feature of mignospace is implemented whereby the
sweeping process is interrupted as soon as any one of three configurable file system
attributes is satisfied: time increment, file increment, or space increment. See man page
mignospace(1M) for more information.
Once initiated, constant sweeping continues to run until the process is terminated with
the kill command.
This command may be run without regard to whether the migd migration daemon is
running, but the VSM state must be Active.
OPTIONS
-s sleep_time
Pause for this interval between sweeping operations, where sleep_time is
the time in seconds that this command pauses before resuming a sweep
of the file system. Default is 60.
hsmname Configured VSM name for the file system (in VSM-Java, the heirarchy)
containing the database files for the volumes you want to consolidate.
CAVEATS
◆ Constant sweeping uses system resources that may adversely affect overall VSM
performance, particularly during periods of heavy system usage.
EXAMPLE
The following command initiates constant sweeping with a sleep time of 10 minutes (600
seconds) between sweeps for hsmname alpha.
# -s 600 alpha &
To stop constant sweeping, terminate the process with the following command.
# kill pid
FILES
dwpath/workdir/hsmname.migconsweep.running
The process identifier (pid) for migconsweep.
dwpath/workdir/hsmname.migsweep
The list of files selected to be premigrated.
SEE ALSO
migbatch(1M), mignospace(1M)
migdbcheck(1M)
NAME
migdbcheck - check VSM databases for consistency
SYNOPSIS
/usr/openv/hsm/bin/migdbcheck [-F | -P] [-V] [-v -r -s -h -p]
[-c number_of_copies] hsmname
DESCRIPTION
The migdbcheck command checks the file handle database (FHDB), file name database
(FNDB), and volume database (VOLDB) for consistency with the file system. You can
check FNDB and FHDB together, the VOLDB by itself, or all three together.
Note The migdbcheck command defaults to check only the FHDB and FNDB. Checking
the FHDB, FNDB, and VOLDB with a single command is faster than checking the
databases independently with two commands.
◆ FHDB or FNDB entries which have been flagged obsolete are present for files that still
exist. Each migration level is checked.
◆ FHDB or FNDB entries which have been flagged dead are present for files that still
exist. Each migration level is checked.
◆ The FHDB or FNDB is not in sorted order.
◆ Duplicate FHDB or FNDB handles exist in the file system.
◆ The FHDB or FNDB sequence number in the FHSEQF file is incorrect.
◆ FHDB or FNDB entries exist that are flagged as locked.
◆ FHDB or FNDB entries exist that are flagged as failed.
◆ There are active dk entries in the FHDB or FNDB but the data is purged.
◆ There are files in the file system whose full pathnames exceed 1024 characters. These
files cannot be selected for migration, and may eventually fill the file system.
VOLDB CHECKING
The migdbcheck command checks the volume database (VOLDB) in two ways:
◆ It verifies that all files recorded in dwpath/database/FHDB and
dwpath/database/FNDB have an associated entry in dwpath/database/VOLDB.
◆ It verifies that all active VOLDB entries are associated with at least one FHDB and
FNDB entry.
The migdbcheck command automatically checks all file systems that use the VOLDB
specified by hsmname. The following error conditions are detected by migdbcheck:
◆ Active FHDB or FNDB entries exist that reference nonexistent VOLDB entries.
◆ Active VOLDB entries exist for which there are no corresponding FHDB references.
◆ VOLDB entries exist in write mode for which there are no corresponding FHDB
references.
OPTIONS
-F Check all entries in the FHDB and FNDB configured for hsmname. This is
the default condition if neither -P nor -V is specified.
-P Check consistency between dk entries and premigrated files. This
overrides -F.
-V Check all entries in the VOLDB configured for hsmname.
-v Verbose mode; output is directed to standard output as well as to the
output files.
CAVEATS
◆ If migdbcheck is run while the migd migration daemon is active and the VSM state
is Active, a warning message tells you that the results of this command may not be
correct because of simultaneous migration activity. Nevertheless, VSM gives you an
option to continue.
◆ If the -r option is specified, a warning message tells you that the results of this
command may not be correct because of simultaneous migration activity.
Nevertheless, VSM gives you an option to continue.
◆ If migbatch, miglow, or migmove run simultaneously with migdbcheck, the
results of migdbcheck may be in error.
◆ Be sure to analyze very carefully any error messages generated by migdbcheck
before taking corrective action. The examples that follow show only a few of the error
situations that could arise.
EXAMPLE 1
The following example checks the file system that uses the FHDB and FNDB specified by
hsmname alpha.
# migdbcheck -F alpha
It is possible to alter the flags field of the FHDB entry for these extra copies using the -i
argument of the migsetdb command, but the administrator must first evaluate the files
to decide which flags to alter for each level. The files
migdbcheck-level-X.hsmname.pid in /tmp are used to indicate the files that exist at
each migration level. The character X is replaced by the appropriate migration level, 1
through 8.
An error message alerts the administrator when files exist in the file system that can never
be migrated because their full pathnames are too long.
-- WARNING: Files with path lengths exceeding 1024 were
found in the file system.
The following information message indicates that VSM has cached some premigrated files
before making any copies:
-- INFO: 6 cached files with no active entries in the
FHDB were found.
Note If this message continually shows large numbers of files, VSM is selecting too many
frequently accessed files for migration. Tune the file threshold formula to be less
aggressive.
VSM lists all such files in verbose mode. Run migloc on each file so identified. There is
no problem if the output resembles the following:
# migloc /alpha/raa/7/6/4/4/1/1/2/f0
Status: Cached code raa /alpha/usr1/7/6/4/4/1/1/2/f0
No matching entries found in the FHDB handle: A14C2.
Problems getting migration data on file.
The next time the file gets migrated it will get a new handle and be placed in the copydb
worklists.
EXAMPLE 2
The following example checks the file system that uses the VOLDB specified by hsmname
delta.
# migdbcheck -V delta
Typical messages in response to this command are shown below:
-- INFO: checking hsmname=delta fspath=/delta
-- INFO: There are 15 entries in the VOLDB.
If you have just installed VSM and have not registered any volumes using migreg or if no
files have been migrated out, the following message appears:
-- WARNING: no volumes in VOLDB referenced by FHDB
If an entry is locked by the indicated process, the following message appears. This could
occur if you run migdbcheck when VSM is actively being used and the migration
daemon (migd) is running. See CAVEATS.
-- WARNING: VOLDB entry 00001000 is locked by 4660
VSM maintains the VOLDB in sorted order. If an entry is out of order, the following
message error appears:
-- ERROR: /usr/var/openv/delta/database/VOLDB is not
in the correct order! handle 1000 preceeded 999.
You must sort the file and rerun migdbcheck. ABORTING
Use the sort command to put the VOLDB in sorted order.
Another typical error message in response to this command is shown below:
-- ERROR: Files on missing volid 00001000
To list all such FHDB entries, run migdbcheck in verbose mode.
# migdbcheck -Vv delta
00001000|00D86BC0|00000000|0000101A|00000000|00019000|
00000000|00000000|dt|||||l|1 0 00000004|00000000|||
00000000|00000001|
A similar error message is produced by migdbrpt. The FHDB references a volume that is
not in the VOLDB. In the example, volume ID 1000 was not in the VOLDB. Following the
initial error is a display of the FHDB entries that reference the missing volume. Use this
list to determine the specific files that the error affects and take the following actions:
1. If the missing entry exists on a recently backed up VOLDB, you may add that entry to
the VOLDB.
3. If only a few files are affected, you can restore the user files from the site’s backup
tapes and delete the entries from dwpath/database/FHDB.
Other typical messages indicate that no file currently references this volume:
-- 00000998 in VOLDB, but no FHDB reference to it
-- Writing Entry 00000999 in VOLDB, but no FHDB
reference to it
This is normal if all of the files on the volumes have been cached or removed. Registered
but unwritten volumes do not appear in this list. The first message indicates the writing
flag is not set for the VOLDB entry; the second message indicates the writing flag is set for
the VOLDB entry.
To list all such VOLDB entries for these volumes, run migdbcheck in verbose mode.
# migdbcheck -Vv delta
0998|00d86BC0|00000000|00000000|A00001|dt||0|3BA73139|
0230000| 0122466F|00E700019|0007a9e8|0||||HSM||| |
These volumes are good candidates for consolidation and reuse (see migcons(1M)).
Before consolidating the second volume, run migdbcheck clear the write flag in its
VOLDB flags field.
# migsetdb -Va delta A00001
EXAMPLE 3
The following example use the -c option to determine if the correct number of copies are
being made.
The configuration of managed file system omikron set the number of copies to be 1.
In the example, the -F option requests that both the FNDB and FHDB are checked. The -c
option queries if 2 copies of any files are being made:
# migdbcheck -F -c 2 xi
Typical messages in response to the command follow:
-- INFO: checking hsmname=omikron fspath=/omikron
-- INFO: There are 4 entries in the FHDB.
-- INFO: 1 of the FHDB entries are place holders.
-- INFO: There are no valid active dk entries in the
FHDB.
-- INFO: There are 1 migrated files in the /omikron
file system
-- ERROR: 1 files have fewer than 2 copies made and
are not found in a copydb.
The messages tell you that there is one migrated file in omikron, that it has fewer than 2
copies made, and that is not in a worklist file waiting to be copied for a second time. The
configuration is working as configured, because only one copy should be made.
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/FHDB
A list of files that have an active dk entry in the FHDB but the files either do not exist
or are not migrated (data not on disk)
/tmp/migdbcheck-missing.hsmname.pid
A list of migrated files that do not have enough entries in the FHDB
/tmp/migdbcheck-dup-handles.hsmname.pid
A list of migrated files with duplicate FHDB handles
/tmp/migdbcheck-no-fhdb.hsmname.pid
A list of migrated files that do not have any entries in the FHDB
/tmp/migdbcheck-cached.hsmname.pid
A list of cached files that do not have any entries in the FHDB because they were
cached before any copies were made
/tmp/migdbcheck-copies-needed.hsmname.pid
A list of files that do not have the required number of migrated copies
/tmp/migdbcheck-error-flag.hsmname.pid
A list of files whose FHDB entry contains an error flag that is either locked or failed
/tmp/migdbcheck-level-X.hsmname.pid where 1<= X <= 8
A list of files that exist at migration level X, where X represents migration levels 1
through 8, and there are more valid copies found than defined in migconf
The following output files are created and used by migdbcheck to list VOLDB
inconsistencies discovered:
/tmp/migdbcheck-voldb-missing.hsmname.pid
A list of volumes in the FHDB that are not in the VOLDB. Verbose mode lists FHDB
entries residing on the missing volumes.
/tmp/migdbcheck-voldb-consolidate.hsmname.pid
A list of volumes in the VOLDB with no FHDB references. Verbose mode lists VOLDB
entries for these volumes.
/tmp/migdbcheck-voldb-writing.hsmname.pid
A list of volumes in the VOLDB that are in write mode with no FHDB references.
Verbose mode lists VOLDB entries for these volumes.
The migdbcheck command checks the environment variable TMPDIR, which allows the
administrator to use a path other than the default /tmp. This can save files through
system reboots or make use of a larger file system to avoid running out of space. The path
defined by TMPDIR, if set, is used instead of /tmp as the directory in which to place any
temporary files. The process id of the migdbcheck that is executing replaces pid.
Files which could indicate problems or which could be used to obsolete or activate FHDB
or VOLDB entries are left in /tmp (or the path defined by TMPDIR). No output files
should be left if migdbcheck executes successfully and finds no errors.
Note Some output files created by migdbcheck may be used as input files for
migsetdb.
SEE ALSO
migadscan(1M), migbatch(1M), migconfg(1M), migcons(1M), migdbrpt(1M),
migftscan(1M), miglow(1M), mignbscan(1M), mignospace(1M), migtscan(1M),
migopscan(1M), migrc(1M), migsetdb(1M), migVSMshutdown(1M),
migVSMstate(1M), migVSMstartup(1M)
migdbconvert(1M)
NAME
migdbconvert - convert FHDB into VSM 4.5 formatted FHDB and an FNDB
SYNOPSIS
/usr/openv/hsm/bin/migdbconvert [-b backupdir] hsmname
DESCRIPTION
The migdbconvert command converts VSM file databases from releases before 4.5 to
VSM release 4.5 format.
The file handle database (FHDB) is a text database file in the database directory for each
managed file system. In VSM release 4.5, a file name database (FNDB) also exists in the
database directory. You must have a properly formatted FHDB and a FNDB for VSM
release 4.5. Unless the conversion is run by the VSM installation script, the managed file
system being converted must be in Maintenance state.
The migdbconvert command first checks to see if the current FHDB for hsmname
appears to be in VSM 4.5 format. If it is, migdbconvert exits with exit status 0.
If you use the -b option to specify a backup directory, the original (pre-version 4.5) FHDB
is moved to backupdir/hsmname.FHDB.prev. This is done before the conversion begins.
If you do not use the -b option to specify a different directory, the original (pre-version
4.5) FHDB remains in the database directory while the new FHDB and FNDB files are
written. After the new files are created, the original FHDB is renamed FHDB.prev.
Not specifying the -b option requires more space in the VSM database directory. You
will need enough space to hold the both the old and new databases.
OPTIONS
-b backupdir
Specifies a directory to be used for the backup copy of the FHDB.
hsmname Specifies the managed file system (hierarchy) name.
EXAMPLE
The following example shows the syntax for converting the database for hsmname xi.
The backup copy of the FHDB is created in the directory /conversion/theta.
# /usr/openv/hsm/bin/migdbconvert -b /conversion/xi xi
SEE ALSO
VSM(1)
migdbdir(1M)
NAME
migdbdir - get VSM information from the global configuration file
SYNOPSIS
/usr/openv/hsm/bin/migdbdir hsmname id
DESCRIPTION
The migdbdir command prints the desired value or device for the specified hsmname on
standard output. The id specifies the desired information.
OPTIONS
hsmname Configured name of the managed file system about which to query.
id Integer identifying the desired information. Accepted values follow:
1 - Database path (dwpath)
2 - File system path (fspath) Requires that file system by mounted.
3 - Log file path (lgpath)
4 - VSM state flag (state; the value in migconfg)
5 - File system device number
6 - Mounted status
7 - Mount point
8 - migattr driver status. Returns yes or not based on the working
status of the migattr driver (Solaris only)
EXAMPLES
The following example prints the device number of the managed file system delta.
# migdbdir delta 5
33554455
The following example prints whether or not the theta file system is mounted correctly.
In this case, it is not mounted correctly.
# migdbdir theta 6
not mounted
SEE ALSO
migconfg(1M)
migdbrpt(1M)
NAME
migdbrpt - report on VSM migration database
SYNOPSIS
/usr/openv/hsm/bin/migdbrpt [-g] -f file_path hsmname
/usr/openv/hsm/bin/migdbrpt [-g] -h file_handle | -H hsmname
/usr/openv/hsm/bin/migdbrpt [-g] -l label | -a hsmname
/usr/openv/hsm/bin/migdbrpt [-g] -m method | -a hsmname
/usr/openv/hsm/bin/migdbrpt [-g] -s vol_set hsmname
/usr/openv/hsm/bin/migdbrpt [-g] -v vol_handle hsmname
DESCRIPTION
The migdbrpt command prints reports on database information maintained by VSM.
Preserving periodic migdbrpt reports helps trace volumes for important files and make
decisions on volume consolidation. The system administrator can issue migdbrpt at any
time.
You can base enquiries about files on the following:
◆ file_path (-f option)
◆ file_handle (-h option) that VSM assigns to the file during the migration phase
The -H option displays information about all migrated files. The displayed information
includes where the file is migrated, as well as the number of granules and the percentage
of volume capacity for the file.
You can base inquiries about volumes on the following:
◆ Volume label (-l option)
◆ Method name (-m option)
◆ Volume set (-s option)
◆ Volume handle (-v option) that VSM assigns when the volume is registered with
migreg
The -a option reports on all volumes. migdbrpt displays the percentage of the volume in
use and the number of both live and obsolete granules on the volume. This information is
useful in making decisions on consolidating volumes (see migcons(1M)). All numbers
are displayed in decimal.
The migdbrpt command also displays database entries that have duplicate file handles
or duplicate volume handles.
If a report indicates possible problems, use migdbcheck to verify the databases. Correct
any database inconsistency immediately to guard against future catastrophe.
OPTIONS
-g Prints granule-related information. You can use this parameter with any
of the other options.
-f file_path
Reports on the file with the specified file path. The file path must be
specified with the full path.
-h file_handle
Reports on the file with the specified file handle (specify the file handle in
hexadecimal).
-H Reports on all migrated files.
-l label Reports on the volume with the specified label. You can use this option
with the -m option to report on all volumes under a given method and
label pair.
-m method Reports on all volumes registered under the specified method.
-a Reports on all volumes registered.
-s vol_set
Reports on all volumes registered under the specified volume set. You
can use this option with the -m option to report on all volumes under a
given method and volume set pair.
-v vol_handle
Reports on the volume with the specified volume handle (specify the
volume handle in hexadecimal).
hsmname Configured VSM name for the managed file system containing the
database files from which you want to derive the report.
EXAMPLE 1
The following example prints information about the /home/pjt/f1 file. Information is
displayed about what volumes the file resides on, as well as its granule count and what
percentage of the volume is occupied by this file.
# migdbrpt -g -f /home/pjt/f1 alpha
EXAMPLE 2
The following example prints a report on all volumes registered under the configured
methods.
# migdbrpt -a alpha
The command results in a display similar to the following (this example has been
truncated on the right):
VOL_HAND LABEL POOL METHOD CAPACITY #LGNS...
00001000 <*>W OPT01A HSM op.1 375896384 572...
00001009 <=>C TST003 HSM dt.1 293601280 1140...
00000000 <=> DK0000 dk.0 17483290624 6083...
00001001 <=>E OPT01B HSM op.1 293601280 0...
EXAMPLE 3
The following example prints information about volume rao001 under method ct. The
display will include information about the migrated files, their granule count, and the
volume occupancy.
# migdbrpt -g -l rao001 -m ct alpha
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/migconf
Configuration file for managed file systems
dwpath/database/FHDB
File handle database for migrated files
dwpath/database/FNDB
File name database for VSM
dwpath/database/VOLDB
Volume database
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
SEE ALSO
migdbcheck(1M), migadscan(1M), migconf(1M), migconfg(1M), migcons(1M),
migreg(1M), migtscan(1M), migopscan(1M)
migfind(1M)
NAME
migfind - determine the full pathname of a file
SYNOPSIS
/usr/openv/hsm/bin/migfind -h file_handle -m machid hsmname
/usr/openv/hsm/bin/migfind -d DMAPI_handle hsmname
DESCRIPTION
The migfind command determines the full pathname of a file, given either its VSM file
handle and machine ID or its DMAPI handle.
Output is displayed to standard output. Error messages go to standard error.
This command may be run without regard to the VSM state or whether the migd
migration daemon is running, but the managed file system must be mounted.
OPTIONS
-h file_handle
The VSM file handle of the file. File handles are stored in the file handle
database (FHDB) for the file system.
-d DMAPI_handle
The DMAPI file handle of the file.
-m machid
The integer (nonzero) identifier for the VSM-managed file system from
which the file was migrated, as configured with the machid parameter in
the DEFAULTS section of the dwpath/migconf file.
hsmname Configured VSM name that specifies the file system in which the file
resides.
EXAMPLE
The following command determines the full path of a file in hsmname beta whose VSM
file handle is 1f29 and machine id is 3e8.
# /usr/openv/hsm/bin/migfind -h 1f29 -m 3e8 beta
/beta/acg/acg1
Identical results are achieved by using the DMAPI handle of the file, as follows (this
command uses a UNIX continuation character; it is meant to be entered on one line).
# /usr/openv/hsm/bin/migfind -d 00000000008000\
a90000000600000000000000000000001a0000010070c00080 beta
/beta/acg/acg1
The following output shows the full path of a file in hsmname beta whose VSM file
handle is 25c1 and machine id is 3e8, but reports that no FHDB entry exists for this file.
# /usr/openv/hsm/bin/migfind -h 25c1 -m 3e8 beta
INFO: No FHDB entries exist
/beta/acg/acg33
The following output reports that neither the FHDB entry nor the file exist for VSM file
handle 25c1 in hsmname beta and machine id 3e9.
# /usr/openv/hsm/bin/migfind -h 25c1 -m 3e8 beta
INFO: No FHDB entries exist
No such file
The following output reports that the file with the specified DMAPI handle does not exist
in hsmname beta (this command uses a UNIX continuation character; it is meant to be
entered on one line).
# /usr/openv/hsm/bin/migfind -d 00000000008000\
a90000000300000000000000000000001a0000010070c00090 beta
No such file
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/FHDB
File handle database for VSM
dwpath/database/FNDB
File name database for VSM
SEE ALSO
VSM(1M)
migftscan(1M)
NAME
migftscan - scan ft volume and reconstruct database entries for the ft storage method.
SYNOPSIS
/usr/openv/hsm/bin/migftscan [-F] [-n] [-s] hsmname label
[server_name server_path [user]]
DESCRIPTION
The migftscan command scans a remote file system and displays information about the
volume as a whole as well as information about each file granule on the volume. It also
reconstructs the FHDB, FNDB, and VOLDB entries for all scanned granules.
The remote disk volumes are registered by using the migreg command before they can be
used as archive media.
A file is migrated to a remote file system as a single granule. The granule header is
separately archived in the remote file system as a file. The granule header contains FHDB,
FNDB, and VOLDB entry information.
The migftscan command creates three output files: FHDB.label, FNDB.label and
VOLDB.label, in the dwpath/database directory. The structure of these files is the same
as the FHDB, FNDB, and VOLDB database files. These files may be used to rebuild the
FHDB, FNDB, and VOLDB if they are corrupted or damaged (see migdbcheck(1M)).
Sorting and merging of FHDB.label files or FNDB.label files for different remote file
systems can be used to recreate the FHDB and the FNDB. Similarly, merging multiple
VOLDB.label files for different remote file systems can be used to recreate the VOLDB
database.
Note When you recreate the VOLDB, ensure that you merge the VOLDB file (in the
directory /usr/var/openv/hsm/example/database) to include the entry for
the dk method.
OPTIONS
The following parameters are available:
-F Force scan the volume for granules in case the volume identity is not in
the volume database (VOLDB). This parameter is optional. If omitted, the
volume must be registered in the volume database. If specified, the
optional parameters server_name server_path user must also be
supplied. A password prompt is issued.
-n Do not compress the FHDB entries for files found on the volume. When
the -n option is used, no FNDB.label file is produced. This option is
useful for examining what is actually written on the media. The
FHDB.label file produced with the -n option must be run through
migfdbconvert before it can be merged into the real FHDB and FNDB.
-s Silently scan the volume and create FHDB.label and VOLDB.label files,
but do not display information on stdout.
hsmname Configured VSM name for the managed file system containing the
database that has information on the desired volume.
label Remote-file-system volume label used when registering the volume. This
parameter is required. For a force scan, you may specify label as anything.
server_name
Name of the remote volume server. This can be the internet id or number.
VSM uses this name on the ftp open command as the host parameter. It
must be a valid ftp host. This parameter is required when you specify
-F.
server_path
Path of the file system on the remote volume server. This parameter is
required when you specify -F.
user User name used for the ftp login request when VSM migrates or caches
files from the remote volume server. If you do not specify user, then root
is assumed. This parameter is required when you specify -F.
CAVEATS
◆ Only the system administrator may use this command.
◆ The remote volume server file system must be available via ftp for this command.
◆ migftscan performance depends on the number of files and FTP performance.
EXAMPLE
The following example scans the archive disk volume FT005 that uses the ad method.
The display shows a list of granule information for files archived on the volume. Files
FHDB.FT005 and VOLDB.FT005 are created in the dwpath/database directory.
# migftscan openv2 FT0005
VOLUME FT0005 registered to HSM
Volume Particulars
------------------
000003E8V000010AF FT0005 ft 00000B71 00000883 #31
Volume label Found ====> hare:FT0005
---------------- /usr/home/acg/ft_stor1/3E8M122D.1.
FILES
The dwpath is a directory in each managed file system that holds the database directory.
dwpath/database/FHDB
File handle database for VSM
dwpath/database/FNDB
File name database for VSM
dwpath/database/VOLDB
Volume database for VSM
dwpath/database/migconf
Configuration file for VSM
dwpath/database/FHDB.label
File handle database for current volume
dwpath/database/FNDB.label
File name database for current volume
dwpath/database/VOLDB.label
Volume database for current volume
server_name:/server_path
File system on the server
SEE ALSO
migdbcheck(1M), migconf(1M), migconfg(1M), migdbrpt(1M), migreg(1M),
migadscan(1M), mignbscan(1M), migtscan(1M), migopscan(1M)
miggetvol(1M)
NAME
miggetvol - print a list of VSM volumes on stdout by method name in ascending order
of percentage utilization
SYNOPSIS
/usr/openv/hsm/bin/miggetvol hsmname [method]
DESCRIPTION
The miggetvol command prints a list of volumes registered under the specified method.
This list is sorted by method name in ascending order according to the percentage of space
used on the volumes. The total size of files currently migrated to the volume determines
space used on the volume.
The entries in the list include the following:
label
method
empty
gran_count
obsolete_gran
percent_use%
volume_set
date_last_written
You can use miggetvol to monitor volume usage, such as required in determining when
to consolidate volumes. The migselect command uses miggetvol for selection of
volumes to consolidate.
You must have superuser (root) privileges to use miggetvol.
OPTIONS
-q Prints the command output without column headers. The default is to
print the column headers. See EXAMPLES.
hsmname Configured VSM name for the managed file system containing the
database files from which you want to derive the report.
method Method name under which miggetvol is to return information. By
default, volumes under all methods are returned.
CAVEATS
◆ miggetvol does not consider granule space overhead on the volume in arriving at
volume occupancy.
EXAMPLE
The following command prints a list of volumes on the managed file system hsm1.
# miggetvol hsm1
LABEL METHOD FLAGS GRAN_CNT OBS_GRANS USE VOLSET LAST_WRITTEN
C102A nb W 33 26 0.00 % 1 Mon Jan 14...
E102B op E 0 0 0.00 % 1 Tue Jan 15...
E102A op W 33 57 4.46 % 1 Wed Jan 23...
DK0000 dk - 31 0 0.00 % 0 Wed Dec 31...
2N512A op - 0 13 0.00 % 1 Tue Jan 15...
2N512B op - 0 0 0.00 % 1 Mon Jan 14...
A W in the third column indicates writing. E indicates empty, D indicates dead, and the
minus sign (-) is a place-holder indicating none of the above.
If you are using this command in a script and want to omit the column headers, you
invoke it with the -q option, as follows:
miggetvol -q hsm1
The output for the script would be as follows:
C102A nb W 33 26 0.00 % 1 Mon Jan 14...
E102B op E 0 0 0.00 % 1 Tue Jan 15...
E102A op W 33 57 4.46 % 1 Wed Jan 23...
DK0000 dk - 31 0 0.00 % 0 Wed Dec 31...
2N512A op - 0 13 0.00 % 1 Tue Jan 15...
2N512B op - 0 0 0.00 % 1 Mon Jan 14...
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/VOLDB
Volume database for VSM
dwpath/database/FHDB
File handle database for VSM
dwpath/database/FNDB
File name database for VSM
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
SEE ALSO
migconfg(1M), migcons(1M), migdbrpt(1M), migselect(1M)
miggroup(1), migungroup(1)
NAME
miggroup, migungroup - group files for migration and caching
SYNOPSIS
/usr/openv/hsm/bin/miggroup [-d] [-M] [-P] dir
/usr/openv/hsm/bin/miggroup -l [-v] dir
/usr/openv/hsm/bin/miggroup -u dir
/usr/openv/hsm/bin/migungroup dir
DESCRIPTION
The miggroup and migungroup commands let users premigrate and group all of the
files in a directory and all of its subdirectories in VSM-managed file systems. Users with
root privilege can group directories owned by any user. Other users can group their own
regular directories if allowed to use this command.
For nonroot users, the miggroup and migungroup perform only the premigration phase
of migration. Optionally, users can also purge copied files. The files in a grouped directory
do not actually migrate to secondary storage until the next time mignospace, migbatch,
migrc -R, or miglow execute. Users with root privilege can also optionally copy and
purge premigrated files in a grouped directory.
Grouping causes files to be added to a tie group, MigGroup, as key caching files so they
will be cached together when any one file in the group is cached. Files listed in global and
local stop files are not included in the group.
Use the -l option to determine if a directory has been grouped, and to see the status of the
files in that directory. Adding the -v option gives the status of each file in the directory. If
many files in the directory are already migrated, they may reside on multiple volumes.
This means the directory is fragmented. The -d option will defragment the directory by
caching migrated files before grouping the directory.
After a grouped directory is migrated to secondary storage, accessing any purged file in
the group causes VSM to transparently cache all of the files in the group back to disk.
De-fragmenting a directory will cache and re-migrate previously migrated data to a
minimal number of tapes, which reduces the mount time whenever the directory is
cached.
Directory grouping is not dynamic. If files are created in a grouped directory, removed
from the directory, or moved in or out of the directory, the grouping remains the same. It is
good practice, therefore, to group active directories periodically.
Normal file selection criteria are not applicable to miggroup, but normal VSM rules
apply to files that have not been grouped in grouped directories, and these files continue
to be selected, migrated, and cached individually.
The VSM state must be Active and the migration daemon migd must be running when
you issue a miggroup command
Users can ungroup a grouped directory using either the migungroup command or
miggroup with the -u option.
OPTIONS
-d Defragment the directory. If specified, all migrated files in the directory
are cached and their FHDB entries are marked obsolete before the
directory is grouped. If not specified (default), all migrated files in the
directory remain migrated, and the directory is grouped. In either case,
files not previously grouped are included in the grouped directory.
-M Run migbatch to make copies of the grouped premigrated files.
Available only to users with root privilege, and generates an error
message if used by nonroot users. If the directory is not yet grouped, this
option groups the directory.
-P Purge copied files in the directory. If the directory is not yet grouped,
using miggroup -P or migungroup -P groups the directory.
-l List the status of a directory without grouping the directory.
When the -l option is used, only one offline volume is displayed. If VSM
has multiple file copies, the volume displayed is the copy that can be
most quickly cached.
-v Generate a verbose list showing the status of a directory. Must be used
with the -l option.
-u Ungroup a previously grouped directory. Previously grouped migrated
files are cached individually if accessed.
dir Path of the directory to group (relative or absolute).
CAVEATS
◆ By their very nature, grouped directories can increase migration and caching activity
unnecessarily if used in situations where files are used individually. Group and
migrate directories only where applicable.
◆ Files created in or moved to a grouped directory are not added to the group until the
grouped directory is grouped again. Until they are added to the group, the grouped
behavior of these files when cached is undefined.
◆ Files moved out of a grouped directory remain in the directory group. The behavior of
these files when cached is undefined.
◆ Unless specifying the -l option, the directory is grouped again each time miggroup
is executed.
◆ The tie group name MigGroup is reserved for miggroup. Using this name for other
uses may cause unpredictable behavior. Also using migtie and miggroup on the
same directory and files will cause unpredictable results.
◆ Making changes to a directory while miggroup is processing the directory may
produce unpredictable behavior. Do not access migrated files, add files, or remove
files in the directory being processed by miggroup.
◆ Grouping and de-fragmenting a directory does not guarantee that all grouped files
will migrate together. Other migration activity in the same file system may cause
other files to get intermingled with the grouped files on the same media.
◆ Running two miggroup commands on the same directory at the same time may
produce undefined results.
◆ Moving grouped directories or files will cause unpredictable behavior. It is best not to
group directories that will be subject to moving.
◆ De-fragmenting a directory requires disk space to cache migrated files from
secondary storage. If this space is not available the de-fragmenting operation will fail.
If the operation fails, create space on disk and try again. A partially completed
operation to defragment a disk may leave unnecessary data from migrated files on
disk.
◆ If a migrated and purged file in a grouped directory is truncated to size zero, the
migration daemon migd does not cache the file, nor does it cache any of the other files
in the grouped directory.
◆ Files whose pathname length exceeds 1023 characters will not be migrated.
EXAMPLES
In the following example, the user requests that VSM group and premigrate all of the files
in directory project123 without first de-fragmenting that directory.
# miggroup /home/abc/project123
In the following example, the user defragments directory project123 before grouping
and pre-migrating all of the files in that directory.
# miggroup -d /home/abc/project123
If the user has root privilege, the following command defragments directory
project123 before grouping, migrating, and purging all of the files in that directory.
# miggroup -d -MP /home/abc/project123
The following command uses an absolute pathname to list the number of volumes
holding data for the grouped files in the project123 directory.
# miggroup -l /home/abc/project123
Regular 3 files 0.046080 MB
Grouped 9 files 0.101412 MB
Not Grouped 3 files 0.046080 MB
FILES
/usr/var/openv/hsm/database/migstop
Global stop file for VSM.
SEE ALSO
VSM(1M), migbatch(1M), migpurge(1), migrate(1), migsetdb(1M), migstage(1),
migtie(1)
migin(1M)
NAME
migin - cache a file from secondary storage to disk
SYNOPSIS
/usr/openv/hsm/bin/migin [-c] hsmname file_system machid file_handle
DESCRIPTION
The migin command caches a file in that has been removed or lost and therefore cannot
be cached simply by accessing it. This command is useful in recovering files that were
migrated or cached and then perhaps accidentally deleted. The file is cached to the
original location as a regular file.
It is possible to recover the file only if an FHDB entry exists for a copy of the file on
secondary storage. VSM automatically removes obsolete entries from the FHDB after 7
days.
This process does not restore original file ownership or mode bits.
This command may be run without regard to whether the migration daemon migd is
running, but the VSM state must be Active or Maintenance.
OPTIONS
-c Specifes that migstage ignores checksum (crc) errors when caching files.
Normally, when caching a file from tape the cache operation fails if the
crc computed from the data does not match the crc in the granule
header.
When -c is specified, the cache operation succeeds even if the crc check
fails. This option is intended to be used only as a last resort when a file
cannot be recovered the usual way. The file data cached back with the -c
option may not be the original file data.
hsmname Name of the managed file sytem that is controlling migrations for the file
system in which the file you are recovering resided, as configured with
the hsmname parameter in the
/usr/var/openv/hsm/database/migconfg file.
file_system
Path to the file system that contained the file, as configured with the
fspath parameter in the /usr/var/openv/hsm/database/migconfg
file.
machid The integer (nonzero) identifier for the VSM-managed file system from
which the file was migrated, as configured with the machid parameter in
the DEFAULTS section of the dwpath/migconf file.
file_handle
File handle of the file you are recovering, as recorded in the FHDB.
CAVEATS
◆ If a file has been designated as a key caching file by the migtie command, caching
that file manually with migin will not cause all migrated files in the associated group
to be cached as well.
◆ If a file has been included in a grouped directory by the miggroup command, caching
that file manually with migin will not cause all migrated files in the grouped
directory to be cached as well.
◆ If both a file and its directory have been removed, migin will not cache the file until
you have made a new directory with its full path to replace the original directory.
◆ Manual migin is not intended to be used on existing files. If migin is used on an
existing purged file, the command restores the data and leaves the file in a purged
state.
EXAMPLE
Assume you run migdbcheck and find that a file handle exists for a file that is not in the
file system. Upon further checking you discover that you need this file. The file resided in
the /project1 file system, was migrated by the managed file system zeta, the machine
ID for the host is 3e8, and the file handle is 12d2. You execute the following:
# migin zeta /project1 3e8 12d2
The command restores the file to its original pathname as a regular, unmigrated file.
FILES
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
dwpath/database/migconf
Configuration file for managed file systems
SEE ALSO
migdbcheck(1M), migconf(1M), migconfg(1M), migreconstruct(1M),
migpurge(1), migtie(1)
miglicense(1M)
NAME
miglicense - displays the current license capacity of VSM
SYNOPSIS
/usr/openv/hsm/bin/miglicense
/usr/openv/hsm/bin/miglicense -l [-v]
/usr/openv/hsm/bin/miglicense -u [-f]
/usr/openv/hsm/bin/miglicense -a | -d textofkey
DESCRIPTION
The miglicense command determines the current license capacity of VSM. If used
without options, miglicense displays the total valid capacity under license. The -l
option displays an itemized list of each VSM license key including both valid and invalid
keys.
You can compare the licensed capacity with the actual current capacity used on storage
media by using the -u option. VSM issues a warning message when current capacity
exceeds 90% of licensed capacity, and an error message when current capacity exceeds
licensed capacity. When current capacity exceeds licensed capacity, VSM suppresses
further migrations with migcopy until additional license keys are added.
Licensing is enforced when migcopy migrates data using the following storage methods:
optical (op and ow), tape (ct, dt, and mt), and NetBackup (nb). Capacity includes active
and obsolete granules, but not any granules marked dead.
Note The nb method will not be supported after the VSM 4.5 release.
VSM calculates current capacity and increments the total as new migrations occur,
recording the sum in either /usr/var/openv/hsm/database/CAPACITY_USED1 or
/usr/var/openv/hsm/database/CAPACITY_USED2. When VSM periodically
recalculates current capacity, only one copy of each migrated file is counted, regardless of
how many copies exist and the levels on which they are located.
Note VERITAS recommends the practice of making two copies of each migrated file.
OPTIONS
-l [-v]
Lists the text value and capacity of each VSM license key. The -verbose
option is for debugging or customer support, and also displays
NetBackup keys.
-u Lists the previously calculated, current capacity used on storage media.
-f Recalculate the current capacity used on storage media. Must be used
with the -u option.
-a Add a license key of format textofkey.
-d Delete a license key of format textofkey.
textofkey The text of the license key in the format
AAAA-BBBB-CCCC-DDDD-EEEE-FFFF.
CAVEATS
◆ Whenever current capacity exceeds licensed capacity, VSM suppresses further
migrations with migcopy. This continues until licensed capacity is increased. During
this period, migrated files can continue to be cached if there is enough free space on
disk to hold them.
FILES
/usr/var/openv/hsm/database/CAPACITY_USED1
/usr/var/openv/hsm/database/CAPACITY_USED2
The current capacity used
SEE ALSO
VSM(1M)
migloc(1)
NAME
migloc - display the location of a migrated file
SYNOPSIS
/usr/openv/hsm/bin/migloc [-R] pathname [pathname ...]
/usr/openv/hsm/bin/migloc -f filelist
DESCRIPTION
The migloc command shows attributes of and medium (volume) location of migrated
files. The output includes obsolete FHDB entries for migrated files.
The resulting migloc display has the following format:
Status: type mach_name owner file_pathname
Handle: mach_idMhandle file_size gran_count date_of_migration
Medium: label method level gran_count seek_info vol_location
Status fields (if the file is not migrated, VSM generates only this field) are as follows:
type For a migrated file, type is one of the following: Premigrated,
Migrated, Cached, Purged, Staging, or Partial. For other files, type
is one of the following: Regular, Directory, Bloc-spl, Char-spl,
Socket, Pipe, or Symb-link.
mach_name
Host name of the machine on which the file resides.
owner Owner of the file.
file_pathname
Pathname of the file.
Handle fields are as follows:
mach_idMhandle
Machine ID and file handle, in hexadecimal, separated by M.
file_size File size in bytes.
gran_count
Total number of active granules of this file on all media.
date_of_migration
Date when the file was last migrated.
Note The nb method will not be supported after the VSM 4.5 release.
After migration, the file data may exist both on disk and secondary storage until
mignospace releases the space from disk. If the data still exists on disk, the display
shows media type dk.
OPTIONS
-R Recursively list subdirectories encountered.
EXAMPLE 1
In the following example, the tproga file resides on cartridge tape and the data has not
yet been purged.
# migloc tproga
EXAMPLE 2
In the following example, the acg1 file resides on a remote ft volume and has been
purged.
# migloc acg1
SEE ALSO
fls(1)
miglow(1M)
NAME
miglow - check the VSM-managed file systems for low space
SYNOPSIS
/usr/openv/hsm/bin/miglow [hsmname] | file_system]
DESCRIPTION
The miglow command maintains and manages disk space on a managed file system by
initiating migration when free space is below the freespace percentage specified in the
dwpath/database/migconf file.
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
miglow is used when the migration daemon is not automatically managing the free space
for a VSM-managed file system. When a managed file system is in Maintenance state, you
may wish to run miglow before changing the state to Active.
This command may be run without regard to whether the migration daemon (migd) is
running. The VSM state must be Active or Maintenance.
OPTIONS
hsmname Configured VSM name for the managed file system that you want to
check.
file_system
Full path name of the file system you want to check.
If you do not specify an hsmname or file_system, miglow checks all managed file
systems.
SEE ALSO
VSM(1M), migconfg(1M), migbatch(1M), mignospace(1M)
migmdclean(1M)
NAME
migmdclean - clean VSM migration media
SYNOPSIS
/usr/openv/hsm/bin/migmdclean [-O] [-i] [-a days] [-R] [-S]
hsmname label.method[.volset] [label.method[.volset]]...
DESCRIPTION
When a user modifies or deletes migrated files, VSM does not remove the migrated files
and granules from the medium, but simply marks them as obsolete in the file handle
database (FHDB). VSM is unable to reuse the space on the media until all FHDB entries
for the volume are obsoleted and set to dead.
The migmdclean command cleans media and databases by setting obsolete FHDB entries
to dead and then removing all dead FHDB entries. When all FHDB entries for a volume
are dead, the -R option can remove the volume’s entry from the VSM volume database
(VOLDB). You can then recycle the media by registering and relabeling it for use with
VSM. By using the migselect command, you can select multiple media under different
methods.
You can use the migrc command to remove obsolete and dead entries (see migrc(1M)).
You can also use the migcons command to consolidate volumes and free them for reuse.
However, migmdclean has additional options that may be useful under certain
conditions. For example, if the medium is damaged you can use the -O and -R options to
forcibly obsolete database entries and remove the empty volume from VSM.
For the ad and ft methods, migmdclean also attempts to remove files from the media
when the MFLAG_OBSOLETE flag is specified in the dwpath/database/migconf
configuration file for these methods.
For the ct, dt, mt, op, and ow methods, migmdclean never attempts to remove files
from the media. If all granules on the volume are already dead, use migrecycle to
reregister the media and remove files. If the volume contains obsolete granules, use
migcons and then reregister the media with migreg to remove files. Although it is
possible to clean ow media (write once, read many), it is not possible to recycle these
optical disks.
Note When one side of an optical disk is consolidated, the volume entry for that input
volume is not removed from the VOLDB unless and until both sides of that optical
disk are empty.
Note Although VSM sets FHDB entries to obsolete if a migrated file is modified or
deleted, VSM must set these entries to dead before actually removing them from the
FHDB. With the ad and ft methods, migmdclean may also unlink the file on the
media so it is no longer possible to recover the data using VSM utilities. Prior to
unlinking, you could recover the file by simply setting the corresponding FHDB
entry back to active. In the following discussions, removal refers to unlinking and
applies only to media used by the ad and ft methods.
OPTIONS
By default, migmdclean marks as dead all FHDB entries that have been obsolete for 7
days, regardless of the method or volume. For ad and ft volumes, the command also
attempts to remove obsolete files from the media if MFLAG_OBSOLETE is set. For nb
volumes, the command will expire the NetBackup image when the last FHDB entry to
reference it is deleted.
Note The nb method will not be supported after the VSM 4.5 release.
Caution Use the -O parameter with extreme caution, as it might prevent user access to
migrated files residing on the volume. See CAVEATS.
For ad and ft volumes, this option also attempts to remove the files from
the media. If this option is not specified, migmdclean removes only
currently obsolete entries.
-i Marks the FHDB entries as dead but inhibits removal of files from the
media. If this option is not specified, VSM attempts to remove files. This
option applies to the ad and ft methods.
-a days Selects only files that have been obsoleted for the specified number of
days. The default is 7 days. An important use of the age parameter [-a
days] is to specify that VSM delete only those files obsoleted prior to the
last full backup.
-R Specifies that if all FHDB entries for the volume are dead, migmdclean
removes the volume entry from the VOLDB. Doing this will also remove
all dead volumes, not just the ones being cleaned.
If this option is not specified, the volume remains in the VOLDB as a
valid entry.
-S Activate obsolete and dead FHDB entries of all files with VSM handles.
migmdclean -S applies to all files with VSM handles, not just those in
the specified volumes.
CAVEATS
◆ When migmdclean is run to clean a specified volume, it will also remove all dead
volumes, not just the ones being cleaned.
◆ Locked database entries for the media will cause the cleanup operation to fail. Run
migrc -L prior to running migmdclean to unlock the locked entries.
◆ Execute migdbcheck before running migmdclean to ensure database consistency.
◆ Side effects of running migmdclean -a 0 -O -R after all copies have been made:
- If there is only one migrated copy and the file is purged from premigration, the
file cannot be cached and the data is lost.
- If another active or obsolete copy exists and the file is purged from premigration,
the file can still be cached.
- Unpurged files will not be purged and can still be cached.
- Copies of unpurged files will not be remade.
◆ If using NetBackup in conjunction with VSM, set the age variable for migmdclean at
a value higher than the longest NetBackup retention period on the managed file
system. Do this by adding the following line to
/usr/openv/hsm/bin/cmd/migmdclean:
FLGS=”-a xxxx $FLGS”
The xxxx is the longest NetBackup retention period.
Next, remove the following line:
FLGS=“-a 7”
EXAMPLE
The following example removes obsolete FHDB entries at least 7 days old from media in
cartridge disk rao001 volume set 1.
# migmdclean -a 7 alpha rao001.ct.1
The following example selects media in alternate magnetic disk (ad) volume set 1 that
have no active files and removes the granules from them. When removal is successful, the
corresponding FHDB entries are marked as dead.
# migmdclean alpha ‘migselect alpha 0-0 1 ad‘
FILES
The term dwpath refers to the path name of the directory containing the database and
workdir directories. The path name of this directory is site configurable
dwpath/database/FHDB
File handle database
dwpath/database/FNDB
File name database for VSM
dwpath/database/VOLDB
Volume database
dwpath/database/migconf
Configuration file for managed file systems
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
SEE ALSO
migdbcheck(1M), migreg(1M), migconf(1M), migconfg(1M), migcons(1M),
migdbrpt(1M), migrc(1M), migrecycle(1M), migselect(1M), migactivate(1M)
migmove(1M)
NAME
migmove - move migrated files from one migration level to another level
SYNOPSIS
/usr/openv/hsm/bin/migmove [-A] [-m methname] [-f a | o | d]
[hsmname | file_system]
/usr/openv/hsm/bin/migmove -c 1 | 2 [-A] [-m methname] [-f a | o
| d] [hsmname | file_system]
/usr/openv/hsm/bin/migmove -s miglevel [-d miglevel] [-A] [-m
methname] [-f a | o | d] [hsmname | file_system]
DESCRIPTION
The migmove command controls the movement of active migrated files from one
migration level to another migration level. It scans the configured migration levels
associated with the specified hsmname or file_system, selecting and moving files that
meet the configured age and size criteria. A file is selected for movement if all of the
following are true:
◆ The file is active (not marked error, obsolete or dead in the FHDB).
◆ The file’s calculated move threshold value is greater than or equal to the configured
move threshold value for the source migration level. The file move threshold is
calculated using either the standard move threshold formula (which factors in file age
and size) or a site-specified move threshold formula.
◆ The destination migration level and corresponding storage method are configured in
migconf.
◆ Any copy of the file at the destination migration level, even if that file has the error
flag set or is marked obsolete or dead in the FHDB, will prevent a file from being
selected to be moved to that level.
◆ The source migration level method name is ad, ct, dt, mt, op, or ow.
VSM supports a total of up to eight migration levels. By default the migmove command
assumes there will be two migrated copies, and divides the eight migration levels into a
symmetrical hierarchy where the first copy is associated with odd-numbered levels and
the second copy is associated with even-numbered levels. Defaults are set accordingly.
Sites can create asymmetrical hierarchies by migrating only one file copy, or by specifying
both the source and destination migration levels in migmove commands.
Using the VSM-Java interface you may configure move criteria for migration levels or for
method names or for both. Move criteria for migration levels, if specified, take precedence
over move criteria for method names, if specified.
VSM first attempts to retrieve the data from the volume at the source migration level. If
that fails, VSM attempts to retrieve the data from another volume regardless of its
migration level, starting with the storage device with the shortest file transfer time.
After a file moves from a source migration level to a destination migration level, the file at
the source level can remain active or it can be marked obsolete or dead. Volumes can later
be consolidated and recycled to reclaim the file space occupied by obsolete and dead files.
The migmove command is generally run on a schedule created with the Scheduling tool.
OPTIONS
-c 1 | 2
For -c 1, move copy 1 of the migrated files. In the default configuration
with all eight migration levels configured, the source migration levels 5,
3, and 1 are processed in that order. Files at level 5 move to level 7, then
files at level 3 move to level 5, and then files at level 1 move to level 3.
Configured source migration levels are scanned only if their respective
destination migration levels are also configured.
For -c 2, move copy 2 of the migrated files. In the default configuration
with all eight migration levels configured, the source migration levels 6,
4, and 2 are processed in that order. Files at level 6 move to level 8, then
files at level 4 move to level 6, and then files at level 2 move to level 4.
Configured source migration levels are scanned only if their respective
destination migration levels are also configured.
The default is move both copy 1 and copy 2 files when neither -c nor -s
are specified. If -c is specified, -s cannot be specified.
-s miglevel
Move files from the source migration level indicated by miglevel, where
miglevel is an integer in the range 1 to 8. If the destination migration level
-d is not specified, miglevel cannot equal 7 or 8. The default destination
migration level is the source migration level +2.
If -s is specified, -c cannot be specified.
Note When specifying the -s level, if the data selected to move is currently on disk, then
the data will come from the disk and not the -s level specified.
-d miglevel
Move files to the destination migration level indicated by miglevel, where
miglevel is an integer in the range 1 to 8. The destination migration level
cannot equal the source migration level. The default is the source
migration level +2.
If -d is specified, -s must be specified.
-A Select all files at source level ignoring selection criteria.
-m methname
Scan for this method name when selecting and moving files for all source
migration levels processed. Allowed values for methname are ad, ct, dt,
mt, op, and ow. Default is to scan for all allowed and configured method
names for all source migration levels processed.
If -m is specified, either -c or -s may also be specified.
-f a | o | d
For -f a, leave the FHDB entries for the selected files active at the
source migration level.
For -f o, mark the FHDB entries for the selected files obsolete at the
source migration level.
For -f d, mark the FHDB entries for the selected files dead at the source
migration level. If the method name is ad, mark the FHDB entries for the
selected files obsolete at the source migration level.
When -f a|o|d is not specified, the default is what is specified in the
migconf move flags.
-h Print help information.
hsmname Configured VSM name for the managed file system to be processed for
moving files from one migration level to another migration level.
file_system
The full path name of the file system to be processed for moving files
from one migration level to another migration level. The hsmname for
this file system must be in the Active or Maintenance state.
If neither hsmname nor file_system is specified, all hsmnames are
processed.
CAVEATS
◆ The defaults for migmove assume two migrated copies and a symmetrical hierarchy
in which the first copy is associated with odd-numbered migration levels and the
second copy is associated with even-numbered migration levels. To implement any
other multilevel migration hierarchy, configure the migration levels you need and
then specify both the source and destination migration levels in migmove commands.
EXAMPLES
The hsmname for the file system to be processed in these examples is alpha.
The following example is the most general case.
# migmove alpha
It assumes there are two migrated copies and all eight migration levels are configured into
a symmetrical hierarchy where the first copy is associated with odd-numbered levels and
the second copy is associated with even-numbered levels. The default conditions will
move selected primary and alternate files with any method name from source migration
levels 5 and 6 respectively to their corresponding default destination migration levels, 7
and 8 respectively, and then process the other source migration levels in decreasing
numerical sequence. After they are moved, selected files at all source migration levels are
marked dead by default unless the method name is ad, in which case they are marked
obsolete.
In the special case where only migration levels 1, 2, and 3 are configured, this same
command
# migmove alpha
moves selected files with any method name only from source migration level 1 to default
destination migration level 3.
The following example moves only copy 2 of migrated files. Assuming all migration
levels are configured, the command moves selected files with method name ct
sequentially from source migration levels 6, 4, and 2 to their default destination migration
levels, 8, 6, and 4 respectively. After they are moved, selected files at all source migration
levels are marked dead by default.
# migmove -c 2 -m ct alpha
The following example moves selected files with any method name from source migration
level 4 to default destination migration level 6. After they are moved, selected files at
source migration level 4 remain active.
# migmove -s 4 -f a alpha
The following example is that of an asymmetrical hierarchy where the destination
migration level is specified to be something other than the default value (source migration
level plus 2). This command moves selected files with any method name from source
migration level 3 to destination migration level 4. After they are moved, selected files at
source migration level 3 are marked obsolete.
# migmove -s 3 -d 4 -f o alpha
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/FHDB
File handle database
dwpath/database/FNDB
File name database for VSM
dwpath/database/migconf
Configuration file for managed file systems
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
dwpath/database/migsweep.site
Site migration and purge criteria
dwpath/database/migsweepm.site
Site move criteria
/usr/var/openv/hsm/example/database/sample.migpolicy.script
Sample migpolicy replacement script
SEE ALSO
migconf(1M), migconfg(1M), migpolicy(1M), migsetdb(1M)
mignbexport(1M)
NAME
mignbexport - export VSM files
SYNOPSIS
/usr/openv/hsm/bin/mignbexport [-s dir] [-e ExpLevel] [-S
schedule] [-P policy] [-D timeout] hsmname
DESCRIPTION
The mignbexport command exports files from one VSM-managed file system so they
can be imported into a different VSM-managed file system using the companion
mignbimport command. Migrated files, if any, are not cached by either mignbexport
or mignbimport.
Using this command requires that NetBackup be installed and running on the server
executing mignbexport.
mignbexport does a user directed backup of the exported files and the FHDB entries
and VOLDB entries for those exported files. These NetBackup images are exported to the
site doing the mignbimport.
The backup is done using a NetBackup policy that must be defined in the NetBackup
configuration prior to executing mignbexport. The NetBackup policy must define a
NetBackup volume pool that contains volumes that can be sent to the site doing the
mignbimport.
The VSM volumes that contain data for any migrated files being exported must also reside
on VSM volumes that can be sent to the site doing the mignbimport.
There are two ways to export files.
◆ Export all migrated and unmigrated files residing in the specified subdirectory (dir) in
the managed file system.
◆ Export all migrated files residing at export level ExpLevel. In this case, do not specify
the -s dir option.
After mignbexport runs, the Volumes_to_export.pid file in dwpath/database
contains a list of all VSM volumes that are exported. Additionally, the exported tapes now
reside in the VSMEXP volume pool, which prevents these tapes from being overwritten
with migrated files. Send all the exported volumes to the site that will import the data
with the mignbimport command.
After mignbexport runs, the Client_name.pid file in dwpath/database contains the
NetBackup client name that initiated the user directed backup. This client name is needed
when doing the NetBackup import at the import site.
OPTIONS
-s dir Full path of the directory to export. This must be a subdirectory in the
managed file system. mignbexport moves files in dir to ExpLevel and
exports all migrated and unmigrated files in dir.
Prior to running mignbexport a LEVELExpLevel must be configured
and there must be VSM volumes registered for this LEVELExpLevel.
After mignbexport moves migrated data to these VSM volumes, the
volumes are sent to the site doing the mignbimport.
All files residing in dir following a mignbexport operation remain there.
If -s dir is specified and there are any migrated files in dir that reside at
level ExpLevel prior to running mignbexport, the command will abort
with an error message.
If -s dir is not specified, mignbexport will only export files that
currently reside at ExpLevel. No files will be moved to ExpLevel and
unmigrated files will not be exported.
-e ExpLevel
Migration level of volumes to export. Valid values range from 1 to 8.
Default is 8. See the -s option for an explanation of the relationship
between ExpLevel and dir.
-S schedule
NetBackup schedule in policy to use for the user directed backup. The
default is HSMEXPS. The schedule must be defined in the NetBackup
configuration prior to running mignbexport.
-P policy
NetBackup policy to use for the user directed backup. The default is
HSMEXPC. The policymust be defined in the NetBackup configuration
prior to running mignbexport. The policymust use NetBackup volumes
that can be moved to the site doing the mignbimport.
-D timeout
A deadman timeout value in minutes. If NetBackup does not respond to
the user directed backup request of mignbexport within the timeout
period, mignbexport will abort. The default is 60 minutes.
hsmname The name of the file system from which files are exported. For more
information, see migconf(1M).
CAVEATS
◆ All systems exporting and importing files between them must have unique Machine
IDs for managed file systems. Valid hexadecimal values range from 1 to FFFFFF. The
default is 1000.
◆ mignbexport does not supported embedded special characters in file names, such as
asterisk, backslash, newline, parenthesis, question mark, right curly brace, square
bracket, tab, or vertical bar (pipe).
◆ All systems exporting and importing files between them must have unique volume
labels for the VSM volumes containing the migrated files being exported. These
volumes are sent to the site doing the mignbimport.
◆ All systems exporting and importing files between them must have unique volume
labels for the NetBackup volumes sent to the site doing the mignbimport.
◆ All systems exporting or importing files between them must have unique NetBackup
client names for the client doing the user directed backup.
◆ If mignbexport does not terminate successfully you may have to cleanup the
exporting file system before trying again. If the -s option was specified, the VSM
volumes containing the migrated files being exported may have to be recycled.
◆ Configure the export migration level (ExpLevel) and corresponding level before using
this command.
◆ Neither the ft or nb methods are eligible to be imported or exported.
Note The nb method will not be supported after the VSM 4.5 release.
EXAMPLE
In the following example, the exporting site will move copies of all migrated and
unmigrated files in directory /delta/export/6/4 to default level 8 for export from file
system delta. The NetBackup schedule is the default HSMEXPS, and the NetBackup
policy is the default HSMEXPC.
# mignbexport -s /delta/export/6/4 delta
A typical response follows. Dots are printed in sequence while tapes are writing or
rewinding.
Waiting on NetBackup backup ...
Waiting on NetBackup to complete ...
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/FHDB
File handle database for VSM
dwpath/database/FNDB
File name database for VSM
dwpath/database/VOLDB
Volume database for VSM
dwpath/database/migconf
Configuration file for VSM
dwpath/database/Volumes_to_export.pid
A list of all VSM volumes that are exported
dwpath/database/Client_name.pid
NetBackup client name
SEE ALSO
migconf(1M), migconfg(1M), migdbcheck(1M), migdbrpt(1M), mignbimport(1M),
migmove(1M)
mignbimport(1M)
NAME
mignbimport - import VSM files
SYNOPSIS
/usr/openv/hsm/bin/mignbimport [-i ImpLevel]
[-P policy] -m client_name [-D timeout] hsmname
DESCRIPTION
The mignbimport command imports files previously exported using the companion
mignbexport. The managed file system must be active before you import files.
Using this command requires that NetBackup be installed and running on the server
executing mignbimport.
mignbimport does a user directed NetBackup restore of the exported files and the FHDB
entries and VOLDB entries for the exported files. This restore also includes information
about the original path of the exported VSM-managed file system.
mignbimport merges the FHDB, FNDB, and VOLDB entries created by mignbexport
into the FHDB, FNDB, and VOLDB of the importing managed file system, hsmname.
When the files are restored, the portion of the path that was the original path of the
exported VSM-managed file system is replaced with the path of the VSM-managed file
system into which the files are being imported.
The VSM volumes that were exported must be placed in the desired library before
running mignbimport. These volumes retain their original volume name so they must be
unique. Do not register these volumes to VSM because mignbimport will take care of
this automatically.
A NetBackup policy must be defined prior to running mignbimport and this policy must
have the same name as the NetBackup policy used with the mignbexport. This policy
must reference a NetBackup volume pool that contains only the NetBackup volumes that
were written by mignbexport. The NetBackup volumes that were written by
mignbexport must be imported into NetBackup at the site importing the files prior to
running mignbimport. For more information on importing NetBackup images, see the
NetBackup DataCenter System Administrator’s Guide for UNIX.
This command may be run without regard to the VSM state, but the migd migration
daemon must be running.
OPTIONS
-i ImpLevel
Migration level of the imported volumes. Valid values range from 1 to 8.
Default is 7.
mignbimport will change the FHDB entries for the imported files to
indicate that the files reside at this level. mignbimport will also change
the VOLDB entries for the imported volumes so they appear to be full
and will never be written on again.
-P policy NetBackup policy to use for the user directed restore. It must be the same
as the policy used with mignbexport. The default is HSMEXPC. The
policy must be defined in the NetBackup configuration prior to running
mignbimport. The policy must use NetBackup volumes that were
exported from client_name and sent from the site doing the
mignbexport. These volumes must be imported into NetBackup prior
to running mignbimport.
-m client_name
Name of the NetBackup client from which the VSM files were exported.
See the dwpath/database/Client_name.pid file created when the
mignbexport operation finished.
-D timeout
A deadman timeout value in minutes. If NetBackup has not responded
within the timeout period, mignbimport will abort. The default is 60
minutes.
hsmname The name of the file system to which the files will be imported. For more
information, see migconf(1M).
CAVEATS
◆ All systems exporting and importing files between them must have unique Machine
IDs for managed file systems. Valid numerical values range from 1 to FFFFFF. Default
is 1000.
◆ All systems exporting and importing files between them must have unique
volume labels for the VSM volumes containing the migrated files being exported.
These volumes are sent from the site doing the mignbexport.
◆ All systems exporting and importing files between them must have unique
volume labels for the NetBackup volumes sent from the site doing the
mignbexport.
◆ Do not run mignbimport twice on a system to import the same files without first
cleaning up any errors from the first run.
◆ Imported files lose any designations they may have as tied files, and must be
redesignated. See man page migtie(1).
◆ Configure the import migration level (ImpLevel) and corresponding LEVEL before
using this command.
◆ The NetBackup policy used for the user directed restore must match the NetBackup
policy used in the mignbexport operation, and must be defined in the NetBackup
configuration prior to running mignbimport.
◆ Imported VSM volumes must be loaded into a library prior to running
mignbimport.
◆ The NetBackup volumes that were exported must be in a NetBackup pool referenced
by policy, and must have been imported into NetBackup as client_name prior to
running mignbimport.
◆ Neither the ft or nb methods are eligible to be imported or exported.
Note The nb method will not be supported after the VSM 4.5 release.
EXAMPLE
Place the NetBackup volumes containing files to be imported in the appropriate storage
devices and register them with Media Manager for the importing VSM-managed file
system, giving them a unique pool name. Define the NetBackup policy HSMEXPC to use
this unique pool name
Using NetBackup, import the client client_name. In this example, this is hat.
Place the VSM volumes containing file data to be imported in the appropriate storage
devices and register them with Media Manager for the importing VSM-managed file
system, giving them a pool name of HSM. If this is not done, Media Manager will issue
requests for the operator to assign this media.
In this example, the site will import copies of files to default level 7 on file system
omikron. The name of the NetBackup client is hat.
# mignbimport -m hat omikron
A typical response is shown below:
Waiting on NetBackup restore in Phase 1...
Waiting on NetBackup restore in Phase 2...
mignbimport complete.
Note The dots are printed in sequence while tapes are reading or rewinding.
The imported files now are ready for access by VSM on the file system at the new location.
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/FHDB
File handle database for VSM
dwpath/database/FNDB
File name database for VSM
dwpath/database/VOLDB
Volume database for VSM
dwpath/database/migconf
Configuration file for VSM
SEE ALSO
migconf(1M), migconfg(1M), migdbcheck(1M), migdbrpt(1M), mignbexport(1M),
migmove(1M), migtie(1)
mignbscan(1M)
NAME
mignbscan - scan nb volume and reconstruct database entries for the nb storage method
SYNOPSIS
/usr/openv/hsm/bin/mignbscan [-s] [-h] hsmname label NB_master
policy_name NB_client level
DESCRIPTION
Note The nb method will not be supported in the next release of VSM.
The mignbscan command scans a NetBackup policy and displays information about the
volume as a whole as well as information about each file granule on the volume. It also
reconstructs the FHDB, FNDB, and VOLDB entries for all scanned granules.
A file is migrated to NetBackup as a single granule. The granule header,
<machid>M<handle>.GLABEL.<level>, is separately backed up as a file. The granule
header contains FHDB, FNDB, and VOLDB entry information.
The mignbscan command creates three output files: FHDB.label, FNDB.label and
VOLDB.label, in the dwpath/database directory. The structure of these files is the same
as the FHDB, FNDB, and VOLDB database files. These files may be used to rebuild the
FHDB, FNDB, and VOLDB if they are corrupted or damaged (see migdbcheck(1M)).
You can sort and merge FHDB.label and FNDB.label files for different volumes to recreate
the FHDB and FNDB. Similarly, merging VOLDB.label files for different volumes can
recreate the VOLDB.
When recreating the VOLDB, be sure to merge the VOLDB file in the
/usr/var/openv/hsm/example/database directory to include the entry for the dk
method.
OPTIONS
The following parameters are available under migftscan:
-s Silently scan the volume and create FHDB.label and VOLDB.label files,
but do not display information on stdout.
-h Print help information.
hsmname Configured VSM name for the managed file system containing the
database containing information on the desired volume.
label NetBackup volume label used when registering the volume. This
parameter is required.
NB_master
Name of the master NetBackup server for nb volumes. NB_master must
be the first name the server is known by to NetBackup.
policy_name
Name of the NetBackup policy. The NetBackup policy must be active.
NB_client Name of the NetBackup client. Check the NetBackup GUI to identify the
correct value to use for client.
level The migration level of this volume. Valid values are 1 or 2.
EXAMPLE
The following example scans the NetBackup disk volume NB003 that is registered under
the nb method. The NetBackup server is duo, the NetBackup policy is hsmnb2, the
NetBackup client is trio, and the migration level for this volume is 1. The display shows a
list of granule information for files backed up onto the volume. The FHDB.NB003 and
VOLDB.NB003 files are created in the dwpath/database directory.
# mignbscan tau4 NB003 duo hsmnb2 trio 1
Volume label Found ====> NB003 duo hsmnb2
-------------------------------
Obtaining list of granules.
Restoring granule header files
...
/tau4/migration/data/3e8M24c5.GLABEL.1 <=>
00014B6B 00000000 Mon Apr 9 12:54:35 2001 /tau4/files/a
/tau4/migration/data/3e8M24c6.GLABEL.1 <=>
00014B6B 00000000 Mon Apr 9 12:54:36 2001 /tau4/files/b
/tau4/migration/data/3e8M24c7.GLABEL.1 <=>
00014B6B 00000000 Mon Apr 9 12:54:36 2001 /tau4/files/c
/tau4/migration/data/3e8M24c8.GLABEL.1 <=>
00014B6B 00000000 Mon Apr 9 12:54:36 2001 /tau4/files/d
/tau4/migration/data/3e8M24c9.GLABEL.1 <=>
00014B6B 00000000 Mon Apr 9 12:54:37 2001 /tau4/files/e
/tau4/migration/data/3e8M24ca.GLABEL.1 <=>
00014B6B 00000000 Mon Apr 9 12:54:37 2001 /tau4/files/f
/tau4/migration/data/3e8M24cb.GLABEL.1 <=>
00014B6B 00000000 Mon Apr 9 12:54:37 2001 /tau4/files/g
/tau4/migration/data/3e8M24cc.GLABEL.1 <=>
00014B6B 00000000 Mon Apr 9 12:54:37 2001 /tau4/files/h
Particulars of granules displayed include (in order): granule file name, migrated file size,
offset of the granule in the migrated file, date of backing up the granule, and migrated file
pathname.
Including an incorrect policy name in the command gives the result shown in the
following example:
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/FHDB
File handle database for VSM
dwpath/database/FNDB
File name database for VSM
dwpath/database/VOLDB
Volume database for VSM
dwpath/database/migconf
Configuration file for VSM
dwpath/database/FHDB.label
File handle database for current volume
dwpath/database/VOLDB.label
Volume database for current volume
SEE ALSO
migconfg(1M), migdbcheck(1M), migdbrpt(1M), migreg(1M), migadscan(1M),
migftscan(1M), migtscan(1M), migopscan(1M)
mignewlog(1M)
NAME
mignewlog - truncate or restart and optionally make a copy of VSM logs
SYNOPSIS
/usr/openv/hsm/bin/mignewlog [-F] hsmname [destination_file] |
GLOBAL [destination_file]
DESCRIPTION
VSM maintains a global log file for the VSM server and a separate log file for each
hsmname in the /usr/var/openv/hsm/database/migconfg file.
◆ The pathname to the global log file is not configurable and is always /tmp/hsm.log
(it may be a symbolic link).
◆ You define the log file paths for each managed file system during configuration. The
term lgpath refers to these file paths.
VSM uses each hsmname’s log file lgpath and the global log file (/tmp/hsm.log) to store
messages, status, and errors. To ensure that the global is maintained between boots and
does not fill up the /tmp partition, you should link it to a file that resides on a file system
other than /tmp.
If the lgpath or /tmp/hsm.log files become too large, you can use the mignewlog
command to truncate or restart them and release the associated disk space. Note that
using rm to remove the global log file /tmp/hsm.log does not release the disk space
associated with that file if the migration daemon (migd) is running.
Before truncating or restarting any log files, you should inspect them for abnormal errors.
OPTIONS
-F Used to replace the contents of the destination_file. When this is not
specified, the destination_file is NOT overwritten.
hsmname Configured VSM name for the managed file system containing the log file
you want mignewlog to truncate or restart. If hsmname=GLOBAL, the
command uses the global log file /tmp/hsm.log.
destination_file
If you specify this parameter, mignewlog copies the log to the specified
destination before truncating or restarting it. If you do not specify a
destination_file, the log is removed.
CAVEATS
If migration to secondary media is taking place, the disk space for lgpath is not actually
released until the copy-out operation completes.
FILES
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
/tmp/hsm.log
Global log file for the VSM server
SEE ALSO
migconfg(1M), migchecklog(1M), migrc(1M), startmigd(1M)
mignospace(1M)
NAME
mignospace - make disk space available
SYNOPSIS
/usr/openv/hsm/bin/mignospace [-N] [-i | -h] hsmname | file_system
DESCRIPTION
The mignospace command attempts to make space available in the indicated file system.
This command starts in either of two ways:
◆ The administrator executes it directly from the system prompt, from the VSM-Java
interface, or with a crontab entry.
◆ A user attempts to write to the file system when the actual free space is less than the
configured free space.
mignospace purges premigrated file space in a sequence determined by the purge
threshold attributes configured for the file system. The default purge threshold attributes
will purge space for the oldest files first, regardless of size. See migconf(1M).
mignospace starts by checking for premigrated files.
◆ If some premigrated files exist that exceed the purge threshold, mignospace either
purges this premigrated file space to the purgemark percentage and stops or purges
all this premigrated file space and stops, whichever comes first.
◆ If premigrated files exist but none exceed the purge threshold, mignospace cuts the
current the purge threshold in half and exits.
◆ If there are no premigrated files, mignospace cuts the current threshold in half and
selects enough files to increase free space to the freespace parameter percentage.
It then premigrates the selected files, copies them to secondary storage, and
determines if any exceed the purge threshold.
If some premigrated files exceed the purge threshold, mignospace either purges the
file space to the purge mark percentage and stops, or it purges all the file space and
stops, whichever comes first.
If no premigrated files exceed the purge threshold, mignospace cuts the current
purge threshold in half and exits.
migrc and migbatch reset current thresholds and current purge thresholds to their
original dwpath/database/migconf values.
If the migconf file specifies a lowwater value, mignospace selects only enough files to
satisfy lowwater. If lowwater is unspecified, mignospace selects all files meeting the
selection criteria. Files in premigration are not considered free, and files in .migrate are
not used in calculating lowwater.
If the migconf file specifies a purgemark value, mignospace purges only enough
premigrated file space to satisfy purgemark. If purgemark is unspecified, mignospace
purges all premigrated file space. Use the -i option to ignore a specified purgemark
value and purge all premigrated files.
The log for hsmname indicates the action taken by mignospace.
OPTIONS
-N Use accelerated disk space availability. The misweep and migcopy
processes will quit before the threshold is reached in order to free some of
the disk more quickly.
-i Ignore the purgemark and purge all available premigrated file space.
-h Print help information.
hsmname Configured VSM name for the managed file system in which you want to
provide space.
file_system
Full path name of the file system in which you want to provide space.
CAVEATS
◆ Always maintain a sufficient number of VSM-registered tapes, optical platters, or
alternate magnetic disks since mignospace may be started automatically by the
system on low space conditions. See migreg(1M).
◆ The migration daemon migd and device-manager daemon (see ltid(1M)) must be
running and the VSM state must be Active for mignospace to start automatically on
low space conditions.
◆ Some processes spawned by mignospace create large temporary files and there may
not be enough space in the /tmp directory for them. Define the environment variable
TMPDIR to contain the pathname of a directory in a file system that has sufficient
space available.
EXAMPLE
The following example, calls mignospace to increase the space available on the file
system named /mig2 and then on the hsmname alpha.
# mignospace /mig2
# mignospace alpha
FILES
dwpath/database/migconf
Configuration file for managed file systems
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
SEE ALSO
VSM(1M), ltid, migconf(1M), migconfg(1M), startmigd(1M),
migVSMshutdown(1M), migVSMstate(1M), migVSMstartup(1M)
migpolicy(1M)
NAME
migpolicy - specify VSM policy and method to write files to secondary storage
SYNOPSIS
/usr/openv/hsm/bin/migpolicy hsmname inputfile [levelno]
DESCRIPTION
The migpolicy command reads the input file and adds the number of copies and the
destination level to migcopy’s input script. The command is used whenever the
controlling commands migbatch or mignospace are run. The migpolicy command
calls migpolicy.script, which is responsible for filling in fields 5 (volset), 7
(method), 13 (hint), 14 (comment), and 15 (mmlevel) of the input file, and for placing
the altered information on worklists, the names of which are echoed as an exit condition.
(The migpolicy.script file is found in the admincmd directory of
/usr/openv/hsm/bin/.)
Generally, you do not alter migpolicy or use it directly. However, it is possible to
enhance the migpolicy.script to divert specific files to suitable media. You can divert
files by file size, by owner, or by any other distinguishable file characteristic.
You change the behavior migpolicy.script by replacing it with an alternate script.
The file /usr/var/openv/hsm/example/database/sample.migpolicy.script
is a sample replacement that uses the size of a file to determine whether VSM will copy it
to the primary level or to the alternate level.
OPTIONS
hsmname Configured VSM name for the managed file system from which you are
migrating files.
levelno Level number that migpolicy will use. Level number 1 is the primary
level, 2 is the alternate level, and 3-8 are multilevel migration levels.
inputfile List of files to be migrated; its format is similar to a copydb worklist:
0000103A|000003E8|00000000|00000100|0|00000000|ad||
0.92|512|472|/home1/migtie/asd|library|Auto HSM
run|00000001|00000000|
The fields are as follows:
1 2 3 4 5 6 7 8 9
handl|machid|lock|flags|volset|copd|meth|dst_seek|age|
10 11 12 13 14 15 16
size|threshold|path|hint|comment|mmlevel|slevel|
CAVEATS
The migration level specified in migpolicy must be a valid level defined in the
dwpath/database/migconf configuration file.
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/migconf
Configuration file for managed file systems
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
/usr/var/openv/hsm/example/database/sample.migpolicy.script
Sample migpolicy replacement script
/usr/openv/hsm/bin/admincmd/migpolicy.script
Migration policy script currently used
hsmname.copydb.method_name.vol_set_number.hint
VSM work lists
SEE ALSO
VSM(1M), migbatch(1M), migconf(1M), migconfg(1M), mignospace(1M)
migpurge(1)
NAME
migpurge - purge migrated file disk space
SYNOPSIS
/usr/openv/hsm/bin/migpurge filename [filename ...]
/usr/openv/hsm/bin/migpurge -f filelist
DESCRIPTION
The migpurge command purges disk space used by migrated files, which makes some
disk space available immediately. The files are not purged unless copies have been made.
Users can purge files they own; root users can purge any files. For users, the VSM state
must be Active; for root users the state can be Active or Maintenance. The migd migration
daemon must be running.
The system administrator can ensure all migration copies have been made before using
migpurge by running migrc -R hsmname first.
OPTIONS
filename Files to purge; may be a relative path or absolute path. You can specify
multiple files, use standard regular expressions, or use wildcards.
-f filelist Purge the files listed in filelist. The format of filelist is one file name per
line, showing the full pathname of each file or a pathname relative to the
current directory in which migpurge is executed, not the directory in
which the file in the filelist resides. Wildcards are not recognized.
EXAMPLES
The following command purges files listed in the input file purglist.
# migpurge -f purgelist
The following command purges files f4, f5, and f6 in the current working directory.
# migpurge f4 f5 f6
The following command purges all file space in the current working directory that have
file names begin with the string July_15.
# migpurge July_15*
SEE ALSO
VSM(1M), fls(1), migloc(1), mignospace(1M), migrate(1)
migrate(1)
NAME
migrate - request premigration of a file
SYNOPSIS
/usr/openv/hsm/bin/migrate [-F] filename [filename ...]
/usr/openv/hsm/bin/migrate [-F] -f filelist
DESCRIPTION
The migrate command lets users request that VSM migrate a file to secondary storage.
Users can premigrate regular files that they own in VSM-managed file systems if allowed
to use this command. The system administrator must provide the proper permissions
before users can use this command.
All files specified with a single migrate command must be in the same managed file
system. The first file determines that file system.
Use the fls command to determine if a file has been migrated or premigrated.
The migrate command performs only the premigration phase of migration. The files do
not actually migrate to secondary storage until the next time mignospace, migbatch, or
miglow execute. After a file is migrated to secondary storage, accessing it causes VSM to
transparently cache the file back to disk.
If the migrate command is used to premigrate an unmodified cached file for which
enough valid copies already exist in secondary storage, VSM does not recopy the file.
VSM purges the data immediately from disk if the dk method entry for the file does not
exist in the FHDB, otherwise the data is purged later by mignospace. Use the migloc
command to determine whether or not file data was purged; if the file remains in
premigration, migloc will show a dk method entry for the file.
The migrate command creates a list of files in /tmp/migrate_list.pid that meet the
migration file selection criteria. The pid is the process ID of the migrate command that is
executing. This list is of the following form:
age size 0|0|path|machid|handle|
where the third field is a default threshold value of 0, and the fourth field is 0 which
indicates the migration level for premigration. The machid and handle are both 0 if the file
has never migrated before.
OPTIONS
-F Force file migration even if the file is listed in the global stop file or a local
stop file, .migstop. This argument is applicable only to Super Users or
to owners of the file.
filename Files that migrate should migate. May be given as a relative path or
absolute path. You can specify multiple files or use standard regular
expressions. Wildcards are recognized.
-f filelist Migate the files listed in filelist. The format of filelist is one file name per
line, showing either the full pathname of each file or a pathname relative
to the current directory in which migrate is executed, not the directory
in which the file in the filelist resides. Wildcards are not recognized.
CAVEATS
◆ Unless the -F argument is given, migrate will not premigrate any files listed in the
global stop file or in a local stop file, .migstop, unless the stop file is overridden. A
typical error response is as follows:
/ov2/stop/nono found in user stopfile not allowed to migrate
The .migstop file most local to the listed file overrides other stop files higher in the
directory tree. Local control files override global control files if the same file or
directory is listed in both. If the same file is listed in both a .migrate file and a
.migstop file at the same level, the .migrate control file overrides the .migstop
file.
◆ Files whose pathname length exceeds 1023 characters will not be migrated.
◆ For non-root users, this command requires that VSM state be Active and the
migration daemon migd be running. For root users, this command may be run
without regard to the VSM state or whether the migration daemon is running.
EXAMPLES
In the following example, the user requests that VSM migrate a file named tproga.
# migrate /home/gls/tproga
In the following example, the user has a file named migrate_list that contains a list of
files to be migrated, one file per line.
# migrate ‘cat migrate_list‘
The following example uses the find command to select for migration all regular files
under a directory, and then uses fls to check if they are migrated.
# migrate ‘find /home/gls/hawks -type f -print‘
# fls -l /home/gls/hawks
total 94
mr--r--r-- 1 root other 23368 May 9 17:20 osprey
mr--r--r-- 1 root other 23368 May 9 17:21 peregrine
FILES
/usr/var/openv/hsm/database/migrate
Global migrate file for VSM
/usr/var/openv/hsm/database/migstop
Global stop file for VSM
The following output file is created and used by migrate to premigrate files:
/tmp/migrate_list.pid
A list of files in the file system that meet the migration file selection criteria
The pid is the process id of the migrate command that is executing. migrate checks the
environment variable TMPDIR, which allows the administrator to use a path other than
the default /tmp. This can save files through system reboots or make use of a larger file
system to avoid running out of space. The path defined by TMPDIR, if set, is used instead
of /tmp as the directory in which to place any temporary files.
SEE ALSO
VSM(1M), fls(1), migloc(1), migmode(1), migpurge(1)
migrc(1M)
NAME
migrc - VSM restart and cleanup operations
SYNOPSIS
/usr/openv/hsm/bin/migrc [-LRSMh] [-o | -O db_type] [-a age]
hsmname
DESCRIPTION
The migrc command provides a variety of functions. Some are intended to be used when
restarting VSM operations on a managed file system and some are intended to be used as
part of regular VSM operations.
Except for the -L option, this command may be run for file systems in the Active,
Inactive, or Maintenance states. The -L option should only be used on a managed file
system in the Inactive or Maintenance state.
The copy activities initiated by the -R and -M options will continue even after the migrc
command has completed.
OPTIONS
At least one of the options L, R, M, h, o or O must be specified.
-L Clear all locks. This option is intended for use only when restarting VSM
operations for a file system. migrc -L may be called by the
migVSMstartup command for this purpose. migrc -L can only be
used for file systems in Maintenance state.
-R Restart interrupted premigration and migration. Execute migrc -RM
following a system interrupt to ensure that any unfinished migration and
multilevel migration (migmove) work is completed.
-S Activate obsolete and dead FHDB entries of all files with VSM handles.
The -S option requires at least one option to be specified with it. For
example, migrc -R -S HSM1 or migrc -O FHDB -S HSM1.
FHDB dk entries are not activated with migrc -S.
-M Restart interrupted migmove work and FHDB flag updates. Execute
migrc -RM following a system interrupt to ensure that any unfinished
migration and multilevel migration (migmove) work is completed.
-h Print usage information.
Caution You should use the age parameter to specify removing only files that were
obsoleted prior to the last full backup.
hsmname Configured VSM name for the managed file system that you want VSM
to process.
If you do not specify hsmname, migrc performs the selected operation(s)
on all VSM-managed file systems.
CAVEATS
◆ Ensure that a sufficient number of volumes are available for migrations that may
occur when you run migrc. Use migreg to register volumes.
◆ Running migrc resets the current threshold and current purge threshold to their
respective values as specified in migconf.
◆ If using NetBackup in conjunction with VSM, set the age variable for migrc at a
value higher than the longest NetBackup retention period on the managed file
system. Do this by changing the line AGE=7 to AGE=nnn
where nnn is the longest NetBackup retention period.
◆ If MFLAG_OBSOLETE is set, dk entries will stay in the FHDB when migrc is run.
This allows a cached file to be returned to premigration and processed by normal
purge operations. To remove these dk entries and reduce the size of the FHDB, run
migmdclean.
◆ When migrc completes there may still be VSM processes running that migrc has
started.
SEE ALSO
VSM(1M), migconfg(1M), migreg(1M), startmigd(1M), stopmigd(1M),
migVSMshutdown(1M), migVSMstate(1M), migVSMstartup(1M), migactivate(1M)
migrd(1M)
NAME
migrd - VSM request daemon
SYNOPSIS
/usr/openv/hsm/bin/admincmd/migrd
DESCRIPTION
Running migrd as a command starts the migrd request daemon. You must have
super-user privileges to execute this command.
migrd is the VSM request daemon (migrd).
You should ensure that migrd is started as part of your system startup. If migrd is not
running when you run /usr/openv/java/migsa to start VSM-Java, the GUI cannot
connect to the server, and the migsa command fails.
SEE ALSO
VSM(1M), migVSMshutdown(1M), migVSMstate(1M), migVSMstartup(1M)
migreconstruct(1M)
NAME
migreconstruct - Reconstruct lost or deleted migrated files
SYNOPSIS
/usr/openv/hsm/bin/migreconstruct [-v] [-n] [-o] [-p permissions]
[-l out_file | -f | -w in_file] hsmname
DESCRIPTION
The migreconstruct command reconstructs migrated files either when they have been
accidentally deleted or when the file system is damaged beyond repair. (The command
cannot reconstruct files that have not been migrated.) The preferred way to do this is to
restore migrated files from their backup copies, if created previously by NetBackup. If no
backup copies exist, however, use migreconstruct to recover the migrated files.
migreconstruct uses information in the file handle database (FHDB) to do the
reconstruction.
If you are reconstructing a damaged file system, you must first re-initialize the file system.
Use fsck, newfs, or mkfs as necessary. The hsmname.IHAND (inode-to-handle) file
must be removed before starting migd. The path to the managed directory must exist.
And, lastly, the migration/data directories must be created in the managed directory.
The migreconstruct command does not overwrite existing files unless the -o option is
specified. In all other cases, it only reconstructs lost or deleted migrated files.
OPTIONS
The following options and parameters are available with migreconstruct:
-f Reconstructs all files that have an entry in the FHDB. This parameter may
not be used with -l or -w. Default is no files are reconstructed.
-l out_file
Lists in out_file all files that have an entry in the VSM file handle database
(FHDB). Does not reconstruct any of these files. This parameter may not
be used with -f or -w.
Each line in out_file contains the following information:
handle|machid|size|uid|gid|permissions|file_path
The handle and machid fields are in hexadecimal; size, uid and gid are
decimal; and permissions is octal. Default is no out_file.
-n Do not sort FHDB in reverse order. If the FHDB is not sorted in reverse
order, the oldest version of a file will be created. The default is to sort the
FHDB in reverse order.
To restore accidentally deleted files, create proper in_file entries and use
migreconstruct with the -w option.
CAVEATS
◆ migreconstruct requires that the VSM state to be Active or Maintenance.
◆ All directories created by migreconstruct belong to the user of this utility, and take
on whatever permissions are set in the user’s umask. This would normally be root.
◆ migreconstruct will not reconstruct files from method dk.
◆ migreconstruct will reconstruct obsolete migrated files if VSM has not yet
removed their corresponding FHDB entry. Obsolete files are no longer obsolete after
they have been reconstructed.
◆ Moved or renamed migrated files will be reconstructed in their original locations
according to the full path recorded in the FHDB when the files were first migrated.
◆ All reconstructed files will have a 0 slice value.
EXAMPLE
In the following example, all files that have a full path in the FHDB of VSM-managed file
system alpha will be reconstructed and granted default permission 1755.
# migreconstruct -v -f alpha
In the following example, all files in VSM-managed file system openv2 with the path
name /tmp/out_list will be reconstructed.
# migreconstruct -w /tmp/out_list openv2
The file /tmp/out_list contains the following lines:
1861|3e8|105|0|1|1755|/home1/home1/file-23_#
1862|3e8|108|0|1|1755|/home1/home1/file-24_$
1863|3e8|111|0|1|1755|/home1/home1/file-25_%
1864|3e8|114|0|1|1755|/home1/home1/file-26_&
1865|3e8|117|0|1|1755|/home1/home1/file-27_’
This shows the handle machid size uid gid permissions and file_path for the five files to be
reconstructed.
FILES
dwpath/database/FHDB
File handle database
dwpath/database/FNDB
File name database
SEE ALSO
VSM(1M), migin(1M), newfs, fsck, mkfs, pfinit(1M)
migrecycle(1M)
NAME
migrecycle - Reregister an empty volume
SYNOPSIS
/usr/openv/hsm/bin/migrecycle [-h | -a days -v volset -P poolname
-d device -c capacity -s server -u user -l new_label -p
password] hsmname label method
DESCRIPTION
The migrecycle command reregisters an empty, registered VSM volume.
If the volume is not empty, an error is produced without any change in registration. A
volume is considered empty either if it has no FHDB entries for granules or if all FHDB
entries for granules on the volume are marked dead.
The volume is reregistered with the parameters in the VOLDB unless they are specified as
migrecycle options. The volume set, volume pool, device, capacity, server, and the
password may be changed by supplying them on the command line. migrecycle
maintains the volume assignment to the current file system and volume set.
Note When one side of an optical disk is consolidated, the volume entry for that input
volume is not removed from the VOLDB until both sides of that disk are empty.
migrecycle first calls migmdclean -a days -R with the supplied label and method to
remove dead FHDB entries. This is followed by a call to migreg, if the volume is now
empty. migmdclean removes obsolete entries from the FHDB that are at least days old.
Note, that 7 days is the default value for days defaults. For optical disks, migrecycle
trys to recycle both sides of the disk. If migrecycle is asked to alter attributes on an
optical disk, both sides of the disk must be empty before a side is recycled.
VSM always cleans obsolete entries that are days old, even if the volume cannot be
recycled.
After a volume is reregistered, any data previously stored on it can no longer be
recovered.
OPTIONS
The following options and parameters are available with migrecycle:
-a days Select only obsolete FHDB entries aged by days when cleaning the FHDB.
The default value is 7 days.
-v volset Volume set number used to reregister this volume. If not specified, the
volume set number is not changed.
-P poolname
The name of the volume pool if other than the default, HSM.
-d device For recycling ad method volumes, this is the path to the file system. For
recycling ft method volumes, this is the file system path on the remote
volume server.
-c capacity
Capacity of the remote file system for the ft method.
-s server Name of the remote volume server system for ft method.
-u user For the ft method, this is the valid ftp user name on the remote volume
server system.
-p password
For the ft method, this is the name of the server password.
-l new_label
Label used to reregister the volume.
-h Print help information.
hsmname Configured VSM name for the managed file system containing the
database that has an entry for the volume you are recycling.
label This is the name of the label that VSM assigns to the remote file system
for identification. The label is a single line of text in a file named
ID_LABEL that is stored in the remote file system.
method Volume method name. It can be ct, dt, mt, ad, op, or ft. Volumes for the
ow and nb methods cannot be recycled.
Note The nb method will not be supported after the VSM 4.5 release.
If the method is ft, a prompt is issued for the password when the volume
is reregistered.
CAVEATS
◆ When recycling an ft volume, the remote file system must be available so the
ID_LABEL file, if present, can be read.
◆ If one side of a rewritable optical disk (method name op) is empty and the other
contains granules, you can recycle the empty volume but not change its attributes,
and the volume set number remains the same for both sides.
EXAMPLE
In the following example, an mt volume EXB001 is reregistered in volume set 1.
# migrecycle -v 1 alpha EXB001 mt
FILES
dwpath/database/VOLDB
Volume database.
dwpath/database/migconf
Configuration file for the managed file system(s).
SEE ALSO
VSM(1M), migreg(1M), migmdclean(1M)
migreg(1M)
NAME
migreg - Register and label volumes for VSM
SYNOPSIS
/usr/openv/hsm/bin/migreg [-F] [-D] [-P poolname] hsmname
methname volume_set_number volume_name [volume_name]...
/usr/openv/hsm/bin/migreg [-F] hsmname ad volume_set_number
mount_point volume_name [mount_point volume_name]...
/usr/openv/hsm/bin/migreg [-F] [-u user [-p password]] hsmname ft
volume_set_number server_name server_directory capacity
volume_name [server_name server_directory capacity
volume_name]...
/usr/openv/hsm/bin/migreg [-F] hsmname nb volume_set_number
policy_name NB_master NB_client schedule capacity volume_name
[schedule capacity volume_name]...
DESCRIPTION
The migreg command registers and labels volumes for VSM.
For local secondary storage, you can register tapes for use by method names ct, dt, and
mt, or optical disk surfaces for use by method name op or ow. You can also register disk
partitions as alternate magnetic disk volumes for use with method name ad.
Note When using migreg to register and label new, unused tape volumes, it is normal
behavior to receive some routine error messages.
For remote secondary storage, you can register remote file system directory names for use
by method name ft. You can also register disk partitions as alternate magnetic disk
volumes for use with method name ad on remote systems. You can register a NetBackup
policy as a volume for use by method name nb.
Note The migreg command does not register volumes for method name dk.
OPTIONS
The following options and parameters are available with migreg:
Caution Use the -F option with extreme caution, as it may prevent access to files already
migrated to the volume.
volume_name
The name of the volume to be recorded on the volume and in the volume
database VOLDB. For NetBackup volumes, the volume_name is only
recorded in the VOLDB, not on the volume. VSM restricts volume names
to an alphabetic character followed by up to five alphanumeric
characters, and converts all lower case input to upper case.
mount_point
The file system mount point required when registering a volume for use
with method name ad. Make sure the file system is mounted before
registering the volume.
server_name
Name of the remote volume server for ft volumes. This can be the
internet id or number of the server. VSM uses this name on the ftp open
command as the host parameter. It must be a valid ftp host.
server_directory
Absolute pathname of a directory on the host identified by server_name
for use by method name ft. The user must have read and write
permissions to this directory. This can be any directory on the remote
volume server identified by server_name that is not already registered
for VSM.
capacity Capacity, in bytes, of the remote file system or NetBackup volume that is
available for VSM to use for storing migrated files. A value of 0 is
interpreted as unlimited storage capacity.
policy_name
The name of the NetBackup policy.
NB_master
Name of the master NetBackup server for nb volumes. NB_master must
be the first name the server is known by to NetBackup.
Note The nb method will not be supported after the VSM 4.5 release.
NB_client Name used for nb volumes to register the client under NetBackup. It
must be the name used to register the client in the NetBackup policy.
schedule The name of the NetBackup schedule.
CAVEATS
◆ Using the -F option to force write a new label destroys all information that may be on
the volume.
◆ Always use the -F option if the media is already labeled and you wish to reuse the
volume.
◆ The device-manager daemon ltid must be running if you are registering ct, dt, mt,
op or ow method names.
◆ When you register one side of an optical disk, VSM also automatically registers the
other side with the same volume set number. This avoids deadlocks during volume
consolidation and when moving files between migration levels.
◆ If migrating two copies of a file, it is good practice to migrate copy 1 and copy 2 to
different volume sets, such as to ct.1 and ct.2 or to ct.1 and dt.1. This avoids the chance
of losing both copies when a volume is damaged or lost.
◆ To specify a password on the command line with the -p parameter is less secure that
to let the command line prompt for input.
EXAMPLES
The following example for hsmname alpha registers a dlt tape (method name dt) with
the name ARC001, and assigns it to volume set number 2.
# migreg alpha dt 2 ARC001
The following example for hsmname alpha registers three cartridge tapes (method name
ct) with the names CT001, CT002, and CT003, and assigns them to volume set number 0.
Later, when a different ct volume set needs another volume, VSM can assign this tape to
that volume set and re-register it with the new volume set number. Tapes are labeled
when they are needed.
# migreg -D alpha ct 0 CT001 CT002 CT003
The following example for hsmname alpha registers two disk partitions on device names
/dev/dsk01 and /dev/dsk02 as alternate magnetic disk volumes (method name ad)
with the names ARC900 and ARC901, and assigns them to volume set number 4.
# migreg alpha ad 4 /dev/dsk01 ARC900 /dev/dsk02 ARC901
The following example for hsmname alpha attempts to register two sides of optical disk
AB001, but cannot do so because the volume on side B of the platter is already registered.
(VSM had registered side B automatically the first time it had registered side A.)
# migreg alpha op 0 AB001A AB001B
Tape label: AB001B already registered to HSM
The following example for hsmname alpha registers a remote file system directory
(method name ft) at pathname /sdisk3 on server greek2me with the name FTD001,
and assigns it to volume set number 1 with a capacity of 600,000,000 bytes (about 572 MB).
The user name is fred and the password is HsMk2$.
# migreg -u fred -p HsMk2$ alpha ft 1 daneel /sdisk3 \
600000000 FTD001
The following example for hsmname alpha registers NetBackup policy hsmnb on
NetBackup server duo as a NetBackup volume (method name nb), and assigns it to
volume set number 1 with NetBackup schedule sk01 and infinite capacity (0).
# migreg alpha nb 1 hsmnb duo duo sk01 0 NB001
Capacity set to unlimited.
Registered vh_label=NB001 [at hsmnb] as vh_handle=104A
and method= nb
FILES
dwpath/database/VOLDB
Volume database.
dwpath/database/migconf
Configuration file.
SEE ALSO
VSM(1M), migbatch(1M), migconf(1M), migconfg(1M), migdbrpt(1M),
migmdclean(1M), mignospace(1M), migsetdb(1M)
migselect(1M)
NAME
migselect - select volumes for consolidation
SYNOPSIS
/usr/openv/hsm/bin/migselect [-o] hsmname low_high volume_set
method
DESCRIPTION
The migselect command selects a set of volumes for consolidation according to the
percentage of volume usage. The percentage occupancy can have low-range and
high-range values. This utility provides only a model in selecting the volumes and a site
can modify it to meet specific requirements.
The output is of the form label.method.volume_set. migcons accepts this format in a list
of input volumes to consolidate.
Only the system administrator may use this utility.
OPTIONS
-o Causes migselect to base its selection on the percentage of a full
volume that is obsolete. If this parameter is not specified, the selection is
based upon the percentage of a full volume that is both active and
obsolete.
hsmname Configured VSM name for the managed file system containing the
database that has information on these volumes. This parameter is
required.
low_high Volume use expressed as limits of low and high percent (for example,
20.05-30.75). This parameter is required.
volume_set
The name of the volume set to use. This parameter is required.
method Method name under which migselect selects volumes. Allowed values
for method are ad, ct, dt, mt, op, or ow. This parameter is required.
CAVEATS
◆ This command does not select volumes that have the W flag set.
◆ This command ignores dead volumes.
◆ Write overhead on the volume is not considered in choosing the low and high range
values for percent occupancy.
EXAMPLE
The following example selects volumes in ct volume set 1 and ad volume set 1, that have
percentage occupancy between 1 and 10 percent.
# migselect alpha 01.00-10.00 1 ct ad
RAO001.ct.1
GLS002.ad.1
The following example selects cartridge tape volumes less than 20 percent full that are on
volume set 2. The output of migselect is used as input to consolidation (see
migcons(1M)).
# migcons alpha one ct 2 ‘migselect alpha 0.00-20.00 2 ct‘
The following example selects volumes in op volume set 1, that are at least 50 percent
obsolete and consolidates them to op volume set 1.
# migcons alpha one op 1 ‘migselect alpha -o 50.0-100 1 op‘
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/FHDB
File handle database for VSM
dwpath/database/FNDB
File name database for VSM
dwpath/database/VOLDB
Volume database for VSM.
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
SEE ALSO
migconf(1M), migcons(1M), miggetvol(1M), migmdclean(1M), migrecycle(1M)
migsetdb(1M)
NAME
migsetdb - allows you to alter the flags field in the FHDB or the VOLDB
SYNOPSIS
/usr/openv/hsm/bin/migsetdb -F [-a | d | O] [-h hint] [[-m
methname [-L label]] -i worklist_file [-s setlevel] hsmname
migsetdb -F [-a | d | O] [-h hint] [[-m methname [-L label] [-K]]
[-M machid] [-s setlevel] hsmname handle [handle]...
migsetdb -V [-a | C | d | e | f | l | w | R | T] hsmname label
[label]...
migsetdb -V [-u new_user] [-p] hsmname label [label]...
migsetdb -V [-u new_user] [-P password] hsmname label [label]...
migsetdb -V -U user [-P password] hsmname
DESCRIPTION
VSM uses the migsetdb command to select and change the state of the file handle
database (FHDB), the file name database (FNDB), and volume database (VOLDB) entries
automatically. Administrators can also use migsetdb to fix inconsistencies not corrected
by migdbcheck.
An administrator can use migsetdb to perform the following functions:
◆ Mark all FHDB entries as active, obsolete, or dead. Finer granularity may be
used by specifying method, volume label, and level. This also allows only the
last copy found with the finer granularity to be set by VSM.
◆ Mark specific file handle as active, obsolete, or dead. Finer granularity may be
used by specifying method name, volume label, migration level, and -K.
◆ Alter the hint value in FHDB entries for a specific handle. This choice also allows a
subchoice by method and/or level and/or volume. Also allows hint to be set for last
copy found at subchoice.
◆ Alter the hint value in FHDB entries for a specific file handle. This choice allows a
sub-choice by any or any combination of method, level and volume. It also allows the
hint value to be set for the last copy found at method, level, and/or volume.
◆ Alter the flags field in the VOLDB to any valid value for the label(s) specified or
change the only password, only the user name, or both the password and use name,
for the volumes that match the label(s) specified.
◆ Change all passwords for individual users in the VOLDB.
◆ Additionally, the command may be called by migmove to mark all FHDB entries in
the supplied worklist file as active, obsolete, or dead.
migsetdb creates the file /tmp/migsetdb.pid when changing flags on FHDB entries.
For changing users or passwords in the VOLDB, migsetdb creates the file
/tmp/migsetdb-tmp-voldb.pid. However, migsetdb checks the environment
variable TMPDIR, which allows the administrator to use a path other than the default
/tmp. This can save files through system reboots or make use of a larger file system to
avoid running out of space. The path defined by TMPDIR, if set, is used instead of /tmp
as the directory in which to place any temporary files. The process ID of the migsetdb
that is executing replaces pid. No files should be left after successful execution.
This command may be run without regard to the VSM state or whether the migration
daemon migd is running, except that the -L label can only be run in Maintenance state.
OPTIONS
Caution Inappropriate use of migsetdb may make migrated files inaccessible or make
the FHDB inconsistent.
-L label Only change FHDB entities that reference this volume label. This option
can only be run when the VSM state is Maintenance.
-K Set only the flags for the last occurrence of handle that matches with -s
level, -m methodname, and -L label. The -s, -m, and -L are required.
-w Set the flags field of the specified VOLDB entry to write.
-R Set the flags field of the specified VOLDB entry to NDLBLFRC, indicating
that this VOLDB entry needs to be force-labeled.
-T Set the flags field of the specified VOLDB entry to indicate no trailer label
on tape.
-m methname
Set the flags field for FHDB entries with migration level setlevel only if
they match method name methname and either handle or the files
specified in worklist_file. These method names must be defined in the
dwpath/database/migconf configuration file for hsmname. When -m
is not specified, entries at setlevel will be modified without regard to
methname. Specifying -M machid further restricts which FHDB entries
are modified.
-i worklist_file
Set the flags field for FHDB entries with migration level setlevel only for
the files specified in worklist_file. The format of each line of worklist_file is
as follows:
handle|machid|lock|flags|volset|copied|method|dest_seek|
threshold|size|age|path|hint|comment|mmlevel|slevel|
Do not set the flags field for FHDB entries with migration level mmlevel,
where mmlevel is an integer in the range 1 to 8. FHDB flags at mmlevel
will not be obsolete.
-s setlevel
The migration level for which to set FHDB flags, where setlevel is an
integer in the range 0 to 8. VSM logs and outputs a warning message if
setlevel is greater than 8. Specifying -m methname or -M machid further
restricts which FHDB entries are modified. If -s setlevel is not specified,
all levels except 0(dk) are set.
-M machid
Set the flags field for FHDB entries with migration level setlevel only if
they match machine ID machid and handle. When -M is not specified,
entries at setlevel are modified without regard to machid only if they
match handle and all entries for a particular handle have the same
machine ID. VSM skips entries at setlevel that match a particular handle
but have more than one machine ID, and logs an error message advising
you to execute migsetdb with the -M option in order to set the flags field
for the handle in question. Specifying -m methname further restricts
which FHDB entries are modified.
hsmname Configured VSM name for the managed file system containing the
database files you want to alter.
handle Set the flags field for FHDB entries with migration level setlevel only for
the files with file handle handle.
label The volume label of the entry to change in the VOLDB.
-u new_user
Change the user name to new_user for each entry with the volume label
specified by label.
-U user (Change the password at the prompt for all VOLDB entries that match the
user name specified by user.
-p Change the password at the prompt(s) for each entry with the volume
label specified by label.
-P password
Change the password as specified by the password variable on the
command line, rather than at the prompt.
CAVEATS
◆ Using the lower case ‘p’ (-p) option to change the password at a prompt is generally
more secure than using the upper case ‘P’ option ( -P) and specifying the password
as part of the command line.
◆ It is possible to obsolete all entries in the FHDB for any file. This could cause them to
be deleted when migrc is run to consolidate the FHDB, making the files inaccessible.
◆ The migrc command removes all FHDB, FNDB, and VOLDB entries marked dead.
◆ Do not mark entries for method name ad or ft dead; mark them obsolete instead.
This prevents them from being incorrectly removed by migrc. These entries are
correctly removed from the FHDB by migmdclean as it cleans the disk.
EXAMPLES
The following example for hsmname alpha sets the FHDB flags field to the condition
specified in the configuration file migconf for all entries with a migration level of 6.
# migsetdb -F -s 6 alpha
The following example for hsmname beta sets the FHDB flags field to dead for all
entries with method name ct and a migration level of 1.
# migsetdb -Fd -m ct -s 1 beta
The following example for hsmname chi sets the FHDB flags field to obsolete for all
files specified in the worklist file wlst0001 with a migration level of 3 and a mmlevel
other than 3.
# migsetdb -FO -i wlst0001 -s 3 chi
The following example for hsmname gamma sets the VOLDB flags field to dead for all
entries with label FT001.
# migsetdb -Vd gamma FT001
In this case, the VSM log would show a record resembling the following:
03/31 13:56:15 [12]migsetdb[8506]: VOLDB label: FT001 flags=0010
These records indicate the flags are set to dead.
Similarly, the following example for hsmname theta clears the VOLDB flags field for all
entries with label FT001.
# migsetdb -Va theta FT001
In the following example for hsmname omikron, migsetdb is called by migmove.
# migmove -s 5 omikron
In this case, the VSM log would show records resembling the following:
03/11 14:35:49 [15]migsetdb[2810]: fh=3E8ME1035 level=5: flags=08
03/11 14:35:50 [15]migsetdb[2810]: fh=3E8ME1036 level=5: flags=08
03/11 14:35:50 [15]migsetdb[2810]: fh=3E8ME1037 level=5: flags=08
These records indicate the flags are set to dead.
The following example for hsmname xi sets the new user name to km and prompts for a
new password for all entries with label FT001 or FT002.
# migsetdb -Vp -u km xi FT001 FT002
A password is requested and confirmed for each specified volume.
Enter the password for label: FT001 user:km
Reenter the password for label: FT001 user:km
Enter the password for label: FT002 user:km
Reenter the password for label: FT002 user:km
These volumes now list name01 as the new user name in the VOLDB.
The following example for hsmname xi prompts once for a new password for user name
lm.
# migsetdb -V -U lm xi
To change many volumes to a new owner with a single password, you can use the
previous two forms of this command in combination. In the following example for
hsmname xi, the first instance sets the new user name to jn for all entries with the
specified labels, and the second instance prompts once for jn’s new password.
# migsetdb -V -u jn xi VOL1 VOL2 VOL3 VOL4 VOL5 VOL6 VOL7
# migsetdb -V -U jn xi
This avoids repetitive password prompts for each reassigned volume.
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/VOLDB
Volume database
dwpath/database/FHDB
File handle database
dwpath/database/FNDB
File name database for VSM
dwpath/database/migconf
Configuration file for managed file systems
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
/tmp/hsm.log
Global log file for the VSM server
lgpath/hsm.hsmname.log
VSM log file. The term lgpath refers to the path name of the log file for a VSM
managed file system.
SEE ALSO
VSM(1M), migconf(1M), migconfg(1M), migmove(1M), migdbcheck(1M)
migstage(1)
NAME
migstage - cache one or more files before recalling from secondary storage
SYNOPSIS
/usr/openv/hsm/bin/migstage [-w] [-R] pathname [pathname ...]
/usr/openv/hsm/bin/migstage [-w] [-R] -f filelist
A more advanced command synopsis for use by experienced administrators who can
determine expected results is as follows:
/usr/openv/hsm/bin/migstage [-w] [-R] [-c] [-m method] [-n
-levelno] [[-f filelist ] [pathname [pathname ...]]
DESCRIPTION
The migstage command examines a set of files and caches them back to disk. Optionally,
migstage will wait until all of the files have been cached before exiting.
This command lets you cache one or more migrated files before you need to access them
in order to avoid caching delays at the time of access.
The specified files are cached in their entirety, even when partial file caching is enabled.
migstage attempts to optimize the reload operation by grouping all of the files for a
given volume ID and hsmname together.
Generally the VSM state must be Active to stage a file, although a root user can stage files
when VSM is in Maintenance state. The migd migration daemon need not be running.
OPTIONS
-w Specifies that migstage is to wait for all of the files to be cached back to
disk before exiting. The default is to initiate caching and then exit while
caching operations continue in the background.
-R Specifies that if migstage encounters a directory name in a filelist, it will
stage all files in that directory and its subdirectories.
-c Specifes that migstage ignores checksum (crc) errors when caching
files. Normally, caching from tape fails if the crc computed from the data
does not match the crc in the granule header.
When -c is specified, the cache operation succeeds even if the crc check
fails. This option is intended to be used only as a last resort when a file
cannot be recovered the usual way. The file data cached back with the -c
option may not be the originalfile data.
-m method Stage the file from the specified method. The method is one of ad, ct, dt,
mt, op, ow, ft, nb, or dk storage methods.
-n levelno Stage the file from the specified levelno. The levelno is a number from 1 to
8 that is associated with a migration level from which you want the file to
be staged. migstage ignores checksum (crc) errors when caching files.
Normally, when caching a file from tape the cache operation fails if the
crc computed from the data does not match the crc in the granule
header.
pathname Files or directories that migstage should pre-cache. If a directory is
specified, or the -R option was used, all files in the directory and its
subdirectories are cached. May be given as a relative path or absolute
path. You can specify multiple files or directories, or use standard regular
expressions. Wildcards are recognized.
-f filelist Pre-cache the files listed in filelist. The format of filelist is one file name per
line, showing either the full pathname of each file or a pathname relative
to the current directory in which migstage is executed, not the directory
in which the file in the filelist resides. Wildcards are not recognized.
EXAMPLES
1. The following command pre-caches all files in the current directory and its
subdirectories, even if the directory was not migrated as a part of a group.
# migstage -R . &
The prompt returns quickly, and caching continues in the background.
2. The following command stages all files listed in stagelist and waits for all staging
to complete before exiting.
# migstage -w -f stagelist
The file stagelist reads as follows:
/usr/mydir/subdir/f1/*
/usr/yourdir/subdir/f2
3. The following command pre-caches all files whose file names begin with the string
June_23.
# migstage June_23*
SEE ALSO
VSM(1M), fls(1), miggroup(1), migungroup(1), migloc(1), migtie(1)
migtestbadness(1M)
NAME
migtestbadness - allows you to check what effect changing the threshold computation
parameters has on migration operations
SYNOPSIS
/usr/openv/hsm/bin/migtestbadness hsmname pathname [threshold
threshold_formula 2 [lowwater | kilobytes_to_reduce] test_mode
number_of_files]
DESCRIPTION
The migtestbadness command lets you assess the results of configuring different
values for threshold, minimum file age and file size, weighting factors and weight
operators to determine the amount of free space that could be selected during a typical
migration operation.
You can see the graphical results of running such tests by invoking the VSM File System
Analyzer and selecting What If.
Each test of a file system lists the files that have calculated thresholds exceeding the
specified threshold and computes the total file space that could be freed by this operation.
This total file space is recomputed each time migtestbadness is run with different
values for the file system attributes.
By testing different file systems in this way, you can choose the optimum values to use in
VSM configuration.
The values for each migtestbadness option can be customized.
OPTIONS
hsmname The VSM name under which the swept file system is defined.
pathname The directory to sweep. It should be specified as a full absolute path.
threshold The threshold value for this test. Files that exceed this value are identified as
migratable. If not configured, the default value is 30
threshold_formula
All of the threshold criteria to be used in this test. Files that have a
threshold factor greater than this value are identified.
The formula is as follows:
threshold_result=(age_weight (min_age)) weight_operator (size_weight
(min_size))
On the command line, the values are specified in the following order:
EXAMPLES
a. Is the age of the file greater than min_age? If the answer is no, the file is not
selectable. If the answer is yes, the command moves to the next step.
b. Is the size of the file greater than min_size? If the answer is no, the file is not
selectable. If the answer is yes, the command moves to the next step.
c. Calculate the threshold of the file bases on the threshold_formula. Move to the next
step.
d. Is the threshold of the file greater than or equal to result of the threshold_formula?
If the answer is yes, the file is selectable for migration. If the answer is no, the file
is not selectable.
Therefore, if you wanted to select files for migration that are 9 hours old, regardless of
size, the beginning of the migtestbadness command would be as follows for a
managed file system named delta:
# migtestbadness delta /delta 9 0 0 24 0 1
The age_weight is set to 24 because the value for threshold is in hours.
Following the command through its calculation, its sequence to determine that a file is
selectable if it is more than 9 hours old regardless of size, is as follows:
b. min_size will be greater than 0 in this calculation because any existing file is more
than 0 KB, so the file is selectable.
c. (9/24 x 24) +0 =9
The test_mode and number_of_files are not specified and default printing headers
and no limit being set on the number of selectable files.
# migtestbadness sigma_6 /sigma_6 1 1 1 1 1 1 2 4000
age + size = badness pathname
--- ---- ------- --------
1.10 1025 1026 /sigma_6/test1/retrieve_file.1.6713
1.11 1025 1026 /sigma_6/test1/retrieve_file.1.7813
9.04 10 19 /sigma_6/test1/1
9.04 10 19 /sigma_6/test1/2
2.10 100 102 /sigma_6/test1/filler.93.7813
2.10 100 102 /sigma_6/test1/filler.94.7813
2.10 100 102 /sigma_6/test1/filler.95.7813
2.10 100 102 /sigma_6/test1/filler.96.7813
2.10 100 102 /sigma_6/test1/filler.97.7813
1.11 1025 1026 /sigma_6/test1/retrieve_file.1.9805
2.10 100 102 /sigma_6/test1/filler.15.9805
2.10 100 102 /sigma_6/test1/filler.16.9805
2.10 100 102 /sigma_6/test1/filler.17.9805
2.10 100 102 /sigma_6/test1/filler.18.9805
2.10 100 102 /sigma_6/test1/filler.19.9805
2.10 10 12 /sigma_6/test1/filler.20.9805
2.10 10 12 /sigma_6/test1/filler.21.9805
2.10 10 12 /sigma_6/test1/filler.22.9805
2.10 10 12 /sigma_6/test1/filler.23.9805
2.10 10 12 /sigma_6/test1/filler.24.9805
2.10 100 102 /sigma_6/test1/filler.9.10960
selected: 21 files, 4077 Kbytes 3 migrated files 3051
Kbytes
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/migconf
Configuration file for managed file systems
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
SEE ALSO
VSM(1M), migconf(1M
migtie(1)
NAME
migtie - designate the key caching file(s) for a caching group
SYNOPSIS
/usr/openv/hsm/bin/migtie -a | -d groupname file_path [file_path]...
/usr/openv/hsm/bin/migtie -a | -d -h hsmname groupname file_handle
[file_handle]...
/usr/openv/hsm/bin/migtie [-l] hsmname groupname
/usr/openv/hsm/bin/migtie -f -a | -d groupname
DESCRIPTION
The migtie command lets users add, delete, or list key caching files for a caching group. A
caching group is a list of files to be cached together. A caching group file defines this list.
The following steps outline the general rules for migrating files as a group.
2. Choose which files you will designate as key caching files. Use the migtie command
to tie one or more of these key caching files to a caching group file.
Users can use migtie to add, delete, or list only those key caching files which they
own. The command exits if it encounters a key caching file not owned by the
command user.
Whenever a key caching file is cached, all files listed in the caching group file tied to it are
also cached. The key caching file and all files listed in the caching group file are cached in
their entirety, even when partial file caching is enabled.
Files can appear in more than one caching group file, as shown in the examples. A key
caching file may only be tied to one caching group file. A caching group file may list a key
caching file for another caching group.
This command may be run without regard to whether the migd migration daemon is
running, but the VSM state must be Active, unless you have root privileges. Root users
can run the command if the VSM state is Maintenance.
OPTIONS
-a Add key caching files for a caching group.
-d Delete key caching files for a caching group.
-f A file containing a list of pathnames that will be added or deleted.
Note You must use -f if any file names contain white space.
CAVEATS
◆ Creating a caching group file of zero length or one containing relative pathnames can
increase caching activity unnecessarily if used in situations where it is not necessary
to cache entire directories and their subdirectories at one time.
◆ When migtie designates a file to be a key caching file it modifies the comments field
of the file’s FHDB entry. Only files with a FHDB comments field containing “Auto
VSM run” or “User selected” or a term with a dot “.” prefix can be designated to be
key caching files.
◆ If you choose a file to designate as a key caching file while it is still in premigration,
and then cache that file before it has been fully migrated to secondary storage, the
designation will be lost when the file is later re-migrated. Although this is a rare
occurrence, you can ensure that the designation will not be lost by using the migloc
command to verify the migrated status of the file before either initially designating
the file or caching it for the first time.
◆ If you cache the files in a caching group tied to a key caching file before all the copies
of those files have been made, re-migrating the files at a later time will create new file
handles. Execute migtie again for each of these files.
◆ If you change the name or full path of any file listed in a caching group file, caching a
key caching file tied to that caching group file will no longer cache the changed file
unless you modify the caching group file accordingly.
◆ A reference only to the slice portion of a key caching file will not cause the files listed
in the caching group file to be cached.
◆ If a key caching file has not been purged, caching it will not cause the files listed in the
caching group file to be cached.
◆ If the key caching files are renamed after they are included in a caching group, they no
longer work as key caching files.
◆ You must use the -f option if you will use file names with white space in them.
◆ The miggroup command is implemented using a tie group named MigGroup. Using
this same name in your own migtie command will interfere with any current or
future use of miggroup in this file system.
EXAMPLE 1
Create a caching group file in /home/user1/.month_tie for the following caching
group:
/home/usr1/monthly_project/run_project.1
/home/usr1/monthly_project/run_project.2
/home/usr1/monthly_project/data.1
/home/usr1/monthly_project/data.2
/home/usr1/quarterly_project/data
/home/boss/reports/monthly_project/user1/her_input
Designate key caching files for this caching group with the following command:
# migtie -a month_tie /home/usr1/monthly_project/run_project.1 \
/home/usr1/monthly_project/run_project.2
When the user executes either program run_project.1 or run_project.2, VSM will
automatically cache all of the files listed in /home/usr1/.month_tie. Normal read,
write, and execute permissions pertain to these cached files.
If the user accesses only /home/usr1/monthly_project/data.1, which is not a key
caching file, no other files would be cached automatically.
EXAMPLE 2
Create a caching group file in /home/user1/.month_tie for the following caching
group:
monthly_project
quarterly_project/d*
Designate key caching files for this caching group with the following command:
# migtie -a month_tie /home/usr1/monthly_project/run_project.?
When the user executes either program run_project.1 or run_project.2, VSM will
automatically cache all of the files listed in /home/usr1/.month_tie. This includes all
files in the /home/user1/monthly_project directory and its subdirectories as well as
any files or directories beginning with the character d in the /home/user1/quarterly_
project directory.
EXAMPLE 3
Create a caching group file in /home/user1/.quarter_tie for the following caching
group:
/home/usr1/monthly_project/data/output
/home/usr1/quarterly_project/data
/home/boss/reports/monthly_project/user1/her_input
Designate a key caching file for this caching group with the following command:
# migtie -a quarter_tie /home/usr1/quarterly_project/run_project
When the user executes the program run_project, VSM will automatically cache all of
the files listed in /home/usr1/.quarter_tie. Note that the key caching file does not
need to be listed in /home/usr1/.quarter_tie for this to occur.
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/FHDB
File handle database for VSM
dwpath/database/FNDB
File name database for VSM
SEE ALSO
VSM(1M), gethsm(1), migin(1M), miggroup(1), migungroup(1), migstage(1)
migtscan(1M), migopscan(1M)
NAME
migtscan, migopscan - scan tapes or optical volumes for file granules
SYNOPSIS
/usr/openv/hsm/bin/migtscan [-F] [-r] [-b block_size] [-P
pool_name] [-n] [-s] [-t] hsmname volume_label method
/usr/openv/hsm/bin/migopscan [-F] [-r] [-P pool_name] [-n] [-s]
hsmname volume_label method
DESCRIPTION
The migtscan and migopscan commands scan the specified tape (ct, dt, or mt) or
optical platter (op or ow) volume_label. The resulting display contains information about
the volume as a whole and also about each granule on the volume.
When VSM migrates a file to secondary storage, it writes the file as granules. The granule
size is configured for the method name (ct, dt, mt, op, or ow) during VSM configuration.
Each granule on tape also contains FHDB, FNDB, and VOLDB entry information.
The migtscan and migopscan commands create three output files: FHDB.label,
FNDB.label, VOLDB.label, in the dwpath/database directory. The structure of these files
is the same as the FHDB, FNDB, and VOLDB database files. These files may be used to
rebuild the FHDB, FNDB, and VOLDB if they are corrupted or damaged (see
migdbcheck(1M)).
You can sort and merge FHDB.label and FNDB.label files for different volumes to recreate
the FHDB and FNDB. Similarly, merging VOLDB.label files for different volumes can
recreate the VOLDB.
Note When recreating the VOLDB, be sure to merge the VOLDB file in the
/usr/var/openv/hsm/example/database directory to include the entry for
the dk method.
OPTIONS
-F Force scan the volume for VSM granules in case the volume identity is
not in the VOLDB. This parameter is optional. If omitted, the volume
must be registered in the VOLDB. If the volume is registered, VOLDB
scans to the end of the tape (for migtscan) or the end of the platter (for
migopscan), and will not use the VOLDB file count.
-b block_size
This number represents the block size, in bytes, that VSM uses on reads.
The default is the size recorded in the volume label (see below).
-b block_size applies only to migtscan.
-P pool_name
This represents the media pool name that VSM uses. When -F is used, the
default is HSM. When -F is not used, the default is the poolname found in
the volume_label entry in the VOLDB.
-n Do not compress or convert FHDB entries for files found on the volume.
When the -n option is used, no FNDB.label file is produced. This option
is useful for examining what is actually written on the media. The
FHDB.label file produced with the -n option must be run through
migfdbconvert before it can be merged into the real FHDB and FNDB.
-r Read granule data. The default behavior is to skip the reading of granule
data. StorageTek 9840 VolSafe tape drives will scan faster if the this option
is specified.
-t Use values of file and record numbers that were recorded on tape. When
not specified, use actual values. The actual values may differ from the
recorded values in some cases; the actual value is needed for VSM to
cache files correctly.
-t applies only to migtscan.
-s Silently scan the volume and create FHDB.label and VOLDB.label files,
but do not display information on stdout.
hsmname Configured VSM name for the managed file system containing the
database that has information on the desired volume.
volume_label
Tape volume label used when registering the volume. This parameter is
required.
method Method name under which the volume is registered (ct, dt, or mt for
migtscan, and op or ow for migopscan).
CAVEATS
◆ Some tape drives, such as the StorageTek 9840 VolSafe drives, will scan faster if you
specify the -r option.
◆ Results of scanning a tape volume that does not conform to VSM standards are
unknown.
EXAMPLE
The following example uses method mt to scan a tape volume named lostid. The resulting
display shows a list of granule information for files archived on the volume.
The FHDB.lostid and VOLDB.lostid files are created in the VSM database directory.
# migtscan alpha lostid mt
VOLUME LOSTID registered to HSM
VOLUME particulars =====>>
000003E8V00001098 LOSTID mt 09600000 0072DB69 #23
--------------------------
000003E8M00001342 V00001098 mt 00005B8C 00000000 00005B8C
#1 1 #1 1 /home/ckb/ed
000003E8M00001343 V00001098 mt 00005B8C 00000000 00005B8C
#2 1 #2 1 /home/ckb/an
INFO: Found trailer label EOV1
Volume information on the display includes (in order):
Volume handle
Volume label
Method
Total capacity of the volume
Total space in use on the volume
Number of files on the volume.
File granules information on the display includes (in order):
File handle
Volume ID
Method
File size in hex
Offset in hex of the granule in the file
Granule size in hex
Recorded filemark number after which the granule resides
Recorded offset from the file mark to the granule
Computed filemark number after which the granule resides
Computed offset from the file mark to the granule
File name.
The recorded file mark number should equal the computer file mark number. The
recorded offset should equal the computed file mark.
number is the granule number recorded on the tape, and should equal the computed
granule number. The computed granule number is based on the scan of the tape.
Similarly, the recorded file number is the file number recorded on the tape, and should
equal the computed file number.
FILES
The term dwpath refers to the path name of the directory in each managed file system
containing the database and workdir directories.
dwpath/database/FHDB
File handle database for VSM
dwpath/database/FNDB
File name database for VSM
dwpath/database/VOLDB
Volume database for VSM
dwpath/database/migconf
Configuration file for managed file systems
dwpath/database/FHDB.label
File handle database for current volume
dwpath/database/FNDB.label
File name database for current volume. It contains some fields that are moved from
the dwpath/database/FHDB.label
dwpath/database/VOLDB.label
Volume database for current volume
/usr/var/openv/hsm/database/migconfg
Global configuration file for the VSM server
SEE ALSO
migdbcheck(1M), mediacheck(1M), migconf(1M), migconfg(1M), migdbrpt(1M),
migreg(1M), migadscan(1M), migftscan(1M), mignbscan(1M)
migunmigrate(1)
NAME
migunmigrate - completely unmigrate a previously migrated file
SYNOPSIS
/usr/openv/hsm/bin/migunmigrate filename [filename ...]
/usr/openv/hsm/bin/migunmigrate -f filelist
DESCRIPTION
The migunmigrate command lets users request that VSM unmigrate specified files.
Users can unmigrate files that they own only if the system administrator provides the
proper permissions before users can use this command.
Use the fls or migloc command to determine if a file has been migrated or premigrated
and/or cached.
Files can be unmigrated regardless of whether or not they are already cached; however, to
achieve maximum caching performance, you should stage the files with migstage before
unmigrating them.
This command requires an Active VSM state and a running migd migration daemon.
OPTIONS
filename Files that migunmigrate should process. May be given as a relative path
or absolute path. You can specify multiple files or use standard regular
expressions. Wildcards are recognized.
-f filelist Unmigrate the files listed in filelist. The format of filelist is one file name
per line: either the full pathname of each file or a pathname relative to the
directory in which migunmigrate is executed, not the directory in
which the file(s) in the filelist resides. Wildcards are not recognized.
EXIT STATUS
The following exit values are returned:
0 All files were successfully unmigrated.
<0 An error prevented any processing from occurring.
>0 The exit status indicates the number of files for which a problem was
encountered.
SEE ALSO
fls(1), migloc(1), migstage(1)
migVSMshutdown(1M)
NAME
migVSMshutdown - this command shuts down VSM.
SYNOPSIS
/usr/openv/hsm/bin/migVSMshutdown [hsmname]
DESCRIPTION
The migVSMshutdown command shuts down VSM. When you invoke S78hsmveritas,
irixrc.sh, or hpuxrc.sh with the stop option, the script runs migVSMshutdown.
A migVSMshutdown command executes the following VSM processes:
1. migVSMstate -w -s -idle [hsmname] changes the state of each Active file system
to Idle.
2. stopmigd stops migd and migvold. Executed only if no hsmname was specified.
4. HSMKiller hsmname stops all VSM processes. May be executed if migd was not
running or was unable to idle a file system.
OPTIONS
hsmname When specified, this is the specific VSM-managed file system processed
by migVSMshutdown. When not specified, all VSM-managed file
systems are process by migVSMshutdown.
SEE ALSO
VSM(1M), migrc(1M), migrd(1M), migconfg(1M), startmigd(1M), migdbcheck(1M),
mignospace(1M), migVSMstate(1M), migVSMstartup(1M)
migVSMstartup(1M)
NAME
migVSMstartup - starts VSM.
SYNOPSIS
/usr/openv/hsm/bin/migVSMstartup [-D] [-T] [-N] [-C] [hsmname]
DESCRIPTION
The migVSMstartup command starts VSM. When you invoke S78hsmveritas,
irixrc.sh, or hpuxrc.sh with the start option, it runs migVSMstartup. The startup
scripts are installed so that they automatically run when the system boots in multi-user
mode (run level 2)
A migVSMstartupdown command executes the following VSM processes:
3. migrc -L hsmname clears locks within VSM for each hsmname in Maintenance
state.
OPTIONS
-D Run migdbcheck if there appear to be problems. Not run by default.
SEE ALSO
VSM(1M), migrc(1M), migrd(1M), migconfg(1M), startmigd(1M), migdbcheck(1M),
mignospace(1M), migVSMshutdown(1M), migVSMstate(1M)
migVSMstate(1M)
NAME
migVSMstate - changes or displays the state of a VSM managed file system
SYNOPSIS
/usr/openv/hsm/bin/migVSMstate [-s state] [-c] [-w] [-v]
[hsmname]
DESCRIPTION
The migVSMstate command changes or displays the state of hsmname. This command
allows VSM to be gracefully shutdown. Should a system interrupt (such a crash) occur,
migVSMstate is part of recovery during a shutdown and startup.
migVSMstate sets the following states:
◆ Idle: When hsmname is in this state, VSM can mount or unmount the file system. No
other activity is allowed on this file system.
◆ Idling: When hsmname is in this state, VSM can remove files. All VSM processes will
cleanup and terminate. mignospace processing cannot start. Once all VSM activity
has completed, migd will change the state of hsmname to idle. This transitional
state is not set by migVSMstate; a managed file system will go through this state as
part of the process of becoming Idle.
◆ Maintenance: When hsmname is in this state, VSM cannot cache files or start
mignospace processing.
◆ Inactive: When hsmname is in this state, no VSM activity is allowed.
◆ Active: When hsmname is in this state, VSM activity is allowed.
If no option is specified, migVSMstate displays the current state setting.
OPTIONS
-s idle Causes hsmname to start idling down and go into Idle state. If -w was
specified, migVSMstate will not exit until the state becomes Idle.
-s maintenance
Changes hsmname to Maintenance state.
-s active Changes hsmname to Active state.
-s inactive
Changes hsmname to Inactive state. A managed file system cannot go
from Active to Inactive; it must go through Idle or Maintenance state and
then to Inactive.
-s maintenance -c
Places hsmname in the Maintenance state, but only if hsmname was not
correctly shutdown or correctly idled.
-w When used with -s idle, migVSMstate will wait to exit until the state
becomes Idle.
-v Verbose mode messages go to STDOUT or STDERR, as well as the log
files.
hsmname When specified, this is the specific VSM-managed file system processed
by migVSMstate. When not specified, this implies that all
VSM-managed file systems are processed by migVSMstate.
SEE ALSO
VSM(1M), migrc(1M), migrd(1M), migconfg(1M), startmigd(1M), migdbcheck(1M),
mignospace(1M), migVSMshutdown(1M), migVSMstartup(1M)
rebuild_ihand(1M)
NAME
rebuild_ihand - rebuild the VSM IHAND file
SYNOPSIS
/usr/openv/hsm/bin/rebuild_ihand hsmname
DESCRIPTION
The rebuild_ihand command reconstructs a lost or corrupted inode-to-handle
(IHAND) file if the managed file system is intact.
This command will not detect all discrepancies between the file system and the FHDB;
run migdbcheck to do this. You must also stop and restart the migd migration daemon
or send it an INT signal after the IHAND file has been replaced.
The output of rebuild_ihand is a reconstructed IHAND file in
dwpath/database/hsmname.IHAND.pid. To use this reconstructed IHAND file, copy it
to the real IHAND file in dwpath/database/hsmname.IHAND.
The exit status of rebuild_ihand is a count of the number of errors encountered. A zero
status indicates there were no errors. Error messages are written to stderr and to the VSM
logfile.
This command may be run without regard to the VSM state, but the VSM daemons must
not be running.
OPTIONS
hsmname VSM name of the managed file system for which you want to rebuild the
IHAND file.
FILES
The term dwpath refers to the path name of the directory containing the database and
workdir directories. The path name of this directory is site configurable
dwpath/database/hsmname.IHAND
Inode-to-handle file for VSM
dwpath/database/hsmname.IHAND.pid
Reconstructed inode-to-handle file for VSM
SEE ALSO
ihprint(1M)
startmigd(1M)
NAME
startmigd - start the VSM migration, volume, and request daemons
SYNOPSIS
/usr/openv/hsm/bin/startmigd [-m | -r | -v ] [-t time]
DESCRIPTION
The startmigd command starts the VSM migration daemon (migd), the volume daemon
(migvold), and the request daemon (migrd).
You should ensure migd, migvold, and migrd are started as part of system startup. The
startup scripts copied during installation do this for you automatically.
On startup, migd and migrd read the configuration files. If you manually change the
configuration file while the daemons are running, you can stop and restart the daemon so
that they pick up the changes, or you can signal the daemons as follows:
# kill -INT ‘cat /usr/var/openv/hsm/workdir/migd.pid‘
# kill -HUP ‘cat /usr/var/openv/hsm/workdir/migrd.pid‘
If you use VSM-Java to make configuration changes, a signal is automatically sent to migd
and migrd.
OPTIONS
-m Start only the migration daemon (migd).
-r Start only the migration request daemon (migrd)
-v Start only the volume daemon (migvold).
-t time Sets the time interval in seconds that determines the frequency with
which the migd migration daemon checks the high-water mark
threshold. The default is 60.
CAVEATS
◆ You must start the migd migration daemon before you can mount the managed file
systems.
◆ If the migration daemon is not running or the managed file system state is not Active,
migrated files cannot be accessed. If migd stops, you can use the VSM log files to help
determine the cause of failure.
EXAMPLE
The following command starts the migration, volume, and request daemons, with results
similar to those shown:
# startmigd
INFO: VSM request daemon migrd started.
INFO: VSM volume daemon migvold started.
INFO: VSM migration daemon migd started with frequency 60.
FILES
/usr/var/openv/hsm/workdir/migd.pid
The process ID (pid) of the VSM migration daemon (if it is running)
/usr/var/openv/hsm/workdir/migvold.pid
The process ID (pid) of the VSM volume daemon (if it is running).
/usr/var/openv/hsm/workdir/migrd.pid
The process ID (pid) of the VSM request daemon (if it is running).
SEE ALSO
VSM(1M), HSMKiller(1M), migconf(1M), migconfg(1M), stopmigd(1M),
stopmigrd(1m), migVSMshutdown(1M), migVSMstate(1M), migVSMstartup(1M)
stopmigd(1M)
NAME
stopmigd - stop the VSM migration and volume daemons
SYNOPSIS
/usr/openv/hsm/bin/stopmigd [-m | -v]
DESCRIPTION
The stopmigd command stops the VSM migration daemon (migd) and the VSM volume
daemon (migvold). The daemons should only be stopped in the event of a problem.
When VSM is installed, the migration daemon becomes an integral part of the operating
system software on that machine.
The stopmigd command only terminates migd and migvold. Use stopmigrd to stop
the migrd migration request daemon. Use migVSMshutdown to halt all running VSM
processes.
OPTIONS
-m Stop only the migration daemon (migd).
-v Stop only the volume daemon (migvold).
The default is to stop both the VSM migration and volume daemons.
The exit value (n) is the number of daemons stopped.
CAVEATS
◆ If migd is not running, you cannot do the following:
- On Solaris and HP-UX systems, you cannot remove files from the managed file
system.
- Users cannot access migrated files.
- Automatic migrations do not occur when free space is above the high-water
threshold and a user attempts to open a migrated file.
◆ If the migvold volume daemon is not running, users cannot read migrated files from
tape or optical volumes.
◆ Current VSM migration and caching operations run to completion but may leave
incorrect results after stopmigd stops the VSM daemons.
EXAMPLE
The following command stops both the migration and volume daemons, and returns
messages similar to those shown if the daemons were running when the command was
issued:
# stopmigd
INFO: VSM migration daemon migd stopped.
INFO: VSM volume daemon migvold stopped.
FILES
/usr/var/openv/hsm/workdir/migd.pid
The process ID (pid) of the VSM migration daemon (if it is running)
/usr/var/openv/hsm/workdir/migvold.pid
The process ID (pid) of the VSM volume daemon (if it is running)
SEE ALSO
VSM(1M), startmigd(1M), migVSMstartup(1M), migVSMshutdown(1M),
HSMKiller(1M)
stopmigrd(1M)
NAME
stopmigrd - stop the VSM request daemon migrd
SYNOPSIS
/usr/openv/hsm/bin/stopmigrd
DESCRIPTION
The stopmigrd command stops the VSM request daemon (migrd). The daemon should
only be stopped in the event of a problem. When VSM is installed, the migration request
daemon becomes an integral part of the operating system software on that machine.
The stopmigrd command only terminates migrd. Use stopmigd to stop the migd and
migvold daemons. Use migVSMshutdown to halt all running VSM processes.
CAVEATS
◆ If the request daemon is not running, VSM-Java applications cannot connect to the
server.
◆ Some state changes rely on the request daemon to make changes to the global
configuration file. If the request daemon is not running, migVSMstate may not be
able to make a requested state change.
FILES
/usr/var/openv/hsm/workdir/migrd.pid
The process ID (pid) of the VSM request daemon (if it is running)
SEE ALSO
migrd(1M), VSM(1M), migVSMshutdown(1M), migVSMstate(1M),
migVSMstartup(1M), HSMKiller(1M)
VSM(1M)
NAME
VSM - VERITAS Storage Migrator (VSM)
DESCRIPTION
VERITAS Storage Migrator (VSM) increases the amount of file space available to users by
migrating files from a local online managed file system to secondary storage (such as
magnetic tape or another disk) as space is needed in the online file system.
Administrators can schedule migration operations to occur automatically. When properly
configured, VSM selects files for migration based on configurable criteria such as file size
and file age.
When a user accesses a migrated file, it is automatically retrieved from secondary storage
and cached in the online file system. Except for the delay to perform the retrieval, users
and programs are unaware that file migration and retrieval are taking place.
VSM uses directly connected tape, optical disk, or magnetic disk devices as well as
magnetic disk file systems on remote volume servers for secondary storage. Media
Manager provides the interface to the tape and optical storage devices. Support for
large-capacity library devices with robotic access mechanisms eliminates the need for
operator action to either migrate or cache files.
VSM lets you use numerous secondary storage methods: disk file for premigration (dk),
alternate magnetic disk (ad), three tape methods (ct, dt, and mt), two optical disk
methods (op and ow), remote using FTP (ft), and NetBackup (nb). The nb method
migrates files using VERITAS NetBackup.
VSM is able to share storage volumes and devices with other applications like VERITAS
NetBackup through the use of a common Media Manager.
VSM supports multilevel migration. Administrators may configure up to eight migration
levels, and can schedule migrated files to move from one level to another based on
site-specified criteria. With multilevel migration, you can configure and manage
cost-effective storage hierarchies that make best use of your storage equipment
investment.
VSM enables administrators to export migrated files from one managed file system and
import them into another managed file system.
The following sections group VSM commands by function.
migfind(1M)
Determine the full pathname of a file on secondary storage
mignospace(1M)
Purge or migrate files to make disk space available
miglow(1M)
Start mignospace if file system is above high-water mark
MANAGING MEDIA
migreg(1M)
Register and label volumes for VSM
migcons(1M)
Consolidate VSM tape and optical volumes
migselect(1M)
Select volumes for consolidation based on specified criteria
migrecycle(1M)
Reregister an empty volume
migmdclean(1M)
Remove obsolete entries from media
migftscan(1M)
Scan an ft remote volume and reconstruct database entries
MANAGING VSM
ihprint(1M)
Print or alter the IHAND file
rebuild_ihand(1M)
Rebuild the IHAND file from the FHDB
migalter(1M)
Display or alter regions, events, or attributes
migcleanup(1M)
RECOVERING DATA
migreconstruct(1M)
Reconstruct damaged or deleted migrated files
migin(1M)
Restore a file from secondary storage to disk.
USER CONTROLS
fls(1)
List and show migration status of files
gethsm(1)
Display the hsmname for files and directories
migcat(1)
Concatenate and display migrated files without caching them
miggroup(1), migungroup(1)
Group/Ungroup files for migration and caching
migloc(1)
Show location of migrated file
migpurge(1)
Purge a specific file or files
migrate(1)
Premigrate a specific file or files
migstage(1)
Pre-cache files to avoid caching delays
migtie(1)
Designate the key caching file(s) for a caching group
migunmigrate(1)
Request that a migrated file be unmigrated
MANAGING DATABASES
migactivate
Activate FHDB entries for files with obsolete VSM file handles
migdbconvert(1M)
Convert VSM release3.4 or 3.4.1 FHDB to VSM release 4.5 FHDB and FNDB
migdbcheck(1M)
Check the FHDB, FNDB, and/or the VOLDB for consistency with the file system
mediacheck(1M)
Check the media, FHDB, and FNDB for consistency
migsetdb(1M)
Alter the flags field in the FHDB and FNDB or the VOLDB
OBTAINING REPORTS
migadscan(1M)
Provide information on contents of archive disk volumes
migtscan(1M), migopscan(1M)
Provide information on contents of tape or optical volumes
miggetvol(1M)
List volumes in ascending order of percentage utilization
migdbdir(1M)
List global configuration values from migconfg
migdbrpt(1M)
Provide FHDB, FNDB, and VOLDB information on files and volumes
migchecklog(1M)
List the most recent messages from an error log file
migftscan(1M)
Scan an ft remote volume and reconstruct database entries
mignbscan(1M)
Scan a NetBackup volume and reconstruct database entries
TUNING MIGRATIONS
migconsweep(1M)
Enable constant file system sweeping
migtestbadness(1M)
Evaluate configuring different file system attributes
Note Man pages are not available for the above graphical user interfaces.
441
◆ The StorageMigrator resource is included in a group by itself, so that the
Parallel attribute can be set by the user. Doing this allows for active-active
configurations. The following table shows the StorageMigrator Agent and
StorageMigratorFS Agents and resources.
Operations - monitor - Verifies that the VSM daemons (migd, migrd, and,
when applicable, migvold) are running.
- online - Calls migVSMstartup to start the VSM daemons.
- offline - Calls migVSMshutdown to stop the VSM daemons. If any
managed file systems are Active, they are put in Maintenance state.
- clean - Calls migVSMshutdown to stop the VSM daemons.
Detecting Daemon The daemon is considered offline if one of the following applies:
Failure - The daemon.pid file for migd, migrd, or (when applicable)
migvold does not exist or is empty.
- The processes associated with the process IDs listed in the
daemon.pid files do not exist in the /proc directory.
Operations - monitor - Verifies that the managed file system is mounted and
that an entry exists for it in migconfg (the global configuration
file). Also tests for status in the resource.vsm.agent.state file.*
- online - Adds the manged file system entry to the migconfg file,
calls migVSMstartup to start VSM, and sets its state to Active.
Also echoes online to the resource.vsm.agent.state file.*
- offline - Calls migVSMshutdown to idle the managed file
system, echoes offline to the resource.vsm.agent.state file*,
and removes the entry from the migconfg file.
- clean - The same as offline.
Detecting Daemon The managed file system is considered offline if it is mounted and
Failure no entry for it appears in the migconfg file.
Limitations
The following limitations apply to Enterprise Agent for Storage Migrator:
◆ When using Media Manager, the Enterprise Agent for Storage Migrator supports only
active-inactive configurations.
◆ Enterprise Agent for Storage Migrator is tested in a two-node configuration, although
it is designed to work in two- to 32-node configurations.
◆ VSM may not support quick restart for all interruptions.
Installation
Before you begin, make sure you can install, configure, and use VCS and NetBackup
Cluster Server Agent in a configuration. You will need the following resources for using
Enterprise Agent for Storage Migrator:
◆ NetBackup Cluster Agent version 1.3.0, if using locally attached tapes.
Pre-Installation
You need the following before you install the Enterprise Agent for Storage Migrator:
◆ VERITAS Cluster Server software distribution 1.3.0 or 2.0 CD.
◆ NetBackup software distribution 4.5 CD.
◆ VSM version 4.5 CD.
◆ VERITAS Volume Manager (VxVM) 3.1 CD
◆ If using locally attached tapes, NetBackup Cluster Agent 1.3.0 or later.
◆ A shared disk for /usr/openv directory.
◆ Shared disks or file systems for the managed file systems, database and log directories
Installation
▼ On a new system, complete the following steps:
1. Install VERITAS Cluster Server as explained in the Cluster Server Installation Guide.
2. Install VERITAS Volume Manager (VxVM) 3.1 as explained in the Volume Manager
Installation Guide.
Note You must install the Enterprise Agent for NetBackup on each node in the cluster.
6. Install the Cluster Server Agent for Storage Migrator using the same installation script
used for VSM installation. You must have a valid license key.
Note You must install the Cluster Server Agent for Storage Migrator on each node in the
the cluster.
The Enterprise Agent for Storage Migrator contains the following files:
/opt/VRTSvcs/bin/StorageMigrator/StorageMigratorAgent
/opt/VRTSvcs/bin/StorageMigrator/online
/opt/VRTSvcs/bin/StorageMigrator/offline
/opt/VRTSvcs/bin/StorageMigrator/clean
/opt/VRTSvcs/bin/StorageMigratorFS/StorageMigratorFSAgent
/opt/VRTSvcs/bin/StorageMigratorFS/online
/opt/VRTSvcs/bin/StorageMigratorFS/offline
/opt/VRTSvcs/bin/StorageMigratorFS/clean
/etc/VRTSvcs/conf/StorageMigratorTypes.cf
/etc/VRTSvcs/conf/agent_config.sh
General Configuration
To ensure proper failover behavior, configure the Enterprise Agent for Storage Migrator
so that it matches your VSM configuration.
This document describes possible configurations that cover the most common cases. You
need to customize these configurations to suit your needs.
The typical configurations are as follows:
◆ Active-inactive configuration with NetBackup.
◆ Active-inactive configuration with FTP method
Import Files
Before you begin the configuration, import the StorageMigratorTypes.cf file that
contains the type definitions for both the StorageMigrator and
StorageMigratorFS types using hagui, as follows:
5. Click Import.
VSM Configuration
Configure each managed file system (hsmname) as follows:
◆ The managed file system must be shared among nodes in the cluster
◆ VSM databases and logs are shared among nodes in the cluster
Note The managed file system configuration is only done on one node in the cluster.
◆ If it finds that the block devices for the managed file systems are presented by
VERITAS Volume Manager, it creates DiskGroup resources for disk group failover.
The agent_config.sh utility lists systems for which it can configure resources. Selected
systems will have managed file system resources configured. The agent_config.sh
utility will list managed file systems that should be configured for cluster management.
The syntax for agent_config.sh is as follows:
/etc/VRTSvcs/conf/agent_config.sh [-i[o] | -u]
Note You run agent_config.sh only on the node where you configured the managed
file systems.
To configure managed file systems in separate resource groups, which allows the default
active-active configuration, run the following command:
# /etc/VRTSvcs/conf/agent_config.sh -i
To configure managed file systems in one resource group, run the following command:
# /etc/VRTSvcs/conf/agent_config.sh -io
It may be necessary, based on how systems in your cluster are configured, to add
resources and dependencies manually in order to ensure proper failover behavior. Use the
hagrp and harcs commands to show all resources, resource groups, and dependencies
have been created. If any requisite groups, resources, or dependencies were not created,
create them manually as described in “Manual Configuration.”
To unconfigure an existing VSM Cluster Server configuration that was configured by
agent_config, run the following command:
# /etc/VRTSvcs/conf/agent_config.sh -u
Manual Configuration
Before configuring Enterprise Agent for Storage Migrator, determine what file systems
will be configured and their respective attributes.
You need to know the block device of the managed file system.
You also need to know the following, found either in VSM-Java or the migconfg global
configuration file:
◆ The hsmname, which is the name of the VSM managed file system
◆ Database path
◆ Log file path
Ensure that you do the following when you configure:
▼ If any of the file systems, including those containing databases, logs, and managed
file systems, must be shared (exported), configure them with the Share Agent:
2. Configure matching Share resources. The Share PathName is the same as the
MountPoint in the Mount type and StorageMigratorFS type.
PUBLIC NETWORK
/hsm1
/hsm2
FTP SERVER
/db1 cranberry
/db2
/log1
/log2
HP DLT
LIBRARY
3. Select the appropriate configuration option based on your needs, and follow the steps
provided in that section:
- “Manual Active-Inactive Configuration using NetBackup” on page 453.
- “Manual Active-Active Configuration using FTP” on page 450.
Note The configurations in this document are examples. They do not necessarily
represent the only way to configure Enterprise Agent for Storage Migrator.
StorageMigratorFSGroup1
StorageMigratorFS
hsm1
StorageMigratorGroup
Mount db1
Mount log1 StorageMIgrator theDaemons
StorageMigratorFSGroup2
StorageMigratorFS
hsm2
Mount db2
Mount log2
Note Repeat step 2 and step 3 for each managed file system. Set the resource name equal
to the managed file system name and use appropriate resource attributes.
6. Create StorageMigratorFSGroup2:
# hagrp -add StorageMigratorFSGroup2
# hagrp -modify StorageMigratorFSGroup2 SystemList pixie 2 trixie 1
StorageMigratorFSGroup
StorageMigratorFS
hsm1
StorageMigratorGroup
NBUGroup
1. Start VCS:
# hastart -force
Mount openv_mnt (
MountPoint = "/usr/openv"
BlockDevice = "/dev/dsk/c1t2d0s4"
FSType = vxfs
)
NetBackup netBackup (
ServerType = NBUMaster
)
4. If you have not yet done so, import the StorageMigratorTypes.cf file that
contains the type definitions for both the StorageMigrator and
StorageMigratorFS types using hagui, as follows:
e. Click Import.
Note Repeat step 7 and step 8 for each managed file system. Set the resource name equal
to the managed file system name, and use other attributes as appropriate.
StorageMigrator theDaemons (
StorageMigratorFS hsm1 (
HsmName = "hsm1"
MountPoint = "/hsm1"
BlockDevice = "/dev/dsk/c1t2d0s6"
DatabasePath = "/db1/hsm/database/hsm1/"
LogFilePath = "/log1/hsm/logs/hsm1"
)
Mount db1 (
MountPoint = "/db1"
BlockDevice = "/dev/dsk/c1t2d0s5"
FSType = vxfs
)
Mount /log1(
MountPoint = "/log"
BlockDevice = "/dev/dsk/c1t2d0s16"
FSType = vxfs
)
type StorageMigratorFS (
static str LogLevel
static str ArgList[] = { HsmName, MountPoint, BlockDevice,
DatabasePath, LogFilePath }
NameRule = ""
str MountPoint
str BlockDevice
str DatabasePath
str LogFilePath
str HsmName
If you find a handle mismatch on a migrated file after a managed file system has been
failed over to a different node in the cluster, you should synchronize the major numbers in
the /etc/name_to_major file in each of the nodes in the cluster using the haremajor
command.
Read the following cautionary statements to ensure that the Enterprise Agent for Storage
Migrator works smoothly at your site
Caution When a managed file system is under VCS control, always leave its state Active.
Failure to do so will cause the system to fault. If you need to change the state,
use the hagrp command to ensure that the StorageMigratorFSGroup is
offline.
Caution While the resource is online, do not manually unmount file systems managed
and used by the Enterprise Agent for Storage Migrator.
Caution When the Enterprise Agent for Storage Migrator is Active, do not add and
remove entries from VSM global configuration files on any system in the
cluster. The StorageMigratorFS Agent automatically adds and removes entries
as required for configuration.
Caution If you create entries in the /etc/vfstab for the file systems, make sure they
are set so they will not mount at boot. If they mount at boot, there could be
concurrency violations during failover.
Caution Do not share (export) /usr/openv/, VSM databases, or managed file systems
without using the VCS Share resource. If they are shared, the
StorageMigratorFS Agent resources will fail to mount the file systems. See
“General Configuration” on page 445 for more information.
1. Unlink all groups you do not want to take offline from the StorageMigrator
and StorageMigratorFS groups.
3. Remove the resources from the groups and remove the groups themselves.
4. Stop the StorageMigrator and StorageMigratorFS Agents that were started by VCS.
5. Remove the software package VRTSsmvcs by running the pkgrm command. This will
remove the files installed by the installation script.
Getting Help
If you have questions about Enterprise Agent for Storage Migrator, access the website
below:
http://support.veritas.com
461
VSM supports the following sector sizes and capacity combinations on HP-UX, Solaris,
and IRIX:
Supported Optical Media
HP C7988A* 512 9.1GB WriteMany Media Manager can mount this media. VSM
writes to it, but NetBackup does not.
HP C7987A 1024 9.1GB WriteMany Media Manager can mount this media. VSM
writes to it, but NetBackup does not.
HP C7985A 2048 8.6GB WriteMany Media Manager can mount this media. VSM
writes to it, but NetBackup does not.
* See the following HP web site for more information about compatibility for these optical platters:
http://www.products.storage.hp.com/eprise/main/storage/DisplayPages
/compatibility.htm?DataPage=rewritable-disks
HP-UX HP C7985A 2048 8.6GB WriteMany Media Manager can mount this media. VSM
(continued) writes to it, but NetBackup does not.
HP C7986A 2048 8.6GB WriteOnce Media Manager can mount this media. VSM
writes to it, but NetBackup does not.
HP C7983A 4096 9.1GB WriteMany Media Manager can mount this media. VSM
writes to it, but NetBackup does not.
HP C7984A 4096 9.1GB WriteOnce Media Manager can mount this media. VSM
writes to it, but NetBackup does not.
HP C7988A 512 9.1GB WriteMany Media Manager can mount this media. VSM
writes to it, but NetBackup does not.
alternate copy
The second copy of a migrated file. See also primary copy.
alternate level
The migration level that pertains to the second copy of a migrated file. VSM-Java
designates the level for the Alternate copy of a file as Alternate Level: 2 and the multilevel
migration levels associated with it as Alternate Level: 4, and so on. See also primary level.
API
Application Programming Interface. See also DMAPI.
archiving
The process of backing up files and directories to a storage unit and then deleting the
original files and directories.
backup
The process of copying and saving files and directories to storage media.
badness
See threshold, move threshold, and purge threshold. References in this manual to badness have
been changed to threshold, although “badness” is still used in some commands and
scripts. Badness refers to the parameters used for selecting files to be migrated, moved, or
purged.
caching
The process of copying migrated files back to the managed file system for access.
465
caching delay
The length of time an application is blocked after accessing migrated data and before the
data is available online (cached).
concurrent recording
The process of copying data to more than one storage device at the same time. Sometimes
called concurrent stripes.
configured slice
The portion of the front of a file retained on disk for user access even when the file is
completely migrated.
consolidation
See volume consolidation.
ct method
The method name for migrating to STK-9840 technology cartridge tapes (8mm
double-density). VSM-Java refers to this storage method as Tape 2. Densities for storage
methods are configurable.
daemon
A program that runs in the background and performs some task (for example, starting
other programs when they are needed). See migd daemon, migrd daemon, and migvold
daemon.
defragmenting directories
Data in a directory can be grouped, then migrated and cached as a one entity. When you
defragment a directory, you first cache any previously migrated data and then migrate all
data in the directory to a minimal number of tapes. Defragmenting reduces the mount and
search time whenever the grouped directory is cached.
device manager
The part of Media Manager that allocates or deallocates drives based on availability.
directory groups
Directories that have been grouped so its files and those in its subdirectories will be
selected for migration, premigrated, migrated, purged, and cached as one entity.
dk method
The method name used for copies of a file not yet copied to secondary storage. The dk
method is not available as a secondary storage method.
DMAPI
Data Management Application Programming Interface. DMAPI is the interface between
Storage Migrator and the operating system kernel.
dt method
The method name for migrating DLT 7000 technology tapes. VSM-Java refers to this
method as Tape 3. Densities for storage methods are configurable.
dwpath
The pathname of the managed file system directory containing the database and
workdir directories.
effective slice
The variable portion of a migrated file that can be partially cached (copied back) to disk if
partial file caching is enabled.
empty volume
A volume that contains no active or obsolete files. See recycling.
ENOSPC
The error condition indicating there is no space left on a device.
Glossary 467
export
The process of removing migrated files from one managed file system that will be
imported to another managed file system. See also import.
file handle
A unique sequence number that VSM uses to identify migrated files and unmodified
cached files. File handles are stored in the VSM databases for the managed file system.
FHDB
The file handle database. Each managed file system uses a separate file handle database.
The default path name for this file is dwpath/database/FHDB.
FNDB
The file name database. Each managed file system uses a separate file name database. The
default path name for this file is dwpath/database/FNDB.
free space
The space in the managed file system that is open for creating new files.
ft method
The method name for migrating to a remote volume using FTP.
FTP
File Transfer Protocol.
grouped directory
See directory groups.
GUI
Graphical User Interface. The VSM GUI is called VSM-Java.
handle
See file handle.
hierarchy
A managed file system and its migration attributes; used by VSM-Java.
high-water mark
See free space parameter.
hint value
See volume set availability.
HSM
See hierarchical storage management (HSM).
In previous versions of documentation for this product, HSM referred to VERITAS
Storage Migrator. All such references are now VSM server.
HSMDEV entry
The hsmname in the global configuration file that specifies the attributes of a managed file
system.
hsmname
The name of a managed file system. This is usually the same as the file system mount
point. The maximum length is 32 characters.
Glossary 469
IHAND file
The inode-to-handle file, containing inode and handle information about migrated files.
The default path name for this file is dwpath/database/hsmname.IHAND.
import
The process of adding migrated files to one managed file system that previously have
been exported from another managed file system. See also export.
inode
The data structure that defines the existence of a single file.
level, migration
See migration level.
low-water mark
The disk utilization point at which VSM stops selecting migration candidates. This value
is expressed as a percentage of used disk space. If the low-water mark is set to 80, VSM
will stop selecting migration candidates when the managed file system is 80% full.
managed server
See VSM server.
media
The physical tapes, optical disks, or disks upon which data is stored.
Media Manager
The VERITAS software that provides device management and removable media
management of tapes and optical disks. VSM requires Media Manager to operate.
migd daemon
The migration daemon. The default path name for this file is
/usr/openv/hsm/bin/admincmd/migd.
migration
The process of copying files to secondary storage while retaining the file names in the
managed file system and providing access to file data.
migration level
The numbered level associated with the location of a migrated file copy on secondary
storage. The primary level stores the first copy of a file and is required for migration. VSM
has up to eight multilevel migration levels.
migration candidates
The files that VSM determines can be migrated according to predefined selection criteria
configured by the VSM administrator.
migrd daemon
The migration request daemon used for VSM-Java. The default path name for this file is
/usr/openv/hsm/bin/admincmd/migrd.
migvold daemon
The volume daemon. The default path name for this file is
/usr/openv/hsm/bin/admincmd/migvold.
MOTAB
Mount table file. The MOTAB file is used to keep track of all volumes mounted for read
access only. The migvold will create the MOTAB file if it does not exist.
Glossary 471
move threshold
The calculated value for a file that determines whether or not it is selected to be moved
from one migration level to another. Formerly called move badness.
mount point
The location of a file system on a disk that logically connects to a system’s directory
structure. This connection makes the file system available to users and applications. A file
system’s mount point is usually the same as its hsmname, but this is not required.
mt method
The method name for migrating to Sony AIT-2 technology 8 mm tapes. In VSM-Java, this
method is named Tape 1. Densities for storage methods are configurable.
multilevel migration
The process of moving migrated files to and from up to eight migration levels (locations
on secondary storage) with VSM.
nb method
The method name for using NetBackup to make copies of files for migration.
Caution The NetBackup (nb) method will not be supported in the next release of VSM.
Choosing this method will require conversion for the next release.
NetBackup policy
Defines the backup policy for a group of one or more clients that have similar backup
requirements.
NFS
Network File System. A Sun Microsystems client-server application that allows network
access to shared files.
offline storage
Storage media not physically loaded in a storage unit.
ow method
The method name for migrating to optical disk as tape with random seek. The default for
this method is write-once, read many (WORM) optical disk, but the value is configurable.
policies, NetBackup
See NetBackup policy.
premigration
The first step in the migration process, during which files are assigned a file handle and
put on a migration work list.
primary copy
The first copy of a migrated file. See also alternate copy and primary level.
primary level
The migration level that pertains to the first copy of a migrated file. VSM-Java designates
the level for the Primary copy of a file as Primary Level: 1 and the multilevel migration
levels associated with it as Primary Level: 3, and so on. See also alternate level.
pseudodevice
A UNIX device with a /dev entry and a device driver that does not require a real device
for I/O.
purge
The process of deleting files from local disk that have been copied to secondary storage.
Glossary 473
purge candidates
The managed files that have been copied to one or more secondary storage devices and
remain on local disk. VSM can purge these files to manage the configured threshold of free
space in the file system.
purge mark
The disk utilization point at which VSM stops deleting purge candidates. This value is
expressed as a percentage of used disk space. If the purge mark is set to 85, VSM will stop
deleting purge candidates when the managed file system is 85% full.
purge threshold
The calculated value for a migrated file that determines whether or not it is selected to be
purged. Formerly called purge badness.
quota parameter
The maximum number of bytes that each user can restrict from migration.
recycling
The process of recovering wasted space on storage media by reregistering an empty
volume.
remote storage
The storage of migrated files on a remote volume server. See ft method and ad method.
restore
The process of recovering selected files and directories from a previous backup and
returning them to their original directory locations (or to an alternate directory).
secondary storage
Storage of migrated files on storage units connected locally to the managed server.
slice
The configured amount of the front of a migrated file that remains on local disk to enable
rapid access. See also configured slice and effective slice.
storage method
The specification of how migrated files are copied to different migration locations in
secondary storage. A storage method consists of one or more stripes (location parameters).
storage unit
The type of storage device on which VSM or NetBackup stores files. It may be a robotic
device or a single tape drive.
stripe
The set of location parameters used to define a storage method: method name, volume set
number, volume set availability, and pool name. A storage level consists of stripes.
threshold
The calculated value for a file that determines whether or not it is selected to be migrated.
References in this manual to badness have been changed to threshold, although the term
badness is still used in some commands and scripts.
Glossary 475
VOLDB
The VSM volume database, which contains attributes of each volume registered with
VSM. The default path name for this file is dwpath/database/VOLDB
volume
A tape, optical disk, or disk partition that has been registered and labeled.
volume consolidation
The process of moving file data from volumes to be recycled to other volumes and
updating the VSM databases. See also empty volume and recycling.
volume manager
See Media Manager.
volume pool
A group of volumes to be used for one purpose that are protected from access by other
applications and users.
volume set
One or more volumes sharing the same method name and volume set number.
VSM-Java
Graphical user interface to VSM configuration, administration. and management tools.
VSM server
The server on which the managed file systems reside and VSM software executes.
WORM
Write Once, Read Many; the acronym for optical disks or tapes that can be written to one
time and read many times.
477
trade-offs 68 migftscan 335
total file caching 16 miggetvol 339
unmount delay parameter 15 miggroup 341
Capacity migin 346
Advanced Configuration miglicense 348
Wizard 120, 122 migloc 350
Cautions miglow 29, 353
changing the IHAND file 195 migmdclean 354
configuring two drives for two migmove 358
copies 57 mignbexport 363
database directory 49 mignbimport 367
editing VSM databases 232, 251 mignbscan 371
FlashBackup 190 mignewlog 375
forced registration 66 mignospace 377
NetBackup migpolicy 380
backup retention 191 migpurge 30, 382
policy conflicts 190 migrate 30, 383
NFS mount point 3 migrc 386
Partial VSM restore 191 migrd 388
Restore previous VOLDB 190 migreconstruct 389
volume management 202 migrecycle 392
Characters, special migreg 395
supported in VSM 74 migselect 400
Class, NetBackup migsetdb 402
see NetBackup policy migstage 408
Commands migtestbadness 410
gethsm 264 migtie 415
HSMKiller 266 migtscan 419
ihprint 268 migungroup 341
Man pages 261 migunmigrate 423
migactivate 273 migVSMshutdown 424
migadscan 275 migVSMstartup 425
migalter 278 migVSMstate 427
migbatch 24, 281 rebuild_ihand 429
migcat 284 startmigd 430
migchecklog 285 stopmigd 432
migcleanup 288 stopmigrd 434
migconf 290 VSM 435
migconfg 306 Concurrent recording
migcons 310 definition 466
migconsweep 314 example 63
migdbcheck 316 restraints on 64
migdbdir 327 Configuration
migdbrpt 328 Basic Configuration Wizard 103
migfind 333 files
Index 479
managed server 233 see dk method, ad method, ft
Media Manager 21 method
migconf file 49 optical
Oracle see Optical disk
see Oracle archive redo logs Disk file
problem solving 251 storage methods
reports 249 see dk method
space requirements 51 Disk space
volume ENOSPC error
see VOLDB definition 467
Dead data FHDB 50
consolidating volumes 204 management
FHDB flags field 233 overview 22
multilevel migration 32 dk method
recycling volumes 208, 213 definition 467
Dead FHDB entries overview 1
multilevel migration DMAPI
move flags 150 definition 467
dead_man_timeout parameter 121, token 197
123, 124 Documentation
Defragmenting related xxii
directories, definition 466 dt method
Delayed labeling 125 definition 467
Deleted files description 59
reloading 258 overview 1
demand delay parameter dump command
Advanced Configuration backing up standard file
Wizard 121 systems 190
caches 15 backing up VSM databases 190
definition 467 cautions 191
density parameter dwpath
Advanced Configuration definition 467
Wizard 120
E
Device manager
Edit menu
definition 467
VSM-Java 97
Devices
Effective date
storage methods for 58
Scheduling tool 175
Directories
Effective slice
remote volume server 42, 127
definition 467
Directory group
Emergency file space parameters 30
see Directory-level migration
Empty volumes
Directory-level migration 20
definition 467
definition 20, 467
recycling 213
Disk
End of tape flag 119
magnetic
Index 481
checking consistency of 195 configuring 132
considering number of files 48 planning guidelines 73
definition 45 fspath
idle state 197 location 36
inode requirements 48 fstab file
log files 245 updating
making free space on 196 for managed file systems 200
migration thresholds 70 ft method
purge thresholds 80 definition 468
rules for choosing 46 overview 2
space for slice 48 partial file caching 17
mounting FTP
demand delay 467 ft method 2
scans 182 port number 123
unmount delay parameter 475
G
File-handle-sequence file
gethsm command
description 242
man page 264
location 39, 307
GLABEL file 43
rebuilding 255
Global log file
Filenames
file systems in Maintenance
special characters
state 195
supported 74
viewing 244
Files
Global migrate file
disk 1
definition 471
not to migrate 46
Global stop file
remote volume server 42
definition 475
Flags field
gran_size parameter
FHDB 233
description 121, 122, 124
VOLDB 238
Granules
FlashBackup, caution for 190
definition 469
FLUSH file
description 12
definition and use 229
file-handle entries for 49
location 40
Grouped files
FNDB
migration of 171
definition 468
GUI
Free space
see VSM-Java
creating on file systems 196
definition 468 H
file systems 196 Help menu
parameter VSM-Java 101
definition 468 Hierarchy
Free space parameter VSM-Java
default value 73 definition 469
description 22 description 93
migration High-water mark
Index 483
configuring 132 definition 467
default values 70 installation 90
definition 470 overview 21
description 22 shared storage devices 2
planning guidelines 70 terminology used xxiii
mediacheck command
M
fixing the FHDB 251
Macintosh file servers 47
Menus
Magnetic disk
Action
media 1
VSM-Java 100
Maintenance state 8, 193
Configure
Man pages 261
VSM-Java 100
Managed directory
Edit
Oracle archive redo logs 130
VSM-Java 97
Managed file system
File
reports
VSM-Java 97
Reporting Tool 162
File System Analyzer 181
Managed file systems
Help
definition 470
VSM-Java 101
Managed server, definition 2
View
Management tasks
VSM-Java 98
scheduling with VSM-Java 173
VSM-Java 97
Managing VSM 189
Method names
Manuals
definition 471
related xxii
migrating files 58
Media
METHOD1-8
consolidate volumes 208
examples 64
definition 470
name parameters
magnetic disk 1
ct 59
monitoring usage 202
dt 59
moving volumes offline 214
mt 59
not enough tapes available 260
nb 61
optical
op 59
notes on support 461
ow 59
recycling 208
names to use for
registration
magnetic disk storage 58
automatic, tape & optical 12, 203,
NetBackup 58
204
NFS file system 58
releasing tape requests 260
optical disk storage 58
reports 249
remote storage 58
storage methods to use 58
tape storage 58
Media Manager
overview
configuring storage devices 91
METHOD1-2 57
definition xxiii, 470
METHOD3-8 67
device manager
volume set availability
Index 485
optical volume report 250 criteria 76
migpolicy overview 73
example script 42 procedure for planning 76
migpolicy command frequency 54
man page 380 management overview 22
migpolicy script minimum file age
creating work lists 12 planning 74
customizing 227 minimum file size 23
modifying 65 planning 74
template 42 overview 9
migpolicy.script performance 229
changing 42 planning 45
migpurge command policies
man page 382 testing with File System
overview 30 Analyzer 187
Migrate restarting 259
definition 471 scheduling 53, 222
see also Migration see also Migration level
migrate (.migrate) file tape 229
file system sweeps 25 thresholds
rules for creating 218, 219 overview 70
migrate command planning procedure 56
man page 383 time to complete 48, 54
overview 30 with migbatch command 24
Migrate file with miglow command 29
see also Migrate with migrate command 30
see also Migration Migration candidate
Migrate file, global definition 471
file system sweeps 25 Migration levels
location 41 definition 470
migration control 218 see also Migration
Migrated files migrc command
exporting man page 386
definition 468 restarting migrations with 259
Migration migrd command
automatic man page 388
overview 22 migrd daemon
best times for 53 definition 471
control, global 218 starting 89
database report 250 starting and stopping 197
directory level 20 migrd.log
example schedule 54 creating 248
File Browser and 172 migreconstruct command
file selection man page 389
configuring 133 migrecycle command
Index 487
planning 82 cleaning nb volumes 203
overview 31, 33 consolidating volumes 204
volume consolidation 32, 34 FHDB flags field 233
work lists 240 multilevel migration 32
recycling volumes 213
N
Obsolete FHDB entries
nb method
backup retention period 191
defining NetBackup policy for 128
consolidating volumes 204, 207,
definition 472
208, 210
description 61
for modified cached files 14
overview 2
multilevel migration
partial file caching 17
move flags 150
nb volumes
Obsolete flag 122, 123, 124
cleaning 203
Offline storage 214
NetBackup
definition 472
caution for 190
op method
file backup with 190
definition 473
migrated files 191
description 59
nb method 2
overview 1
policy
operator
caution for 190
volume set availability
defining 128
planning 62
requirement for VSM 6
Optical disk
retention, caution for 191
notes on support 461
schedule
op method 1, 59
defining 128
ow method 1, 59
servers 128
write once, read many (WORM) 59
slice value lost 191
Options tree
storage
Scheduling tool 175
nb method 61
Oracle
support of optical disk 461
archive redo log management 151
Next-volume-set files
Oracle archive redo logs
description 242
backup and delete 157
location 39, 307
management 151, 152
NFS (Network File System)
migrating files 157
mount point 3
searching 156
mounted file system
Oracle databases
managing 46
see Oracle archive redo logs
operations 197
ow method
rules for using 3
definition 473
NT
description 59
platform for VSM-Java 90
overview 1
O
P
Obsolete data
Partial file caching
backup retention period 191
Index 489
planning 81 setting preferences 160
partially cached files 20, 80 starting 158
problems with automated 259 Reports, media and database 249
thresholds Restart time window
overview 80 Scheduling tool 175
with File Browser 172 restore command
backing up standard file
Q
systems 190
quota parameter
backing up VSM databases 190
configuring 130
cautions 191
definition 474
Restores
planning 67
definition 474
R Run days
Read ahead Scheduling tool 175
configuring 130
S
explained 18
Scans
rebuild_ihand command
deleting
man page 429
File System Analyzer 188
Recovery operations 9, 195
performing
Recycling
File System Analyzer 182
volumes 208, 213
Schedules
definition 474
backing up VSM databases 190
Redo Logs
component configuration
Oracle
Scheduling tool 175
VSM managmement 151
configuration pane 176
Remote migration
effective date 175
ft method 2
for migrations 53, 222
Remote storage
general options 175
ad method 60
management tasks
definition 474
using VSM-Java 173
nb method 61
migrations 53, 222
Remote volume server
options tree list 175
definition 474
restart time window 175
description 2, 126
restarting tasks 177
shutdown 198
run days 175
Reporting Tool 158
settings
data copied reports 164
Scheduling tool 177
data retrieval (caching) reports 163
summary
data retrieval reports 163
Scheduling tool 178
file and space usage 161
summary of configured tasks 178
lperformance reports 165
time window 175
main window 158
Scheduling tool
managed file system reports 162
configuration pane 176
menus 159
general options 175
performance reports 165
Index 491
multiple 63, 64, 67 used with mignospace command 28
sweep.restart file 25 Time window
Sweeps Scheduling tool 175
file system Timestamp
constant 31 nb method 203
round-robin 25 Tokens, DMAPI 197
Symbolic links 218, 219 Toolbar
VSM-Java 95
T
Total file caching
Tape marks
overview 16
frequency 229
partial file caching trade-offs 68
Tapes
Trailer labels
ct, dt, and mt methods 59
tapes 196
duplicating 215
missing trailer labels 196 U
not enough available 260 UNIX platforms
performance 229 for VSM-Java 90
random seek 1 Unmount
releasing requests 260 managed file systems 196
supported tape methods 1 unmount delay parameter 15, 121, 475
Tasks User operations
restarting overview 5
Scheduling tool 177
V
Templates
vault
database files 42
volume set availability
file-handle database file 42
planning 62
migconf file 42
View menu
migconfg file 41
VSM-Java 98
migsweep.site 42
VOLDB 237
migsweepm.site 42
caution for restoring 190, 254
sample.migpolicy.script 42
definition 476
volume database file 42
description 237
Threshold
fixing 253
file
flags field
examples 77, 78
description 238
formula for 74
multilevel migration 34
selections 134
location 39
site-specified 84, 242
lock file
weighting factors 74
description 242
Thresholds
location 39
definition 475
recovering 255
Time increment
removing entries 214
accelerated file space availability 30,
template 42
69
updating 12
configuring 131
Volume database
Index 493
for purging files 172 move threshold
migrating database archive redo overview 83
logs 157 purge threshold
migrating grouped files 171 overview 81
searching databases 156 threshold formula
see also File Browser, File System overview 75
Analyzer, Reporting Tool, Windows
Scheduling Tool, Managing platforms for VSM-Java 90
Oracle Archive Redo Log Tool Work directory
UNIX platforms supported 90 location 38
View menu 98 Work lists
volume recycling 215 description 240
volume registration 124 multilevel migration 34
overview 12
W
Write Once, Read Many (WORM) 59
Weight operator
definition 476
configuration with VSM-Java 134