Jump to content

Linear Tape-Open: Difference between revisions

From Wikipedia, the free encyclopedia
Browse history interactively
← Previous editNext edit →
Content deleted Content added
VisualWikitext
→Optional technology: WORM is also useful for ransomware protection
Line 406: Line 406:


; [[Magnetic tape data storage#Data compression|Compression]]: The original LTO specification describes a data compression method '''LTO-DC''', also called Streaming Lossless Data Compression (SLDC).<REF name="SLDC"/><REF name="ECMA-321"/> It is very similar to the algorithm ALDC<REF name="ALDC"/> which is a variation of [[Lempel–Ziv–Stac|LZS]]. LTO-1 through LTO-5 are advertised as achieving a "2:1" compression ratio, while LTO-6 and LTO-7,<ref name="lto7lic"/> which apply a modified SLDC algorithm using a larger history buffer, are advertised as having a "2.5:1" ratio. This is inferior to slower algorithms such as [[gzip]], but similar to [[lzop]] and the high speed algorithms built into other tape drives.
; [[Magnetic tape data storage#Data compression|Compression]]: The original LTO specification describes a data compression method '''LTO-DC''', also called Streaming Lossless Data Compression (SLDC).<REF name="SLDC"/><REF name="ECMA-321"/> It is very similar to the algorithm ALDC<REF name="ALDC"/> which is a variation of [[Lempel–Ziv–Stac|LZS]]. LTO-1 through LTO-5 are advertised as achieving a "2:1" compression ratio, while LTO-6 and LTO-7,<ref name="lto7lic"/> which apply a modified SLDC algorithm using a larger history buffer, are advertised as having a "2.5:1" ratio. This is inferior to slower algorithms such as [[gzip]], but similar to [[lzop]] and the high speed algorithms built into other tape drives.
; WORM: New for LTO-3 was [[write once read many]] (WORM) capability. This is normally only useful for legal record keeping. An LTO-3 or later drive will not erase or overwrite data on a WORM cartridge, but will read it. A WORM cartridge is identical to a normal tape cartridge of the same generation with the following exceptions: the cartridge memory identifies it to the drive as WORM, the servo tracks are slightly different to allow verification that data has not been modified, the bottom half of the cartridge shell is gray,<REF name="PVMatrix"/> and it may come with tamper-proof screws.<REF name="LTO 3 WORM"/> WORM-capable drives immediately recognize WORM cartridges and include a unique WORM ID with every dataset written to the tape. There is nothing different about the tape medium in a WORM cartridge.
; WORM: New for LTO-3 was [[write once read many]] (WORM) capability. This is useful for legal record keeping, and for protection from accidental or intentional erasure, for example from [[ransomware]]. An LTO-3 or later drive will not erase or overwrite data on a WORM cartridge, but will read it. A WORM cartridge is identical to a normal tape cartridge of the same generation with the following exceptions: the cartridge memory identifies it to the drive as WORM, the servo tracks are slightly different to allow verification that data has not been modified, the bottom half of the cartridge shell is gray,<REF name="PVMatrix"/> and it may come with tamper-proof screws.<REF name="LTO 3 WORM"/> WORM-capable drives immediately recognize WORM cartridges and include a unique WORM ID with every dataset written to the tape. There is nothing different about the tape medium in a WORM cartridge.
; Encryption: The LTO-4 specification added a feature to allow LTO-4 drives to encrypt data before it is written to tape.<REF name="LTO-4 encryption"/> All LTO-4 drives must be aware of encrypted tapes, but are not required to support the encryption process. All current LTO manufacturers support encryption natively enabled in the tape drives using Application Managed Encryption (AME). The algorithm used by LTO-4 is [[Advanced Encryption Standard|AES]]-[[Galois/Counter Mode|GCM]], which is an authenticated, symmetric block cipher. The same key is used to encrypt and decrypt data, and the algorithm can detect tampering with the data. Tape drives, tape libraries, and backup software can request and exchange encryption keys using either proprietary protocols, or an open standard like [[OASIS (organization)|OASIS]]'s [[Key Management Interoperability Protocol]].
; Encryption: The LTO-4 specification added a feature to allow LTO-4 drives to encrypt data before it is written to tape.<REF name="LTO-4 encryption"/> All LTO-4 drives must be aware of encrypted tapes, but are not required to support the encryption process. All current LTO manufacturers support encryption natively enabled in the tape drives using Application Managed Encryption (AME). The algorithm used by LTO-4 is [[Advanced Encryption Standard|AES]]-[[Galois/Counter Mode|GCM]], which is an authenticated, symmetric block cipher. The same key is used to encrypt and decrypt data, and the algorithm can detect tampering with the data. Tape drives, tape libraries, and backup software can request and exchange encryption keys using either proprietary protocols, or an open standard like [[OASIS (organization)|OASIS]]'s [[Key Management Interoperability Protocol]].
; Partitioning: The LTO-5 specification introduced the partitioning feature that allows a tape to be divided into two separately writable areas, known as partitions. LTO-6 extends the specification to allow 4 separate partitions. The [[Linear Tape File System]] (LTFS) is a self-describing tape format and file system made possible by the partition feature. File data and filesystem [[metadata]] are stored in separate partitions on the tape. The metadata, which uses a standard [[XML schema]], is readable by any LTFS-aware system and can be modified separately from the data it describes. The Linear Tape File System Technical Work Group of the [[Storage Networking Industry Association]] (SNIA) works on the development of the format for LTFS.<REF name="LTFS"/> Without LTFS, data is generally written to tape as a sequence of nameless "files", or data blocks, separated by "filemarks". Each file is typically an archive of data organized using some variation of [[tar (computing)|tar]] format or proprietary container formats developed for and used by backup programs. In contrast, LTFS utilizes an XML-based index file to present the copied files as if organized into directories. This means LTFS-formatted tape media can be used similarly to other removable media ([[USB flash drive]], [[external hard disk drive]], and so on). While LTFS can make a tape appear to behave like a disk, it does not change the fundamentally sequential nature of tape. Files are always appended to the end of the tape. If a file is modified and overwritten or removed from the volume, the associated tape blocks used are not freed up: they are simply marked as unavailable, and the used volume capacity is not recovered. Data is deleted and capacity recovered only if the whole tape is reformatted.{{citation needed|date=October 2015}} In spite of these disadvantages, there are several use cases where LTFS-formatted tape is superior to disk and other data storage technologies. While LTO seek times can range from 10 to 100 seconds, the streaming data transfer rate can match or exceed disk data transfer rates. Additionally, LTO cartridges are easily transportable and the latest generation can hold more data than other removable data storage formats. The ability to copy a large file or a large selection of files (up to 1.5&nbsp;TB for LTO-5 or 2.5&nbsp;TB for LTO-6) to an LTFS-formatted tape, allows easy exchange of data to a collaborator or saving of an archival copy.
; Partitioning: The LTO-5 specification introduced the partitioning feature that allows a tape to be divided into two separately writable areas, known as partitions. LTO-6 extends the specification to allow 4 separate partitions. The [[Linear Tape File System]] (LTFS) is a self-describing tape format and file system made possible by the partition feature. File data and filesystem [[metadata]] are stored in separate partitions on the tape. The metadata, which uses a standard [[XML schema]], is readable by any LTFS-aware system and can be modified separately from the data it describes. The Linear Tape File System Technical Work Group of the [[Storage Networking Industry Association]] (SNIA) works on the development of the format for LTFS.<REF name="LTFS"/> Without LTFS, data is generally written to tape as a sequence of nameless "files", or data blocks, separated by "filemarks". Each file is typically an archive of data organized using some variation of [[tar (computing)|tar]] format or proprietary container formats developed for and used by backup programs. In contrast, LTFS utilizes an XML-based index file to present the copied files as if organized into directories. This means LTFS-formatted tape media can be used similarly to other removable media ([[USB flash drive]], [[external hard disk drive]], and so on). While LTFS can make a tape appear to behave like a disk, it does not change the fundamentally sequential nature of tape. Files are always appended to the end of the tape. If a file is modified and overwritten or removed from the volume, the associated tape blocks used are not freed up: they are simply marked as unavailable, and the used volume capacity is not recovered. Data is deleted and capacity recovered only if the whole tape is reformatted.{{citation needed|date=October 2015}} In spite of these disadvantages, there are several use cases where LTFS-formatted tape is superior to disk and other data storage technologies. While LTO seek times can range from 10 to 100 seconds, the streaming data transfer rate can match or exceed disk data transfer rates. Additionally, LTO cartridges are easily transportable and the latest generation can hold more data than other removable data storage formats. The ability to copy a large file or a large selection of files (up to 1.5&nbsp;TB for LTO-5 or 2.5&nbsp;TB for LTO-6) to an LTFS-formatted tape, allows easy exchange of data to a collaborator or saving of an archival copy.

Revision as of 02:06, 16 January 2022

An LTO-2 cartridge. The outer dimensions are 102.0 × 105.4 × 21.5 mm.
Computer memory and data storage types
General
Volatile
RAM
Historical
Non-volatile
ROM
NVRAM
Early-stage NVRAM
Analog recording
Optical
In development
Historical

Linear Tape-Open (LTO) is a magnetic tape data storage technology originally developed in the late 1990s as an open standards alternative to the proprietary magnetic tape formats that were available at the time. Hewlett Packard Enterprise, IBM, and Quantum control the LTO Consortium, which directs development and manages licensing and certification of media and mechanism manufacturers.

The standard form-factor of LTO technology goes by the name Ultrium, the original version of which was released in 2000 and stored 100 GB of data in a cartridge. The ninth generation of LTO Ultrium was announced in 2020 and can hold 18 TB in a cartridge of the same physical size.

Upon introduction, LTO Ultrium rapidly defined the super tape market segment and has consistently been the best-selling super tape format.[1][2] LTO is widely used with small and large computer systems, especially for backup.

History

IBM Full-Height LTO-2 drive

Half-inch (½-inch, 12.65 mm) magnetic tape on open reels has been used for data storage since the 1950s, with the IBM 7 track. In the mid 1980s, IBM and DEC put this kind of tape into a single reel, enclosed cartridge. Although the physical tape was nominally the same size, the technologies and intended markets were significantly different and there was no compatibility between them. IBM called its format the 3480 (after the 3480, the one product that used it) and designed it to meet the demanding requirements of its mainframe products. DEC originally called theirs CompacTape, but later it was renamed DLT and sold to Quantum Corporation. In the late 1980s, Exabyte's Data8 format, derived from Sony's dual-reel cartridge 8 mm video format, saw some popularity, especially with UNIX systems. Sony followed this success with their own now-discontinued 8 mm data format, Advanced Intelligent Tape (AIT).

By the late 1990s, Quantum's DLT and Sony's AIT were the leading options for high-capacity tape storage for PC servers and UNIX systems. These technologies were (and still are) tightly controlled by their owners. Consequently, there was little competition between vendors and the prices were relatively high.

To counter this, IBM, HP and Seagate formed the LTO Consortium, which introduced a more open format focusing on the same mid-range market segment.[3] Much of the technology is an extension of the work done by IBM at its Tucson lab during the previous 20 years.[4] Initial plans called for two LTO formats to directly compete with these market leaders: Ultrium with half-inch tape on a single reel, optimized for high capacity, and Accelis with 8 mm tape on dual reels, optimized for low latency.

Around the time of the release of LTO-1, Seagate's magnetic tape division was spun off as Seagate Removable Storage Solutions, later renamed Certance, which was subsequently acquired by Quantum.

Generations

File:Lto-ultrium-logo.png
The LTO logo

Despite the initial plans for two form-factors of LTO technology, only Ultrium was ever produced. The other proposed format was Accelis,[5] developed in 1997 for fast access to data by using a two-reel cartridge that loads at the midpoint of the 8 mm wide tape to minimize access time. IBM's (short-lived) 3570 Magstar MP product pioneered this concept. The real-world performance never exceeded that of the Ultrium tape format, so there was never a demand for Accelis and no drives or media were commercially produced. As of 2008, LTO Ultrium was very popular and there were no commercially available LTO Accelis drives or media.[6] In common usage, LTO generally refers only to the Ultrium form factor.

The first generation of Ultrium tapes were going to be available with four types of cartridge, holding 10 GB, 30 GB, 50 GB, and 100 GB. Only the full length 100 GB tapes were produced.[7]

As of 2020, nine generations of LTO Ultrium technology have been made available and three more are planned. Between generations, there are strict compatibility rules that describe how and which drives and cartridges can be used together.

Format LTO-1 LTO-2 LTO-3 LTO-4 LTO-5 LTO-6 LTO-7 Type M (M8)[Note 1] LTO-8 LTO-9 LTO-10 LTO-11 LTO-12
Release date 2000[8] 2003 2005 2007 2010[9] Dec. 2012[10] Dec. 2015[11][12][13] Dec. 2017 Sep. 2020,[14] delayed until late 2021[15] TBA TBA TBA
Native/raw data capacity 100 GB 200 GB 400 GB 800 GB 1.5 TB[16] 2.5 TB[17] 6.0 TB[13][18] 9 TB 12 TB[19] 18 TB[14][16][20] 36 TB[21] 72 TB[21] 144 TB[21]
Compressed capacity 200 GB 400 GB 800 GB 1.6 TB 3.0 TB 6.25 TB 15 TB 22.5 TB 30 TB 45 TB 90 TB 180 TB 360 TB
Max uncompressed speed (MB/s)[18][Note 2] 20 40 80 120 140 160 300[22] 360 400 1,100 TBA TBA
Max compressed speed (MB/s) 40 80 160 240 280 400 750 900 1,000 2,750 TBA TBA
Time to write a full tape at max speed(hh:mm) 1:23 1:51 3:10 4:20 5:33 8:20 9:16 12:30 12:07 TBA TBA
Compression capable? Yes, "2:1" Yes, "2.5:1" Planned, "2.5:1"[20][23]
WORM capable? No Yes No Yes Planned
Encryption capable? No Yes Planned
LTFS capable? No Yes Planned
Max. number of partitions 1 (no partitioning) 2 4 Planned
  1. ^ Previously unused LTO-7 tape, not an independent generation, part of LTO-8 generation. See: Compatibility
  2. ^ Maximum uncompressed speeds valid for full height drives. Half height drives may not attain the same speed. Check manufacturer's specifications.
Comparison of "supertape" capacities, including LTO

Data capacity and speed figures above are for uncompressed data. Most manufacturers list compressed capacities on their marketing material. Capacities are often stated on tapes as double the actual value; they assume that data will be compressed with a 2:1 ratio (IBM uses a 3:1 compression ratio in the documentation for its mainframe tape drives. Sony uses a 2.6:1 ratio for SAIT). See Compression below and the table above.

The units for data capacity and data transfer rates generally follow the "decimal" SI prefix convention (e.g. mega = 106), not the binary interpretation of a decimal prefix (e.g. mega = 220).

Minimum and maximum reading and writing speeds are drive-dependent.

Drives usually support variable-speed operation to dynamically match the data rate flow. This nearly eliminates tape backhitching or "shoe-shining", maximizing overall throughput and device/tape life.[24]

Compatibility

HP Half-Height LTO-2 drive in an enclosure for desktop use

In contrast to other tape technologies, an Ultrium cartridge is rigidly defined by a particular generation of LTO technology and cannot be used in any other way (with the exception of LTO-M8, see below). While Ultrium drives are also defined by a particular generation, they are required to have some level of compatibility with older generations of cartridges. The rules for compatibility between generations of drives and cartridges are as follows:

  • Up to and including LTO-7, an Ultrium drive can read data from a cartridge in its own generation and the two prior generations. LTO-8 drives can read LTO-7 and LTO-8 tape, but not LTO-6 tape.[25][26][27]
  • An Ultrium drive can write data to a cartridge in its own generation and to a cartridge from the one prior generation in the prior generation's format.
  • Some LTO-8 drives may write previously unused LTO-7 tapes with an increased, uncompressed capacity of 9 TB (Type M (M8)).[28] Only new, unused LTO-7 cartridges may be initialized as LTO-7 Type M. Once a cartridge is initialized as Type M it may not be changed back to a 6 TB LTO-7 cartridge. LTO-7 Type M cartridges are only initialized to Type M in an LTO-8 drive. LTO-7 drives are not capable of reading LTO-7 Type M cartridges.[29]
  • An Ultrium drive cannot make any use of a cartridge from a more recent generation.

For example, an LTO-2 cartridge can never be used by an LTO-1 drive and even though it can be used in an LTO-3 drive, it performs as if it were in an LTO-2 drive.

Within the compatibility rules stated above, drives and cartridges from different vendors are expected to be interchangeable. For example, a tape written on any one vendor's drive should be fully readable on any other vendor's drive that is compatible with that generation of LTO.

Core technology

Inside a LTO-2 tape drive

Tape specifications

Generations LTO-1 LTO-2 LTO-3 LTO-4 LTO-5[30] LTO-6[31] LTO-7 LTO-7 Type M (M8)[29] LTO-8[32] LTO-9 LTO-10 LTO-11 LTO-12
Native data capacity 100 GB 200 GB 400 GB 800 GB 1.5 TB[16] 2.5 TB[17][33] 6.0 TB[13][18][33] 9.0 TB 12 TB[18][33] 18 TB[20][23][33][14] 36 TB[21] 72 TB[21] 144TB[21]
Tape length 609 m 680 m 820 m 846 m[34] 960 m 1035 m[35]
Tape width 12.650 mm ± 0.006 mm
Tape thickness 8.9 µm 8 µm 6.6 µm 6.4 µm 6.4 µm[31] or 6.1 µm (BaFe)[36] 5.6 µm 5.2 µm[37]
Magnetic pigment material Metal Particulate (MP) MP or BaFe[38] BaFe[39][37]
Base material Polyethylene naphthalate (PEN)
Data bands per tape 4
Wraps per band 12 16 11 14 20[16] 34 28 42 52
Tracks per wrap (read/write elements) 8 16[16][40] 32[13] 32 (TMR) 32[37]
Total tracks 384 512 704 896 1,280 2,176[40] 3,584 5,376 6,656 8,960[37]
Linear density (bits/mm) 4,880 7,398 9,638 13,250 15,142[41] 15,143[42] 19,094[43] 19,104 20,668
Encoding RLL 1,7 RLL 0,13/11; PRML RLL 32/33; PRML 32/33 RLL NPML[42]
End-to-end passes required to fill tape 48 64 44 56 80 136 112 168 208
Expected tape durability (end-to-end passes) 9,600[44] 16,000[44] 16,000[44] 11,200[44] 16,000[44] 20,000

Physical structure

ADIC Scalar 100 tape library interior

LTO Ultrium tape is laid out with four wide data bands sandwiched between five narrow servo bands. The tape head assembly, that reads from and writes to the tape, straddles a single data band and the two adjacent servo bands. The tape head has 8, 16, or 32 data read/write head elements and 2 servo read elements. The set of 8, 16, or 32 tracks are read or written in a single, one-way, end-to-end pass that is called a "wrap". The tape head shifts laterally to access the different wraps within each band and also to access the other bands.

Writing to a blank tape starts at band 0, wrap 0, a forward wrap that runs from the beginning of the tape (BOT) to the end of the tape (EOT) and includes a track that runs along one side of the data band. The next wrap written, band 0, wrap 1, is a reverse wrap (EOT to BOT) and includes a track along the other side of the band. Wraps continue in forward and reverse passes, with slight shifts toward the middle of the band on each pass. The tracks written on each pass partially overlap the tracks written on the previous wrap of the same direction, like roof shingles. The back and forth pattern, working from the edges into the middle, conceptually resembles a coiled serpent and is known as linear serpentine recording.

When the first data band is filled (they are filled in 3, 1, 0, 2 order across the tape), the head assembly is moved to the second data band and a new set of wraps is written in the same linear serpentine manner. The total number of tracks on the tape is (4 data bands) × (11 to 52 wraps per band) × (8, 16, or 32 tracks per wrap). For example, an LTO-2 tape has 16 wraps per band, and thus requires 64 passes to fill.

Logical structure

IBM 3584 tape library with LTO-1 (Ultrium) tapes visible

Since LTFS is an open standard, LTFS-formatted tapes are usable by a wide variety of computing systems.

The block structure of the tape is logical so interblock gaps, file marks, tape marks and so forth take only a few bytes each. In LTO-1 and LTO-2, this logical structure has CRC codes and compression added to create blocks of 403,884 bytes. Another chunk of 468 bytes of information (including statistics and information about the drive that wrote the data and when it was written) is then added to create a "dataset". Finally error correction bytes are added to bring the total size of the dataset to 491,520 bytes (480 KiB) before it is written in a specific format across the eight heads. LTO-3 and LTO-4 use a similar format with 1,616,940-byte blocks.[45]

The tape drives use a strong error correction algorithm that makes data recovery possible when lost data is within one track. Also, when data is written to the tape it is verified by reading it back using the read heads that are positioned just "behind" the write heads. This allows the drive to write a second copy of any data that fails the verify without the help of the host system.

Positioning times

While specifications vary somewhat between different drives, a typical LTO-3 drive will have a maximum rewind time of about 80 seconds and an average access time (from beginning of tape) of about 50 seconds.[46][dead link] Because of the serpentine writing, rewinding often takes less time than the maximum. If a tape is written to full capacity, there is no rewind time, since the last pass is a reverse pass leaving the head at the beginning of the tape (number of tracks ÷ tracks written per pass is always an even number).

Durability

LTO tape is designed for 15 to 30 years of archival storage.[47][48] If tapes are archived for longer than 6 months they have to be stored at a temperature between 16 to 25°C (61 to 77°F) and between 20 – 50% RH.[49][50] Both drives and media should be kept free from airborne dust or other contaminants from packing and storage materials, paper dust, cardboard particles, printer toner dust etc.[49]

Depending on the generation of LTO technology, a single LTO tape should be able to sustain approximately 200-364 full file passes.[44] There is a large amount of lifespan variability in actual use. One full file pass is equal to writing enough data to fill an entire tape and takes between 44 and 208 end-to-end passes. Regularly writing only 50% capacity of the tape results in half as many end-to-end tape passes for each scheduled backup, and thereby doubles the tape lifespan. LTO uses an automatic verify-after-write technology to immediately check the data as it is being written,[51][52] but some backup systems explicitly perform a completely separate tape reading operation to verify the tape was written correctly. This separate verify operation doubles the number of end-to-end passes for each scheduled backup, and reduces the tape life by half.

Optional technology

The original release of LTO technology defined an optional data compression feature. Subsequent generations of LTO have introduced new optional technology, including WORM, encryption, and partitioning features.

Compression
The original LTO specification describes a data compression method LTO-DC, also called Streaming Lossless Data Compression (SLDC).[53][54] It is very similar to the algorithm ALDC[55] which is a variation of LZS. LTO-1 through LTO-5 are advertised as achieving a "2:1" compression ratio, while LTO-6 and LTO-7,[13] which apply a modified SLDC algorithm using a larger history buffer, are advertised as having a "2.5:1" ratio. This is inferior to slower algorithms such as gzip, but similar to lzop and the high speed algorithms built into other tape drives.
WORM
New for LTO-3 was write once read many (WORM) capability. This is useful for legal record keeping, and for protection from accidental or intentional erasure, for example from ransomware. An LTO-3 or later drive will not erase or overwrite data on a WORM cartridge, but will read it. A WORM cartridge is identical to a normal tape cartridge of the same generation with the following exceptions: the cartridge memory identifies it to the drive as WORM, the servo tracks are slightly different to allow verification that data has not been modified, the bottom half of the cartridge shell is gray,[56] and it may come with tamper-proof screws.[57] WORM-capable drives immediately recognize WORM cartridges and include a unique WORM ID with every dataset written to the tape. There is nothing different about the tape medium in a WORM cartridge.
Encryption
The LTO-4 specification added a feature to allow LTO-4 drives to encrypt data before it is written to tape.[58] All LTO-4 drives must be aware of encrypted tapes, but are not required to support the encryption process. All current LTO manufacturers support encryption natively enabled in the tape drives using Application Managed Encryption (AME). The algorithm used by LTO-4 is AES-GCM, which is an authenticated, symmetric block cipher. The same key is used to encrypt and decrypt data, and the algorithm can detect tampering with the data. Tape drives, tape libraries, and backup software can request and exchange encryption keys using either proprietary protocols, or an open standard like OASIS's Key Management Interoperability Protocol.
Partitioning
The LTO-5 specification introduced the partitioning feature that allows a tape to be divided into two separately writable areas, known as partitions. LTO-6 extends the specification to allow 4 separate partitions. The Linear Tape File System (LTFS) is a self-describing tape format and file system made possible by the partition feature. File data and filesystem metadata are stored in separate partitions on the tape. The metadata, which uses a standard XML schema, is readable by any LTFS-aware system and can be modified separately from the data it describes. The Linear Tape File System Technical Work Group of the Storage Networking Industry Association (SNIA) works on the development of the format for LTFS.[59] Without LTFS, data is generally written to tape as a sequence of nameless "files", or data blocks, separated by "filemarks". Each file is typically an archive of data organized using some variation of tar format or proprietary container formats developed for and used by backup programs. In contrast, LTFS utilizes an XML-based index file to present the copied files as if organized into directories. This means LTFS-formatted tape media can be used similarly to other removable media (USB flash drive, external hard disk drive, and so on). While LTFS can make a tape appear to behave like a disk, it does not change the fundamentally sequential nature of tape. Files are always appended to the end of the tape. If a file is modified and overwritten or removed from the volume, the associated tape blocks used are not freed up: they are simply marked as unavailable, and the used volume capacity is not recovered. Data is deleted and capacity recovered only if the whole tape is reformatted.[citation needed] In spite of these disadvantages, there are several use cases where LTFS-formatted tape is superior to disk and other data storage technologies. While LTO seek times can range from 10 to 100 seconds, the streaming data transfer rate can match or exceed disk data transfer rates. Additionally, LTO cartridges are easily transportable and the latest generation can hold more data than other removable data storage formats. The ability to copy a large file or a large selection of files (up to 1.5 TB for LTO-5 or 2.5 TB for LTO-6) to an LTFS-formatted tape, allows easy exchange of data to a collaborator or saving of an archival copy.

Cartridges

LTO-2 cartridge with the top shell removed, showing the internal components. Top right corner: tape access gate. Bottom left corner: write-protect-tab. Bottom right corner: cartridge memory chip

As of 2019, only Fujifilm and Sony continue to manufacture current LTO media.[60]

Compliance-verified licensed manufacturers of LTO technology media at one time were EMTEC, Imation, Fujifilm, Maxell, TDK, and Sony.[61] All other brands of media are manufactured by these companies under contract. Since its bankruptcy in 2003, EMTEC no longer manufactures LTO media products. Imation ended all magnetic tape production in 2011,[62] but continued making cartridges using TDK tape. They later withdrew from all data storage markets, and changed their name to Glassbridge Enterprises in 2017. TDK withdrew from the data tape business in 2014.[63] Verbatim[64] and Quantegy[65] both licensed LTO technology, but never manufactured their own compliance-verified media. Maxell also withdrew from the market.

In addition to the data cartridges, there are also Universal Cleaning Cartridges (UCC), which work with all drives.

Dimensions

All formats use the same cartridge dimensions, 102.0 × 105.4 × 21.5 mm.[66]

Memory

LTO cartridge memory

Every LTO cartridge has a cartridge memory chip inside it. It is made up of 511, 255, or 128 blocks of memory, where each block is 32 bytes for a total of 16 KiB for LTO-6 to 8; 8 KiB for LTO-4 and 5; and 4 KiB on LTO-1 to 3 and cleaning cartridges.[67] This memory can be read or written, one block at a time, via a non-contacting passive 13.56 MHz RF interface. This memory is used to identify tapes, to help drives discriminate between different generations of the technology, and to store tape-use information. Every LTO drive has a cartridge memory reader in it. The non-contact interface has a range of 20 mm.[68] External readers are available, both built into tape libraries and PC based. One such reader, Veritape, connects by USB to a PC and integrates with analytical software to evaluate the quality of tapes.[69] This device is also rebranded as the Spectra MLM Reader[70] and the Maxell LTO Cartridge Memory Analyzer.[71] Proxmark3 and other generic RFID readers are also able to read data.[72]

Labels

An example of an LTO-6 label

The LTO cartridge label in library applications commonly uses the bar code symbology of USS-39.[73][74] A description and definition is available from the Automatic Identification Manufacturers (AIM) specification Uniform Symbol Specification (USS-39) and the ANSI MH10.8M-1993 ANSI Barcode specification.

Leader pin

Leader pin on the end of a length of LTO tape

The tape inside an LTO cartridge is wound around a single reel. The end of the tape is attached to a perpendicular leader pin that is used by an LTO drive to reliably grasp the end of the tape and mount it in a take-up reel inside the drive. Older single-reel tape technologies, such as 9 track tape and DLT, used different means to load tape onto a take-up reel. When a cartridge is not in a drive, the pin is held in place at the opening of the cartridge with a small spring. A common reason for a cartridge failing to load into a drive is the misplacement of the leader pin as a result of the cartridge having been dropped. The plastic slot where the pin is normally held is deformed by the drop and the leader pin is no longer in the position that the drive expects it to be.

Erasing

The magnetic servo tracks on the tape are factory encoded. Using a bulk eraser, degaussing, or otherwise exposing the cartridge to a strong magnetic field, will erase the servo tracks along with the data tracks, rendering the cartridge unusable. Erasing the data tracks without destroying the servo tracks requires special equipment. The erasing head used in these erasers has four magnetic poles that match the width and the location of the data bands. The gaps between the poles correspond to the servo tracks, which are not erased. Tapes erased by this equipment can be recorded again.[75]

Cleaning

Internal head cleaning brush from an IBM LTO-2 FH drive. Swipes once for every insert and eject

Although keeping a tape drive clean is important, normal cleaning cartridges are abrasive and frequent use will shorten the drive's lifespan. LTO drives have an internal tape head cleaning brush that is activated when a cartridge is inserted. When a more thorough cleaning is required the drive signals this on its display and/or via Tape Alert flags.[76] Cleaning cartridge lifespan is usually from 15 to 50 cleanings. There are 2 basic methods of initiating a cleaning of a drive: robot cleaning and software cleaning. In addition to keeping the tape drive clean, it is also important to keep the media clean. Debris on the media can be deposited onto drive components that are in contact with the tape. This debris can result in increased media wear which generates more debris. Removing excessive debris from tape can reduce the number of data errors. Cleaning of the media requires special equipment.[77] These cleaners are also used by Spectra Logic to clean new media that is marketed as "CarbideClean" media.[78] HP LTO Gen.1 drives have a cleaning strategy[79] that will prevent the drive from using the cleaning tape if it is not needed. In a change of strategy, HP LTO Gen 2, 3 and 4 drives will always clean when a Universal Cleaning Cartridge is inserted, whether the drive requires cleaning or not.[79]

Mechanisms

As of 2019, compliance-verified licensed manufacturers of current LTO technology mechanisms are IBM, Hewlett-Packard, and Quantum,[80] although both Hewlett Packard and Quantum have stopped new development of drive mechanisms.[81] The mechanisms, also known as tape drives or streamers, are available in Full-height and Half-height form factors. These drives are frequently packaged into external desktop enclosures or carriers that fit into a robotic tape library.

Sales and market

LTO sales peaked at about 800,000 units in 2008

In the course of its existence, LTO has succeeded in completely displacing all other low-end/mid-range tape technologies such as AIT, DLT, DAT/DDS, and VXA. And after the exit of Oracle StorageTek T10000 of the high-end market, only the IBM 3592 series is still under active development.[citation needed] LTO also competes against hard disk drives (HDDs), and its continuous improvement has prevented the predicted "death of tape" at the hands of disk.[82]

The presence of five certified media manufacturers and four certified mechanism manufacturers for a while produced a competitive market for LTO products. However, as of 2019, there are only two manufacturers developing media, Sony and Fuji, and only IBM is developing mechanisms.

The LTO organization publishes annual media shipments measured in both units and compressed capacity. In 2017, a record 108,457 petabytes (PB) of total tape capacity (compressed) shipped, an increase of 12.9 percent over the previous year.[83] Cartridge unit shipments decreased to about 18 million units down from a peak of about 27 million units in 2008.[84]

Public information on tape drive sales is not readily available. Unit shipment peaked at about 800,000 units in 2008, but have declined since then to about 400,000 units in 2010,[85] and to less than 250,000 by the end of 2018[86]

As HDD prices have dropped, disk has become cheaper relative to tape drives and cartridges. As of 2019, at any capacity, the cost of a new LTO tape drive plus one cartridge is much greater than that of a new HDD of the same or greater storage capacity. However, most new tape cartridges still have a lower price per gigabyte than HDDs, so that at very large subsystem capacities, the total price of tape-based subsystems can be lower than HDD based subsystems, particularly when the higher operating costs of HDDs are included in any calculation.[87]

Tape is also used as "offline" copy, which can be protection against ransomware that cipher or delete data (e.g. tape is pulled out of the system in library, blocked from writing after making copy or using WORM technology). In 2019, many businesses used tape for backup and archiving.[88][89]

See also

References

  1. ^ "Super tape drive shipments double in" (PDF). Archived from the original (PDF) on 2005-03-06. Retrieved 2013-03-29.
  2. ^ "New Freeman Study Projects Major Shifts In Compact Tape — Industry Growth In Units, Revenue Seen" (PDF). Archived from the original (PDF) on 2005-03-06. Retrieved 2013-03-29.
  3. ^ "HP, IBM, And Seagate Agree to Establish Open Format Specifications for Enterprise and Network Storage" (Press release). LTO. November 4, 1997. Archived from the original on 2006-11-13. Retrieved 2007-10-15.
  4. ^ "IBM storage history". IBM. 23 January 2003. Retrieved 2013-03-29.
  5. ^ "Advanced Research, Exabyte, Matsushita, Mitsumi Electric and Otari License Linear Tape-Open Technology". Archived from the original on 2016-01-08. Retrieved 2013-03-29.
  6. ^ "What Happened to Accellis?". Enterprise storage forum. 2002-09-11. Retrieved 2013-03-29.
  7. ^ "Cartouches Ultrium" (EMTEC site offering LTO-1 tape cartridges in multiple sizes) (in French). RPS data. 2005-05-09. Archived from the original on 2005-05-09. Retrieved 2013-03-29.
  8. ^ "Linear Tape-Open Program Ships One Million Ultrium Tapes in First 12 Months of Availability for market" (PDF) (Press release). LTO. November 5, 2001. Archived from the original (PDF) on March 6, 2004.
  9. ^ "LTO-5 expected in H1 2010 with 1.6 TB–3.2 TB storage". Geekzone.co.nz:80. Retrieved 2013-03-29.
  10. ^ from Quantum and Tandberg, Bechtle Direct catalog 09/2012, p. 450
  11. ^ "Quantum LTO-7 HH SAS internes Laufwerk (TC-L72AN-BR)". Retrieved 2015-12-27.
  12. ^ Signoretti, Enrico (2015-09-21). "LTO-7 has it taped, but when will 'bigger/faster' thinking hit the buffers?". The Register. Retrieved 2015-09-24.
  13. ^ a b c d e "The LTO Program Announces Upcoming Generation 7 Specifications for Licensing". 2015-09-14. Retrieved 2015-09-15.
  14. ^ a b c "THE LTO PROGRAM RELEASES SPECIFICATIONS FOR UPCOMING GENERATION 9". lto.org. 2020-09-09. Retrieved 2020-09-10.
  15. ^ "LTO-9 delayed til late 2021". Retrieved 2021-04-25.
  16. ^ a b c d e "WHAT IS LTO TECHNOLOGY?". 2017.
  17. ^ a b "Licensing Specs for LTO-6 Available in August, 2012". Micro-Journal / The LTO Program. 11 June 2012.
  18. ^ a b c d "Ultrium Generations LTO". Hewlett-Packard, IBM and Quantum. Archived from the original on 2011-06-26.
  19. ^ "IBM Ts2280 LTO-8". Retrieved 13 October 2017.
  20. ^ a b c Mellor, Chris (11 Sep 2014), "No TKO for LTO: Tape format spawns another 2 generations, sports 120 TB bigness", The Register
  21. ^ a b c d e f https://www.lto.org/roadmap/
  22. ^ Mellor, Chris (2015-09-16). "LTO issues mighty seventh-generation 15 TB tape format". The Register. Retrieved 2015-09-22.
  23. ^ a b Mellor, Chris (2010-04-15). "Two new LTO tape gens announced". The Register.
  24. ^ "Chapter 2: Introduction Speed Matching", Quantum LTO-7 HH SAS User's Guide (PDF), December 2015, retrieved 2017-04-09
  25. ^ "LTO PROGRAM OUTLINES GENERATION 8 SPECIFICATIONS". Retrieved 2 March 2018. To address this technological shift and maintain affordability in times of extreme data growth, the latest LTO generation 8 specifications are intended to be only backwards compatible with LTO generation 7 cartridges.
  26. ^ "LTO-8". Retrieved 2 March 2018. Is it true LTO-8 cannot read LTO-6? Yes it is true. The two generations of backward compatibility was broken for LTO-8 because LTO-8 drives relies entirely on Barium Ferrite tape media. Since LTO-6 supported both magnetic particle and Barium Ferrite, the compatibility issues has arisen.
  27. ^ "Compatibility among LTO tape drives and cartridges". LTO8 Drive -> Not compatible with LTO6 cartridges
  28. ^ "LTO Ultrium 8 Tapes". Retrieved 2017-12-26.
  29. ^ a b "HPE LTO-7 cartridge initialized as Type M media; A technical overview of the main characteristics of LTO-7 Type M media" (PDF).
  30. ^ "HP LTO Ultrium tape drives technical reference manual; Volume 4: specifications; LTO 5 drives" (PDF).
  31. ^ a b "HP LTO Ultrium 6 Tape Drives Technical Reference Manual; Volume 4: Specifications" (PDF).
  32. ^ "HPE StoreEver LTO-8 Ultrium Tape Drives; Technical Reference Manual Volume 4; Specifications Guide". February 2018.
  33. ^ a b c d "LTO Roadmap Extended To Gen 10". IT Jungle. September 15, 2014.
  34. ^ Rivera, Rogelio; Vargas, Gustavo; Vázquez, Marco (September 2012), IBM® System Storage® LTO Ultrium 6 Tape Drive Tape Drive Performance White Paper (PDF), IBM Guadalajara, archived from the original (PDF) on 2013-08-11, This new capacity is achieved in the same tape length (846 m) as the gen5 media due to a higher density format (gen6 format). Note that another IBM announcement disagrees: "This is achieved by increasing the linear density, track density, and the media length." (IBM TS1060 LTO-6 tape drive announcement, p. 3.) Note: the difference on the length from LTO5 and LTO6 media is only 1 m.
  35. ^ "LTO Media".
  36. ^ "Fujifilm LTO-6 specifications" (PDF). Archived from the original (PDF) on 2013-05-11. Retrieved 2013-03-29.
  37. ^ a b c d "Fujifilm Launches LTO Ultrium9 Data Cartridge | Fujifilm [Latvia]".
  38. ^ Imation whitepaper: LTO-6 MP or BaFe?
  39. ^ "HP Ultrium Storage Supplies" (PDF). Archived from the original (PDF) on 2016-01-31.
  40. ^ a b IBM System Storage TS1060 Tape Drive offers an Ultrium 6 Tape Drive for the TS3500 Tape Library, IBM, 2012-10-03, IBM Hardware Announcement, retrieved 2012-11-05, There are 2,176 data tracks in Ultrium 6 versus 1,280 data tracks in Ultrium 5.
  41. ^ "LTO-5 Tape Drive User's Guide" (PDF). Quantum. Archived from the original (PDF) on 2016-01-08.
  42. ^ a b "LTO-6/LTO-5 Tape Drive Datasheet". Quantum. Archived from the original on 2014-04-08. Retrieved 2012-12-14.
  43. ^ 485 kbit/in"LTO Ultrium 7" (PDF). Sony. 2016-04-04. Retrieved 2016-04-17.
  44. ^ a b c d e f "Expected Usage Life of Imation Media" (PDF). Imation. Archived from the original (PDF) on 2016-01-08. Retrieved 2013-07-16.
  45. ^ "Patent application number 20090208018: Data Transfer Device". Faqs.org. Retrieved 2013-03-29.
  46. ^ Dell PowerVaultTM 110T drive specification. Retrieved 2009-05-16
  47. ^ HP Ultrium Media QuickSpecs (PDF), UK: CCI distribution.
  48. ^ "Storage tek tape storage media LTO specs". Oracle and Sun. Sun. 2011-10-04. Archived from the original on 2009-04-30. Retrieved 2013-03-29.
  49. ^ a b "Fujifilm Tape Care & Handling Recommendations" (PDF).
  50. ^ "IBM media environmental specifications".
  51. ^ "Primer 3". Ultrium – LTO Technology. LTO. 2010-04-04. Archived from the original on 2012-03-06. Retrieved 2013-03-29.
  52. ^ News bytes (PDF), LTO, Jun 2011, archived from the original (PDF) on 2011-07-27.
  53. ^ Standard, ECMA, 321, archived from the original on 2006-09-24, retrieved 2006-09-23
  54. ^ Specification of SLDC (PDF), ECMA, 321, archived from the original (PDF) on 2006-10-08, retrieved 2006-09-23.
  55. ^ ALDC documentation, IBM, archived from the original on 2006-03-13.
  56. ^ "Image of Dell LTO-3 WORM cartridge with gray bottom". Support.dell.com. 2012-06-06. Archived from the original on 2012-09-26. Retrieved 2013-03-29.
  57. ^ "HP Forum: LTO 3 WORM info". H30499.www3.hp.com. Retrieved 2013-03-29.
  58. ^ LTO-4 encryption whitepaper (PDF), HP, p. 11, archived from the original (PDF) on 2013-11-12, retrieved 2013-03-29
  59. ^ "Linear Tape File System (LTFS)". SNIA. Retrieved 20 November 2013.
  60. ^ "SONY AND FUJIFILM PASS LTO ULTRIUM GENERATION 7 INTERCHANGE TESTING". www.lto.org. November 18, 2015. Retrieved June 2, 2019.
  61. ^ "LTO Compliance-Verified Licencees". Ultrium. Archived from the original on 2006-11-13. Retrieved 2013-03-29.
  62. ^ "Imation To Close Tape Plant | Network Computing". www.networkcomputing.com.
  63. ^ "Notice Concerning Dissolution of Consolidated Subsidiary Due to Business Withdrawal" (Press release). LTO. August 29, 2013.
  64. ^ "Emtec, Imation, and Verbatim License Linear Tape-Open Technology" (PDF) (Press release). LTO. August 3, 1998.[permanent dead link]
  65. ^ "Linear Tape-Open (LTO) Technology Continues Licensee Momentum with Signing of Fujitsu and Quantegy" (PDF) (Press release). LTO. October 21, 1998.[permanent dead link]
  66. ^ "LTO cartridge specifications". USA: Fujifilm. Retrieved 2013-03-29.
  67. ^ "LTO Ultrium Data Cartridge". Fujifilm. Retrieved 2015-12-27.
  68. ^ "Fujitsu Cartridge Memory documentation" (PDF). US: Fuji film. Archived from the original (PDF) on 2013-05-11. Retrieved 2013-03-29.
  69. ^ "VeriTape the trusted Cartridge Quality Analyzer". MP tapes. 2010-06-15. Retrieved 2013-03-29.
  70. ^ "Spectra MLM Reader". Spectra logic. 2007-11-15. Retrieved 2013-03-29.
  71. ^ "Maxell LTO Cartridge Memory Analyzer". US: Maxell. Archived from the original on 2013-03-05. Retrieved 2013-03-29.
  72. ^ "Proxmark3 developers community". US: Proxmark. Retrieved 2019-12-21.
  73. ^ "IBM LTO Ultrium Cartridge LabelSpecification (Revision 6)". IBM. February 2009.
  74. ^ "Barcode Requirements". Quantum Corporation.
  75. ^ http://www.thic.org/pdf/August07/MEII_8-21-07.Groel.pdf
  76. ^ Tape alert
  77. ^ https://support.hpe.com/hpesc/public/docDisplay?docId=c01507784&docLocale=en_US
  78. ^ "Certified Tape Media". Spectra Logic. Retrieved 2016-04-14.
  79. ^ a b "HP cleaning strategy" (PDF). Sundds LTO. Archived from the original (PDF) on 2012-02-19. Retrieved 2013-03-29.
  80. ^ "PARTICIPANTS". LTO.org. LTO Consortium. Retrieved June 2, 2019.
  81. ^ "Digital Data Storage Outlook 2019". Spectra Logic. May 22, 2019. Retrieved June 2, 2019. It was Spectra's opinion that IBM would be the sole manufacturer of enterprise-class tape drives and media in the years to come. In 2017, this projection became true as Oracle announced their intentions to no longer pursue future tape drive development. There remain two tape media suppliers.
  82. ^ "Data Tape: Dying a Slow Death or Already Dead?". Data Center Knowledge. July 18, 2013.
  83. ^ "RECORD BREAKING AMOUNT IN TOTAL TAPE CAPACITY SHIPMENTS ANNOUNCED BY THE LTO PROGRAM" (PDF). LTO Organization. March 14, 2018. Retrieved June 6, 2019.
  84. ^ "Media Shipment Report" (PDF). LTO Organization. March 2018. p. 6. Retrieved June 6, 2019.
  85. ^ "Tape market strength" (PDF). HP. July 2011. Retrieved June 6, 2019.
  86. ^ "Evaluating Different Tape Technologies for Today's Data Storage Needs". Spectra Logic. January 17, 2019. Retrieved June 2, 2019.
  87. ^ "Disk vs Tape vs Cloud: What Archiving Strategy is Right for Your Business?". ProStorage. February 20, 2018. Retrieved June 6, 2019.
  88. ^ Reed, Jesse (November 19, 2019). "Debunking Tape Backup Myths in 2019: Full Overview". Nakivo. Retrieved July 10, 2021.
  89. ^ Schwartz, Karen D. (February 7, 2019). "Tape Storage Is 'Still Here'". ITPro Today. Retrieved July 15, 2021.
Wikimedia Commons has media related to Linear Tape-Open.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Linear_Tape-Open&oldid=1065938894"