Linear Tape-Open

From Wikipedia, the free encyclopedia

Jump to: navigation, search
LTO-2 cartridge

Linear Tape-Open (or LTO) is a magnetic tape data storage technology originally developed in the late 1990s as an open standards alternative to the proprietary magnetic tape formats that were available at the time. Seagate, Hewlett-Packard, and IBM initiated the LTO Consortium, which directs development and manages licensing and certification of media and mechanism manufacturers. The standard form-factor of LTO technology goes by the name "Ultrium", the original version of which was released in 2000 and could hold 100 GB of data in a single cartridge. The most recent version was released in 2007 and can hold 800 GB in the same size cartridge. Since 2002, LTO has been the best selling "super tape" format and is widely used with small and large computer systems, especially for backup. Its popularity can be attributed to both the innovative technology developed as well as the attractive pricing.

Contents

[edit] Historical context

Half-inch (1/2") magnetic tape has been used for data storage for more than 50 years. In the mid 1980s, IBM and DEC put this kind of tape into a single reel, enclosed cartridge. IBM called their cartridge 3480 and DEC originally called theirs CompacTape, but later it was renamed DLT and sold to Quantum. In the late 1990s, Quantum's DLT and Sony's Advanced Intelligent Tape (AIT) were the leading options for high-capacity, high speed tape storage for PC servers and UNIX systems. Those technologies were and still are tightly controlled by their owners. Consequently, their availability was fairly limited and prices were relatively high.

IBM, HP and Seagate sought to counter this by introducing a more open format.[1] Much of the technology is an extension of the work done by IBM at its Tucson lab during the previous 20 years.[2]

Around the time of the release of LTO-1, Seagate's magnetic tape division was spun off as Seagate Removable Storage Solutions, later renamed Certance which, soon after, was acquired by Quantum Corp.

[edit] Form factors

LTO technology was designed to come in two form factors, Ultrium and Accelis.[3] As of 2008, LTO Ultrium is very popular and there are no commercially available LTO Accelis drives or media.[4] In common usage, LTO generally refers only to the Ultrium form factor.

[edit] Accelis

Accelis was developed in 1997 for fast access to data by using a two-reel cartridge that loads at the midpoint of the 8 mm wide tape to minimize access time. IBM's (short-lived) 3570 Magstar MP product pioneered this concept. The real-world performance never exceeded that of the Ultrium tape format, so there was never a demand for Accelis and no drives or media were commercially produced.

[edit] Ultrium

LTO Ultrium was developed as a (more or less) drop-in replacement for DLT and has a similar design of 1/2" wide tape in a (slightly smaller) single reel cartridge. This made it easy for robotic tape library vendors to convert their DLT libraries into LTO libraries.

An Ultrium cartridge's dimensions are 102.0 x 105.4 x 21.5 (mm).

  • An Ultrium drive is expected to read data from a cartridge in its own generation and at least the two prior generations.
  • An Ultrium drive is expected to write data to a cartridge in its own generation and to a cartridge from the immediate prior generation in the prior generation format.

[edit] Generations

Generation LTO-1 LTO-2 LTO-3 LTO-4 LTO-5 LTO-6
Release Date 2000 2003 2005 2007 TBA TBA
Native Data Capacity 100 GB 200 GB 400 GB 800 GB 1.6 TB 3.2 TB
Max Speed (MB/s) 15 40 80 120 180 270
WORM Capable? NO NO YES YES PLANNED PLANNED
Encryption Capable? NO NO NO AES256-GCM PLANNED PLANNED
Tape Thickness 8.9 μm 8.9 μm 8 μm 6.6 μm
Tape Length 609 m 609 m 680 m 820 m
Tape Tracks 384 512 704 896
Write Elements 8 8 16 16
Wraps per Band 12 16 11 14
Linear Density (bits/mm) 4880 7398 9638 13300?
Encoding RLL 1,7 PRML PRML PRML

[edit] LTO-1

  • Originally designed to come in 4 lengths of tape: 10, 30, 50, and 100 GB.
  • Tape encoding is RLL 1,7
  • First commercially available in September 2000.[5]

[edit] LTO-2

  • Doubled capacity and transfer speed
  • Switched to PRML encoding
  • First mechanisms approved in February 2003.[6] First media approved in March 2003.[7]

[edit] LTO-3

  • Doubled capacity and transfer speed again
  • Introduced WORM feature
  • Doubled number of write elements in head
  • First media approved in November 2004.[8]

At the full native data rate (80 MB/s), LTO-3 drives can write data faster than most hard disk drives can read. Even the minimum streaming data rate (~30–40 MB/s) is faster than many hard disk drives.

[edit] LTO-4

  • Doubled capacity again to 800 GB.
  • Added 256-bit AES-GCM drive level encryption.
  • Increase data transfer rate by 50% to 120 MB/s.
  • First mechanisms approved in April 2007.[9] First media approved in May 2007.[10]

[edit] Notes

  • Data Capacity and Speed figures above are for uncompressed data. Most manufacturers list compressed capacities on their marketing material. Capacities are often stated on tapes as double the actual value; they assume that data will be compressed with a 2:1 ratio (IBM uses a 3:1 compression ratio in the documentation for its Mainframe tape drives. Sony uses a 2.6:1 ratio for SAIT). See LTO-DC below. The marketing material also uses decimal definitions for byte capacities.
  • The units for data capacity generally follow the (decimal) SI prefix convention. (eg. mega = 10^6)
  • The units for data transfer generally follow the binary prefix convention. (eg. mega = 2^20)
  • Minimum and maximum reading and writing speeds are drive dependent.
  • Tape speed adjusts to available data stream, within the minimum and maximum streaming speeds.

[edit] Positioning times

Maximum rewind time is 98 seconds.[citation needed] Note that due to the back and forth writing, rewinding rarely takes this long. If a tape is written to full capacity, there is no rewind time, since the last pass is a reverse pass leaving the head at the beginning of the tape. Although this depends on the block size used when writing to the tape as the end of the tape could also be at the tape head when the writing is complete.

Average tape seek/filemark search time is 75 seconds.[citation needed] Although these times vary with the type of LTO drive that you have and the overall drive performance.

[edit] Tape durability

  • 15 to 30 years archival.[11][12]
  • 5000 cartridge loads/unloads [12]
  • Approximately 260 full file passes. (One file pass is equal to writing enough data to fill an entire tape.)[11]

The following durability figures are quoted from Imation corporation's 2008 tape specifications:[13]

General specifications Lifetime Tape Durability Approximate years of life assuming..
Tape type Native capacity Total tracks Tracks written per pass Passes to write entire tape Total end-to-end passes Entire-tape reads/writes ... one entire tape written per MONTH ... one entire tape written per WEEK
LTO-1 100 GB 384 8 48 9600 200 17 4
LTO-2 200 GB 512 8 64 16000 250 21 5
LTO-3 400 GB 704 16 44 16000 364 30 7
LTO-4 800 GB 896 16 56 11200 200 17 4

There is a large amount of lifespan variability in actual use:

  • Regularly writing only 50% capacity of the tape results in half as many end-to-end tape passes for each scheduled backup, and doubles the tape lifespan.
  • LTO uses an automatic verify-after-write technology to immediately check the data as it is being written[citation needed], but some backup systems explicitly perform a completely separate tape reading operation to verify the tape was written correctly. This separate verify operation doubles the number of end-to-end passes for each scheduled backup, and reduces the tape life by half.

[edit] Technical features

[edit] Encryption

The LTO-4 specification added a feature to allow LTO-4 drives to encrypt data before it is written to tape.[14] All LTO-4 drives must be aware of encrypted tapes, but are not required to actually support the encryption process. The algorithm used by LTO-4 is AES-GCM, which is a symmetric block cipher. The same key is used to encrypt and decrypt data.

[edit] Error detection and correction

The tapes contain a strong error correction algorithm that makes data recovery possible when lost data is within one track.[15] When data is written to the tape it is verified by reading it back using the read heads that are positioned just 'behind' the write heads. This allows the drive to write a second copy of any data that fails the verify without the help of the host system.

[edit] Leader pin

Leader pin on the end of a length of LTO tape

The tape inside an LTO cartridge is wound around a single reel. The end of the tape is attached to a perpendicular leader pin that is used by an LTO drive to reliably grasp the end of the tape and mount it in a take-up reel inside the drive. When a cartridge is not in a drive, the pin is held in place at the opening of the cartridge with a small spring.

A common reason for a cartridge failing to load into a drive is the misplacement of the leader pin as a result of the cartridge having been dropped. The plastic slot where the pin is normally held is deformed by the drop and the leader pin is no longer in the position that the drive expects it to be.

Older tape technologies used different means to load tape onto a take-up reel. Some 9 track tape drives used a burst of air against the spinning reel to automatically separate and grasp the loose end of the tape. This worked without a leader pin. DLT tapes have a hole punched in the end of the tape that a drive can use to grasp the end of the tape.

[edit] LTO-CM

LTO-CM

Every LTO cartridge has a Cartridge Memory chip inside it. It is made up of 128 blocks of memory, where each block is 32 Bytes for a total of 4096 Bytes. This memory can be read and/or written, 1 block at a time, via a non contacting passive RF interface. This memory is used to identify tapes and to help drives discriminate between the different generations of the technology.

Every LTO drive has a CM Reader in it. External readers are available, both built into tape libraries and handheld. The non-contact interface has a range of 20 mm.[16]

[edit] LTO-DC

The LTO specification describes a Data Compression method LTO-DC, also called Streaming Lossless Data Compression (SLDC)[17]. It is very similar to the algorithm ALDC[18] which is a variation of LZS (a patent-encumbered algorithm controlled by Hi/Fn[19]).

The primary difference between ALDC and SLDC is that SLDC does not apply the compression algorithm to uncompressible data (i.e. data that is already compressed or sufficiently random to defeat the compression algorithm). Every block of data written to tape has a header bit indicating whether the block is compressed or raw. For each block of data that the algorithm works on, it saves a copy of the raw data. After applying the compression function to the data, the algorithm compares the "compressed" data block to the raw data block in memory and writes the smaller of the two to tape. Every data compression algorithm will end up increasing the size of some inputs. The extra bit used by SLDC to differentiate between raw and compressed blocks effectively places an upper bound on this data expansion.

LTO-DC achieves an approximately 2:1 compression ratio when applied to the Calgary Corpus. This is inferior to slower algorithms such as gzip, but similar to lzop and the high speed algorithms built into other tape drives. It should be noted that plain text, raw images, and database files (TXT, ASCII, BMP, DBF, etc.) typically compress much better than other types of data stored on computer systems. In contrast, encrypted data and pre-compressed data (PGP, ZIP, JPEG, MPEG, MP3, etc.) would normally increase in size, if data compression was applied. In some cases this data expansion could be as much as 15%. With the SLDC algorithm, this significant expansion is avoided.

[edit] Tape layout

LTO Ultrium tape is laid out with 4 wide data bands sandwiched between 5 narrow servo bands. The data bands are numbered 3,1,0,2 across the tape and are filled individually, in numeric order. The head unit straddles the 2 servo bands that border the data band that is being written or read. The servo bands are used to keep the head precisely aligned within the data band.

Data tracks are written in forward and reverse passes, also called wraps. It takes several wraps to completely fill a data band. All of the write elements in the head write simultaneously as the head passes over the data band from the physical start of the tape to the physical end. This makes one forward wrap. At the end, the head shifts to line up the write elements with a new set of tracks within the same data band. It is now ready to make a reverse wrap. All tracks written by the same write element in the same direction are grouped together. This leads to a set of serpentine patterns in each data band. To determine the number of passes required to fill up a tape, divide the total number of tracks by the number of write elements. For example, an LTO-2 tape requires 64 passes.

The block structure of the tape is logical so inter block gaps, file marks, tape marks and so forth take only a few bytes each. In LTO-1 this logical structure has CRC codes and compression added to create blocks of 403884 bytes. Another chunk of 468 bytes of information (including statistics and information about the drive that wrote the data and when it was written) is then added to create a 'dataset'. Finally error correction bytes are added to bring the total size of the dataset to 491520 bytes before it is written in a specific format across the eight heads. The formats for LTO-2 and LTO-3 are similar.

[edit] WORM

New for LTO-3 is Write Once Read Many (WORM) capability. This is normally only useful for legal record keeping. An LTO-3 drive will not erase or overwrite data on a WORM cartridge, but will read it. An LTO-3 WORM Cartridge is identical to a normal LTO-3 tape cartridge except its LTO-CM chip identifies it to the drive as WORM and the servo track is slightly different.[20] WORM capable drives immediately recognize WORM catridges and include a unique WORM ID with every dataset written to the tape. There is nothing different about the tape medium in a WORM cartridge. Typically the WORM cartridges have a different color packaging.

[edit] Cartridges

LTO-2 Cartridge with the top shell removed, showing the internal components

Compliance-Verified licensed manufacturers of LTO technology media are Maxell, TDK, Imation, EMTEC, Fujifilm, and Sony.[21] All other brands of media are manufactured by these companies under contract. Since its bankruptcy in 2003, EMTEC no longer manufactures LTO media products. Verbatim[22] and Quantegy[23] both licensed LTO technology, but never manufactured their own compliance-verified media.

[edit] Colors

HP's Dark Red LTO-2 cartridge

The colors of LTO Ultrium cartridge shells are somewhat standardized. HP is the notable exception.

UCC LTO-1 LTO-2 LTO-3 LTO-4
EMTEC Black Black Purple
FujiFilm Black Purple Slate-Blue Green
HP Orange Blue Dark Red Yellow Green
IBM Black Black Purple Slate Blue Green
Imation Black Purple Blue-Gray Teal
Maxell Gray Black Purple Blue-Gray Teal
Overland Teal
Quantum Black Black Purple Blue Dk Purple
RPS Black Purple
Sony Black Purple Gray Green
StorageTek Purple
Tandberg Grey Black Purple Blue-Gray
TDK Gray Black Purple Blue-Gray Blue-Green
Verbatim Black Purple Blue-Gray
  • UCC means Universal Cleaning Cartridge, which works with all drives.
  • Different manufactures use different names for the same color sometimes. The names in the table above come from each manufacturers' own documentation.
  • WORM (Write Once, Read Many) cartridges are two-tone, the top half of the shell is the normal color of that generation for that manufacturer, and the bottom half of the shell is a light gray.

[edit] Labels

The LTO cartridge label uses the bar code symbology of USS-39. A description and definition is available from the Automatic Identification Manufacturers (AIM) specification Uniform Symbol Specification (USS-39) and the ANSI MH10.8M-1993 ANSI Barcode specification.

[edit] Erasing

The magnetic servo tracks on the tape are factory encoded. Using a bulk eraser (or otherwise exposing the cartridge to a strong magnetic field) will erase the servo tracks along with the data tracks and make the cartridge unusable.

[edit] Mechanisms

HP Half-Height LTO drive in an enclosure for desktop use

Current Compliance-Verified licensed manufacturers of LTO technology mechanisms are IBM, Hewlett-Packard, Quantum, and Tandberg Storage.[21]

[edit] Cleaning

Although keeping a tape drive clean is important, normal cleaning cartridges are abrasive and frequent use will shorten the drive's lifespan. HP LTO Gen.1 drives have a cleaning strategy[24] that will prevent the drive from actually using the cleaning tape if it is not needed. There is an internal mechanism that also handles cleaning tasks based on error rate criteria and time. The internal tape head cleaner is also activated when the cleaning cartridge is loaded. HP LTO Gen 2,3,4 using a Universal Cleaning Cartridge will always clean when a cleaning cartridge is inserted, irrespective of whether the drive requires cleaning or not[25].

[edit] Sales figures

The presence of 5 certified media manufacturers and 4 certified mechanism manufacturers has produced a competitive market. This has led to attractive prices for customers and subsequently, high sales volumes for manufacturers. In 2002, LTO out-shipped SDLT by nearly 2 to 1. Sales since then have dominated other "super" formats (SDLT, SAIT).

Year Drives sold
this year [26]
Total
drives sold
(as of Sept.) [27]
Cartridges
sold
this year
Total
cartridges sold
(as of Sept.) [27]
2001 1,000,000
2002 175,000
2003 262,000 350,000 (July)
2004 354,000
2005 461,000 1,000,000 30,000,000
2006 [28] 1,500,000 50,000,000
2007 [29] 2,000,000 80,000,000
2008 [30] 2,500,000 100,000,000

[edit] References

  1. ^ LTO (November 4, 1997). HP, IBM, And SEAGATE Agree To Establish Open Format Specifications For Enterprise And Network Storage. Press release. http://www.ultrium.com/newsite/html/news_11_04_97.html. Retrieved on 2007-10-15. 
  2. ^ IBM storage history
  3. ^ Advanced Research, Exabyte, Matsushita, Mitsumi Electric and Otari License Linear Tape-Open Technology
  4. ^ What Happened To Accellis?
  5. ^ LTO (November 05, 2001) (PDF). Linear Tape-Open Program Ships One Million Ultrium Tapes in First 12 Months of Availability. Press release. http://lto.org/pdf/011105_one_million_milestone.pdf. 
  6. ^ LTO (February 12, 2003) (PDF). HP, IBM Pass LTO Ultrium Format Generation 2 Mechanism Compliance. Press release. http://lto.org/pdf/030212_hp_ibm_gen2_compliance.pdf. 
  7. ^ LTO (March 27, 2003) (PDF). LTO Program Announces LTO Ultrium Generation 2 Compliance-Verified Licenses. Press release. http://lto.org/pdf/030327_gen2_compliance_verification.pdf. 
  8. ^ LTO (November 08, 2004) (PDF). Fujifilm, Imation, Maxell, Sony, TDK Pass LTO Ultrium Generation 3 Data Interchange Compliance Testing. Press release. http://lto.org/pdf/041108_gen3_compliance_testing.pdf. 
  9. ^ LTO (April 11, 2007). HP And IBM Pass Mechanism Compliance Testing For LTO Ultrium Format Generation 4 Tape Drives. Press release. http://lto.org/newsite/html/news_4_11_07.html. Retrieved on 2007-10-15. 
  10. ^ LTO (May 7, 2007) (PDF). Fujifilm, Imation, Maxell, Sony and TDK Pass LTO Ultrium Generation 4 Data Interchange Compliance Testing. Press release. http://lto.org/pdf/2007-5-7.pdf. 
  11. ^ a b http://nle.ch/dl/LTO.pdf
  12. ^ a b http://www.sun.com/storagetek/tape_storage/tape_media/lto/specs.xml
  13. ^ http://www.imation.com/support/pdfs/Usage-life-of-Imation-media_2008.pdf
  14. ^ HP LTO-4 encryption whitepaper, p11
  15. ^ Maxell tape specs
  16. ^ Fujitsu Cartridge Memory documentation
  17. ^ ECMA 321Specification of SLDC
  18. ^ IBM ALDC documentation
  19. ^ Patent claim by Hi/Fn
  20. ^ HP Forum: LTO 3 WORM info
  21. ^ a b LTO Compliance-Verified Licencees
  22. ^ LTO (August 3, 1998) (PDF). EMTEC, IMATION, and VERBATIM License Linear Tape-Open Technology. Press release. http://lto.org/pdf/980803.pdf. 
  23. ^ LTO (October 21, 1998) (PDF). Linear Tape-Open (LTO) Technology Continues Licensee Momentum with Signing of Fujitsu and Quantegy. Press release. http://lto.org/pdf/981021.pdf. 
  24. ^ HP cleaning strategy
  25. ^ HP cleaning strategy
  26. ^ Freeman Reports
  27. ^ a b LTO consortium press releases
  28. ^ LTO (September 25, 2006). LTO Ultrium Format Maintains Momentum With More Than 1,500,000 Tape Drives And 50,000,000 Cartridges Shipped. Press release. http://lto.org/newsite/html/news_9_25_06.html. Retrieved on 2007-10-15. 
  29. ^ LTO (September 5, 2007) (PDF). More than 2,000,000 LTO Ultrium Format Tape Drives and 80,000,000 Cartridges Shipped. Press release. http://lto.org/pdf/2007_09-05%20LTO_Hits_New_Milestones.pdf. Retrieved on 2008-03-13. 
  30. ^ LTO (September 3, 2008) (PDF). LTO Ultrium Format Reaches New Heights With Over 100 Million Cartridges Shipped. Press release. http://lto.org/pdf/LTO%20100%20Million%20Cartridge%20Milestone.pdf. Retrieved on 2009-03-10. 

[edit] External links

[edit] See also

Personal tools