To help solve the arcane mysteries of molecular structures and human health, scientists at the University of Georgia in Athens use some of the world’s most advanced technologies – including tape drives.
Each day, chemistry professor James de Haseth collects between 10MB and 100MB of measurement and observational data that will help researchers better understand mammalian immune defence, viral replication and cell growth systems.
“This data is very expensive to obtain,” says de Haseth. “Although it can be collected in a matter of minutes, the isolation and purification of the data can cost US$10,000 or more.” His lab uses a mix of Windows 98/NT/2000, Linux, Solaris and OS/2 desktops and servers.
Protecting that data against loss is crucial to de Haseth’s research, and that means back-up. A few years ago, he installed multiple VXA-1 tape drives from Ecrix Corp. in Boulder, Colo., to replace the lab’s overburdened Digital Data Storage-2 tape drives. Later, he almost lost everything.
“Things went awry,” he says. “I was attempting to add new features to a back-up server that controlled the existing tape drives, and I made some grave errors.” Fortunately, the VXA drives helped him recover much of the data.
The experience that de Haseth had underscores the need for regular, reliable data back-up, and it shows how skyrocketing storage demands can overwhelm existing back-up systems. This isn’t just a problem for scientists; e-commerce sites generate staggering amounts of data that must be backed up. Magnetic tape is the traditional data back-up medium; it’s cheap but relatively slow, and per-tape capacity has historically been limited. Yet tape technology is keeping pace, as vendors continue to develop higher-performance, higher-capacity tape systems.
Just coming into the market now are three tape formats – Super Digital Linear Tape (SDLT), Advanced Intelligent Tape (AIT-3) and Linear Tape Open (LTO). These offer Texas-size appetites for data archiving, a market that IDC in Framingham, Mass., predicts will grow 25 per cent per year, reaching US$5 billion by 2003.
SDLT, a successor to Milpitas, Calif.-based Quantum Corp.’s popular DLT 8000 format, stores up to 110GB per tape cartridge at a transfer rate of 10Mbps, about doubling the capacity and speed of DLT 8000. Quantum projects that SDLT capacities will ultimately increase to one terabyte per cartridge, while transfer rates will climb to 100Mbps. And new SDLT drives will read cartridges recorded in the older DLT 4000, 7000 and 8000 formats.
Park Ridge, N.J.-based Sony Electronics Inc.’s AIT-3 cartridges, available this quarter, will offer a 100GB capacity per cartridge, with a transfer rate of 11MB/sec. AIT-3 is fully read-and-write backward-compatible with prior generations. AIT-4, expected in early 2004, will reportedly double AIT-3’s capacity and transfer rate.
LTO, a competitive technology sponsored by Hewlett-Packard Co., Seagate Technology Inc. in Scotts Valley, Calif., and IBM, will store up to 100GB per cartridge at transfer speeds up to 15Mbps. Looking ahead to 2003, advances in LTO technology might see drives storing up to 1.6 terabytes at the incredible (at least for tape) transfer speed of 320Mbps. To accelerate file restoration and cataloguing, both LTO and AIT cartridges include on-board memory that gives fast access to the cartridge’s file index.
Several factors have triggered the growth in storage needs, most notably the Internet. The meteoric growth of multimedia enriched Web pages, e-commerce transactions and the Web’s vast and ever-changing storehouse of documents account for a large part of the anticipated 500 per cent growth in enterprise storage needs over the next three years.
Other causes for the increase are more basic. “No one wants to delete files any more, and files sizes are increasing significantly,” says Derek Gamradt, chief technology officer at StorNet Inc., a data storage services firm in Englewood, Colo. Gamradt says he sees a need for storage that will accommodate the use of ever more sophisticated documents, including presentations, graphics and eventually audio and video attachments. The increase is also driven by the escalating demand by new businesses, such as telecommunications.
Ed Presutti, manager of network security and engineering at US Unwired Inc., a telecommunications services firm in Lake Charles, La., says his company’s data storage requirements have more than tripled in the past two years. The data is generated by 1,000 internal employees and the company’s 100,000-plus subscribers.
“We are now over the one-terabyte mark. When we link our accounting and financial systems with data warehousing and point-of-sale information, we will expand to a 3-terabyte solution,” he says.
Heading Presutti’s wish list for storage improvements is faster throughput. “No matter what technology you use to back up your data, it just does not seem fast enough,” he says. “We are also hoping to see tighter integration between the back-up software, tape devices and storage-area networks.”
To help ensure that tight integration, Presutti often asks aspiring vendors for an on-site product demonstration. “In our environment, what [a product] does in a lab and what it does on our network may be totally different,” he says.
Tape’s traditional popularity is partly due to its scalability. The technology lends itself to building multidrive, fault-resilient storage-area networks (SAN). Where throughput is important, as in retrieval operations, SANs can leverage the low latency of newer tape drives and offer fast access to multi-terabyte data stores.
Despite all the advances and intelligence built into SDLT, LTO and AIT, they still depend on a linear data stream, so it’s time-consuming and inconvenient to restore selected, noncontiguous files. To some degree, a hierarchical storage management (HSM) system can compensate. In this three-tier architecture, software automatically moves files between the various media – RAID, DVD jukeboxes and tape libraries. File transfers can be based on content, type, date or frequency of use. With HSM, new and frequently needed files are stored on RAID systems. Less frequently used files are moved onto near-on-line DVD jukeboxes. Rarely used files are archived to tape libraries, often at remote locations.
Today, you can choose from multiple hardware and media technologies to protect your company’s data. But back-up technology is about to take some giant steps forward in capacity and speed, so the equipment that you commit to now may be outdated in a year.
What factors should you weigh before buying? Not the cost, says Presutti. “Price is an important factor, but so is quality,” he says. “Look for a strong product from a strong company.”
Millman is a freelance writer in Croton, N.Y. Contact him at hmillman@ attglobal.net.