Zetta Scalabytes Blog

In this blog, hear from Zetta's founders and leaders about cloud computing, storage and data management best practices and Zetta Enterprise Cloud Storage technology.
Jeff Bell

February 02, 2012

4 Remote Office Backup Approaches

Jeff runs corporate marketing for Zetta. Prior to Zetta, Jeff was VP of Marketing at Pivot3 and VP of Marketing at Pillar Data Systems.

Remote office backup tape failureAccording to Telework 2011, a June 2011 report from nonprofit human resources organization WorldatWork, last year 26.2 million American employees worked from home or remotely at least one day per month. Almost half of those operated almost exclusively remotely or at home.
 
It is hard enough keeping a company’s main servers backed up. It is much harder to do remote office backup or branch office backup making sure all the crucial data stored on laptops, home computers and in each remote office is ready to restore when needed. That problem continues to grow as increasing numbers of employees hit the road or work from home.
 
While staff at headquarters enjoys the advantage of high-speed local network access to onsite servers — and IT staff on hand to support them — once the business extends its operations beyond the walls, IT must lengthen its reach accordingly.
 
Remote help desk software, for example, extends support out into the field and enterprise security software does a good job of enforcing firewall and antivirus policies. Traditional backup solutions, however, do not provide an easy or cost effective way to secure all the remote sites and mobile data.
 
Here are four possible options for dealing with remote office backup and remote worker backup:
 

1. Not backing up the remote workers or branch offices

While this is all too common, it is risky. True, people may promise to back up their own systems locally, but such tasks are easily forgotten. Hoping nothing bad happens isn’t an effective business strategy.
 

2. Purchasing backup systems for the branch offices

This requires spending money for the backup hardware and software, as well as having someone onsite who can manage and maintain the backups. While that makes sense for certain operations with abundant IT resources, it is rarely cost effective for businesses with multiple small branch offices. This approach also establishes separate islands of backups at each location which are not synchronized.
 

3. Using a centralized backup system with WAN Optimization

Tying into a centralized backup system can solve the issue of managing multiple remote backups, but often requires a WAN optimization device (like a Riverbed Steelhead appliance) at the remote office to deliver the needed performance. This works, but at a high cost. And it doesn’t cover remote workers.
 

4. Go with an online backup service such as Zetta

With online backup such as Zetta Data Protect, ZettaMirror agent software can be loaded onto any number of servers or workstations (Windows, Linux, Solaris or Mac) as well as laptops. ZettaMirror automatically replicates and synchronizes the data from those devices to the Zetta Storage Service at one of Zetta’s data centers. With Zetta Data Protect, remote workers and branch office personnel don’t need to back up to local hardware. The entire process can be monitored and managed by IT at the central office.
 
Acupay Zetta case studyAcupay System LLC, for example, is a company that manages the payments of dividends and interest in a way that reduces the payment of excess foreign taxes. It maintains data centers in New York and London, both of which had their own backup procedures in place. Since the London data center had a small IT staff, if someone was sick or on vacation, the backups might not be done in a timely manner. To solve this problem, Acupay installed ZettaMirror on Windows servers in New York and London and mirrors its SQL databases, documents and spreadsheets to the Zetta Data Center in New Jersey.
 
“For about the same money we were paying for tape media and our offsite tape service, we implemented Zetta and got better reliability,” says Acupay’s Director of Technology, Thorpe Thompson. “I spend less time and attention on backup, it takes less time for data restores, and we added the London office to the process.” Click here to read the complete Acupay story.
 
Zetta Data Protect provides an easy-to-manage, online solution for remote office backup, branch office backup, and other mobile endpoints. For more information on Zetta Data Protect, visit our Online Backup & Disaster Recovery center.
 

gary

January 25, 2012

Post Tornado Data Access & Recovery

Gary is VP Marketing for Zetta. He has 15 years of experience in storage, cloud services and security. Prior to joining Zetta, Gary worked in HP and Symantec, where he was a co-founder of cloud storage business unit for healthcare. At Symantec, he worked closely with EMC and NetApp on storage security initiatives. Gary holds two patents in Internet Security.    

Tornado damagePre-dawn tornadoes struck with deadly results Monday in Alabama. In the community of Clay, more than 300 homes were damaged shortly after 4 a.m. as the tornado swept through. Less than a year earlier, a massive F5 tornado devastated nearby Joplin, Missouri. Alabama, Arkansas, Mississippi, Tennessee, and Georgia were all under tornado watch. While advanced warnings can provide precious time and save lives, nothing can prevent the physical damage and devastation that these storms will wreak.
 
Keeping a business running or getting it running again after the storms pass is a challenge. For IT, it means maintaining access to critical data from databases, mail and file servers, as well as insuring ongoing employee access to their online business files.
 
For many, it could be extremely hard to accomplish these tasks, due to power outages and hazardous travel conditions, when people cannot get to work, and the IT infrastructure is down due to lost power or physical destruction. Weather emergency data backup & recovery calls for extra steps.
 
One of the key challenges is employee access to business critical data stored on servers. Traditional backup copies of data stored on tapes, external disks or USBs, may be difficult to obtain or impossible to restore in a timely fashion when the datacenters are down or weather inhibits travel.
 
Online backup and recovery services, such as Zetta, help keep businesses running even during such severe conditions by providing IT and other employees with secure, controlled access to both server and desktop backup data when weather conditions have made getting to the office — or even working from home — not an option.
 
Company employees can access and retrieve their backup files from any location with power and Internet connection using just a web browser, even with the datacenters being down and IT managers being unavailable.
 
The server online backup data can be immediately accessed from other regional offices not affected by the weather. And once the power is restored, the data can be quickly retrieved to primary and secondary datacenters, eliminating the risk of data loss occurring during the outage.
 
You can read how the Town of Dedham, Massachusetts relies on Zetta to provide protection against such weather disasters. Other Zetta customers also indicate that online data backup and recovery solutions help them keep their businesses going and significantly reduce the impact from weather emergencies such as tornadoes, snowstorms and power outages.
 
To learn more about Zetta enterprise online backup and disaster recovery, visit our Post Tornado Data Access & Recovery Center.
 

gary

January 24, 2012

Weather Emergency Data Backup & Recovery Readiness

Gary is VP Marketing for Zetta. He has 15 years of experience in storage, cloud services and security. Prior to joining Zetta, Gary worked in HP and Symantec, where he was a co-founder of cloud storage business unit for healthcare. At Symantec, he worked closely with EMC and NetApp on storage security initiatives. Gary holds two patents in Internet Security.    

Seattle Snow StormA winter storm blasted the Pacific Northwest last week closing schools, canceling flights, and making travel (or even getting to work) a nightmare, if not impossible. Near record snow amounts blanketed Seattle. Wind as high as 110 miles per hour took out power in many places in Oregon and Washington.
 
It was good news, perhaps, for the kids that got a welcome return to the carefree holidays. Most businesses, however, had to keep running. For IT, it meant maintaining access to critical data from databases, mail and file servers, as well as insuring ongoing employee access to their online business files.
 
For many, it could be extremely hard to accomplish these tasks, due to power outages and hazardous travel conditions, when a lot of people couldn’t get to work — and the IT infrastructure, including primary and secondary datacenters, was often down due to lost power. Weather emergency data backup & recovery calls for extra steps.
 
One of the key challenges is employee access to business critical data stored on servers. Traditional backup copies of data stored on tapes, external disks or USBs, may be difficult to obtain or impossible to restore in a timely fashion when the datacenters are down or weather inhibits travel.
 
Online backup and recovery services, such as Zetta, help keep businesses running even during such extreme weather conditions by providing IT and other employees with secure, controlled access to both server and desktop backup data when weather conditions have made getting to the office — or even working from home — not an option.
 
Company employees can access and retrieve their backup files from any location with power and Internet connection using just a web browser, even with the datacenters being down and IT managers being unavailable.
 
The server online backup data can be immediately accessed from other regional offices not affected by the weather. And once the power is restored, the data can be quickly retrieved to primary and secondary datacenters, eliminating the risk of data loss occurring during the outage.
 
You can read how the Town of Dedham, Massachusetts relies on Zetta to provide protection against such weather disasters. Other Zetta customers also indicate that online data backup and recovery solutions help them keep their businesses going and significantly reduce the impact from weather emergencies such as snowstorms and power outages.
 
To learn more about Zetta enterprise online backup and disaster recovery, visit our Winter Emergency Readiness center.
 

Jeff Bell

January 19, 2012

Cloud Backup Costs Less For Full Data Disaster Protection

Jeff runs corporate marketing for Zetta. Prior to Zetta, Jeff was VP of Marketing at Pivot3 and VP of Marketing at Pillar Data Systems.

CostIn acquiring and selecting a backup solution, cost is, of course, an important concern. Modern online backup and cloud backup solutions offer some interesting options when you consider all the costs of implementing full offsite data protection with reasonable recovery times. Cloud backup costs can actually be lower than more traditional options.
 
Different approaches to backup — cloud, on-site, and tape/removable media — can be significantly different, cost-wise. Solutions within each approach may have price differences as well. And, of course, the different approaches have different benefit and use case profiles. For example, an on-site appliance or off-site tape may not meet your requirements for Business Continuity/Disaster Recovery. So you have to be careful to not just compare based on pricing.
 

The Challenges and Concerns of Tape

Tape solutions have a lot of initial and recurring expenses, notably:
 

  • Tape-only solutions require local tape drives and, depending on how many tapes a backup requires, an automated multi-tape system. As your data volume grows, and tape technology evolves, you are likely to need to replace your tape hardware periodically to provide faster speeds and higher capacities.
  •  

  • You need a continually-refreshed library of tapes, since tapes do wear out, and you’re likely to need more tapes as well.
  •  

  • Tape backups require on-site IT to mount or swap tapes, and prepare them for shipment off-site. Any tapes being kept on site need to be stored in an environmentally stable, secure container.
  •  

  • You need an offsite tape storage service, media, and possibly also tape automation equipment. Plus you need a trusted courier service to pick up and deliver tapes. Third-parties can provide all this — but it still costs money.
  •  

  • Restoring from tape takes time — which represents downtime and possible loss of business, even if there’s no additional itemized costs — to request tapes, have them be found and couriered back to your site, and perform the restore. If multiple tapes are needed, this will take, and possibly cost, even more.
  •  

  • Tapes that are removed from use must be recycled or disposed of responsibly, not just in terms of environmental concerns, but also ensuring that data has been “scrubbed” so it cannot be retrieved by unauthorized parties.

 

Disk, Disk-to-Disk, Disk-to-Tape

Like tape, disk-based backups require investments in premises gear, space, power (and cooling).
 
If you want disk backups to go off-site, they, like tape, require having a library of removable disks or a set of transportable disk devices, plus provisioning secure transport and storage; or replication software plus networking gear, plus storage systems or a managed storage provider at the other end.
 
If you want these offsite disk backups to provide disaster recovery, you’ll need application software, plus hardware. Fortunately, server virtualization has made this simpler and less expensive than in the past, where you had to maintain physical duplicates of your main hardware environments.
 

Costs of Non-Cloud Solutions in General

All premises backup — like tape, disk or combination — have a power, cooling and space footprint, along with software licensing, service agreements. Plus the need for IT time to plan, purchase and deploy solutions; monitor ongoing performance and maintenance; track capacity requirements; and buy additional gear and media as needed.
 
Similarly, off-site solutions require data centers — owned, or service facilities — to house backups. These, in turn, have to provide physical and cyber security; be staffed to respond to restore queries; and be administered.
 
A blended disk-to-disk-to-tape (D2D2T) solution can provide local recoveries faster than a tape-only one, but the cost premium is substantial, close to doing both tape-only and disk-to-disk.
 

Cloud Backups Offer Direct, Indirect Cost Advantages

Cloud backup can avoid many-to-most of the direct and indirect costs of traditional premises and off-site tape/disk-based backups.
 
Zetta’s online backup service, for example, is all-inclusive with charges only for storage footprint.
 

  • There are no appliances to buy, administer and maintain; no media to wrangle; no software fees; no physical space, power or cooling footprint.
  •  

  • Zetta does not charge for bandwidth (you will need Internet connectivity to your site — but you need that anyway, these days), nor for IOPS (Input/Output Operations Per Second).
  •  

  • Your company does not have to pay for a secondary data center to house the remote data.
  •  

  • No “pre-buying” of capacity. As your backup footprint scales, so does your Zetta service — automatically, not requiring your IT staff to monitor and request more capacity.
  •  

  • No costs for protracted downtime. With Zetta, data recovery is instantaneous. Simply mount the data that’s at Zetta and begin running again. No waiting for tapes or disk shipments or even copying the data back.

 
Not all cloud backup solutions cost the same — or offer the same capabilities. Once you understand how cloud solutions differ in price and methodology from traditional premises and off-site backup solutions, the next steps will be to understand the possible start-up, ongoing and per-incident charges for cloud backup — and how to compare the TCO of cloud backup against the ROI — the cost versus the value, compared with the more limited benefits of traditional backups.
 
For more information on cloud backup and to explore some of the other decision criteria, visit the Zetta Cloud Backup decision center.
 

Jeff Whitehead

January 17, 2012

7 Ways to Prevent Backup Data Corruption

Jeff Whitehead, Vice President of Technical Operations and CTO, and Zetta co-founder is responsible for delivering the Zetta Enterprise Cloud Storage Service. Jeff spent more than two years as CIO of Shutterfly growing and managing over six petabytes of storage infrastructure.Twitter: @jwhitehead

Data CorruptionNo matter how diligent you are about conducting regular data backups, all that hard work comes to nothing if corruption or backup data loss keeps you from performing a successful restore.

 

How big of a problem is it? Well, the figures are all over the place. Google “tape restoration failure rate” and the first few hits give you estimates ranging from a 10% to a 71% failure rate. Whatever the actual figure is, it clearly is too high.

 

Disks are also prone to failure. Although Fiber Channel drive manufacturers talk about a Bit Error Rate of 1 in 1015 (1 in 1014 for most SATA drives) each drive holds a lot of bits and a data center holds a lot of drives. When you figure a single 1TB SATA drive has 8×1012 bits, you would expect a bit error once every 12 times you read the entire drive. In practice, bit error rate is dwarfed by actual drive failures. There are other sources of bit errors than just the disks themselves — consider all other points along the data transport path. A 2008 study of the issue by researchers at the University of Wisconsin-Madison, the University of Toronto and Network Appliance looked at 1.53 million disk drives in production storage systems and found, “more than 400,000 instances of checksum mismatches over the 41-month period.”

 

A UW/Net App study from a year earlier found that after 24 months of use, 5% to 20% of nearline disks had at least one sector error. Enterprise disks had a significantly lower, but still too high, error rate: “1.46% of enterprise class disks develop at least one latent sector error within twelve months of their ship date.”

 

Now, in some cases, such as a word document, a single bit error may not be catastrophic, but it can wreak havoc for certain databases or compressed data streams. Given that both tape and disk storage will suffer from data corruption over time, here are some steps to ensure that data can be restored when needed.

 

1. Use Strong RAID Encoding

RAID-5 uses an n+1 architecture, meaning it is designed to protect against the failure or corruption of one of the disks in the set. Switching to RAID-6, which uses an n+2 architecture can guard against two simultaneous failures and is much more secure. RAID-6 is also better for another reason, which is also overlooked: with RAID-5 if one of the blocks in a raid set doesn’t match (i.e., parity mismatch) the system has no way of telling what is the “correct” value — the parity could be wrong, or one of the data disks could be wrong. With RAID-6 if there is a single error, the others can be compared to determine which “one of these things is not like the other,” and the data corrected without resorting to have to restore from backup.

 

2. Backup to Multiple Nodes

Although not specifically a “corruption” issue, this protects against failure of an entire backup device. Zetta’s RAIN-6 (Redundant Array of Independent Nodes) technology, for example, stripes the data across independent computers protecting the data whether there is a network, power supply, memory, or disk failure. RAIN gives rise to greater availability of the backup service, ensuring it is available for backing up or restoring your data as needed.

 

3. Make Backup Copies of All Tapes

While this adds to the cost and it is slow to have to retrieve and load a second tape when the first fails, it does increase reliability. The probability of two tapes failing is the product of the probability of each tape failing.

 

4. Ensure your off-site schedule meets business needs

If you are taking tapes off site once a week, on average you have a 3.5 day window of vulnerability, — and worst case up to 7 days — where the tapes have been written, but are on-site and potentially destroyed in the event of a site disaster.

 

5. Verify All Tapes

Don’t assume that tapes will retain accuracy sitting in a vault. Verify the tape before archiving and pull them out on a regular basis to check for errors.

 

6. Implement CRC

A cyclic redundancy check (CRC) is a small fingerprint of data that can identify bit errors or corruption in a larger data set. A common CRC method is to extend the normal 512 byte disk sector to 520 bytes or more, and use that extra header space for the CRC information. CRC, however, is usually limited to high-end storage arrays using Fibre Channel and SAS disks, and is not something that can typically be added “after the fact,” if the system wasn’t designed to implement sector based CRCs from the ground up.

 

7. Use Cryptographic Hashes

Create a cryptographic hash such as SHA-1 or SHA-256 for any stored data to ensure that the recovered data is identical to what was originally stored. If there is any discrepancy, and you are using a redundant storage method, you can restore an uncorrupted version of the data. Being able to know and prove that a backup is exactly the same as when it was taken is critical for many industries and applications.

 

An alternative approach to preventing backup data corruption is to use online backup and disaster recovery, such as Zetta provides.
 

Follow Jeff Whitehead on Twitter.