Login  |  Register
Videoguys News Blog Twitter Videoguys News Blog Facebook Videoguys News Blog Yaoo Videoguys News Blog RSS Home Research Support About Us

EDIUS Neo 2 Booster Bundles Pioneer BDR-205 Blu-ray Disc Bundles G-Tech Storage Bundles

The “Videoguys” nickname started when we began posting on various bulletin boards and forums in the early days of the World Wide Web and we’re proud to live up to the name and reputation still today. We’ve been writing product reviews, the Videoguys’ Top 10 and trade-show reports for more than a decade and our tech tips and DIY articles are used by computer and video enthusiasts all over the world. If you have any questions, or would like to discuss one of these articles, give us a call at 800-323-2325.

Jan
22
Videoguys NLE Video Storage FAQ
by: 
01/22/2010 10:19 AM

One of the most confusing things about digital video editing is the storage requirement. In this article the Videoguys Techs will help you better understand just what kind of storage you'll need for your video productions. Mac or PC based video editors face the same storage challenges and questions, and we've got the straight forward answers you need!

Top 5 Storage Rules
You have a lot of choices for drives to store your digital video files. A stand-alone SATA hard drive is fast enough for editing Standard Definition (SD) footage using DV or MPEG2 compression. But, if you're working with uncompressed SD footage or HD footage, we recommend more robust storage solutions. Before we get into our FAQ, we'd like to review Videoguys' Five Rules of Video Storage:

2007best-1.gifYou can never have too much storage.

DV compressed video requires 13GB per hour of footage. While this may not seem like a big deal to you today, it sure was not so many years ago. Back in 1998 a 9GB SCSI drive would cost you over $1500!! And if you wanted to create great looking video, you had no choice but to invest that kind of money. Today's SATA drives are faster, more reliable and most importantly offer far greater capacities at a fraction of the cost. You can find 1TB drives (1,000 GB) for under $150 online. I saw an ad in my Sunday newspaper from one of the big computer chains for a 500GB SATA drive for $49.95 after mail in rebate this past holiday season!!

2007best-2.gifIt's the throughput baby!

Seek times and peak transfer rates mean nothing for video production. All we care about is sustained throughput. We don't care about the highest specs of the drive. We only care about the minimum. If the sustained data rate of the drive dips below the required transfer rate for our video, the result is jerky playback, messed up audio and dropped frames. Given today's technology, there is no excuse for this. When in doubt, get better storage then you think you will need.

RPMs are a good indicator of a drives over-all performance. For video work we recommend drives rated 7200 RPM or faster. We have found that many 5400 RPM drives do not have the sustained throughput required for NLE work.

2007best-3.gifA single drive will get slower as it fills with data.

A hard drive is a spinning disk. Back when we all had turntables and records, this was very easy to explain. If you placed a penny on the outer edge of the record, it would travel a much greater distance in a single rotation then a penny placed near the label on the inside of the LP. More distance over the same period of time equals greater speed. Using this analogy today just gets me a strange look by most people. But the reality is still the same: A single drive will get slower as it fills with data. Even with todays SATA technology we have seen that once a drive reaches 75% of capacity, the sustained data rate starts to drop off considerably.

Drives are so big, affordable & fast today that this rule at times does not even apply. You can buy a 1TB drive for under $150, that's big enough to store over 75 hours of DV video. Even though we don;t want you to fill the drive beyond 75% capacity - that still leaves you with enough room for over 50 hours of video!

2007best-4.gifUse a dedicated drive for your video projects and media.

With today's powerful processors, lightening fast memory, super 3D graphics cards and huge SATA hard drives; you can capture, edit & playback single stream DV video with your system drive. That said, we still urge you to get a dedicated hard drive (7200 RPM or faster) for all your video clips. This will produce the best results - especially for video projects over 1 hour in length. If you are going to be editing HD footage we still recommend a dedicated RAID for all your video and media. That will give you the best results.

2007best-5.gifgraid3-backsmall.jpgRAIDs are GREAT for video!!

RAID stands for Redundant Array of Independent Disks. That means that 2 or more drives are grouped and formatted together in order to provide greater storage and performance. There are several different types of RAID, which we outline in greater detail in the FAQ section of this article. Setting up a RAID is very simple and easy to do. If you are putting together a new machine for video editing we recommend selecting a motherboard with a built-in SATA RAID controller. Not only will this work great, but we've found they often include very easy to use RAID configuration software. If you have a laptop or you do not want to open up your computer you can ad an external RAID solution like our G-Tech G-RAIDs.


Now that you know our Five Rules of Video Storage, let's dig in and answer some very important video storage questions!

How should I configure the storage for my video editing workstation?
For video editing, the Videoguys recommend the following RAID storage configuration:

   1. SATA Boot drive (160GB or larger)
   2. Pair of Identical SATA drives striped in a RAID0 configuration 2 x 500GB = 1TB (1,000GB)
   3. (optional) 4th SATA drive (160GB or larger) for back-ups, digital photo library, MP3 library, etc.

Why can't I just set up my computer with one big RAID-0 for all my storage?
We do NOT recommend setting up your computer with a single RAID 0 array as your boot drive and video storage. This will actually give you poor performance for video editing. The constant reading and writing of small bits of data to the boot drive works against the need to read & write large continuous video files. Add in the overhead of the RAID controller and you get potential bottlenecks. For video editing you always want to have a separate drive or RAID array dedicated to your video files.

What about SCSI?
Years ago we only recommended SCSI hard drives for video storage but now, with SATA drive technology, that is no longer the case. While SCSI drives are faster, more reliable and better then SATA drives, they are also much more expensive and, for video work, they are not worth the premium. You get much better price / performance with a SATA RAID then a SCSI drive.

How much storage do I need for making standard definition DVDs?
Lets break it down:

  • If you are starting with DV footage, you need 13GB per hour of video.
  • This means a 2 hour DVD is 2 x 13 = 26GB of footage.
  • Add in the extra unused footage and it's more like 3 x 13 = 39GB.
  • Figure that you'll be adding some extra graphics and audio tracks. Let's say another 2GB for these.
  • Now you need room for the MPEG2 footage for the DVD, that's 4.7GB more.

Add it all up and it comes to almost 50GB of high speed video storage to make a 2 hour DVD!!

How much storage do I need for HD?
That depends on the compression you are using. HDV footage takes up about the same amount of space as DV, 13GB per hour, while DVC Pro HD takes up about 4 times as much space, around over 50GB per hour. Uncompressed HD footage requires around 500GB per hour - almost 50x the storage capacity of compressed HD footage. Plus, uncompressed HD also requires substantially faster sustained throughput. A single stream of uncompressed HD footage requires over 100 MB/sec!! At first glance, uncompressed HD video capture cards are inexpensive, but once you add the cost of the necessary storage you'll realize that editing uncompressed HD is actually very expensive.

Below is a simple chart to help make this easier to understand:

Format

GB/Hour

Hours/TB

DV

13

75

HDV 720p

11

90

HDV 1080i

13

75

DVCPro HD

60

17

XDCAM EX

19

52

ProRes 422 1920x1080

66

15

ProRes 422 HQ 1920x1080

99

10

Cineform Low

36

28

Cineform High

58

17

Avid DNxHD 145 8-bit

61

16

Avid DNxHD 220 10-bit

100

10

Uncompressed SD 8-bit

80

12

Uncompressed SD 10-bit

97

10

Uncompressed HD 720p 8-bit

396

2.5

Uncompressed  HD 720p 10-bit

497

2

Uncompressed  HD 1080i 8-bit

432

2.25

Uncompressed  HD 1080i 10-bit

558

1.8

What are the different RAID configurations and how are they used for video storage?

  • str0.jpgRAID 0
    RAID 0 is two or more drives striped together for maximum throughput. The computer sees theses drives as one single, large drive. With RAID-0 you get 2x the drive capacity of the smaller drive. So two 250GB drives give you 500GB of storage. (Note: we strongly recommend using identical drives – same model and capacity – for any RAID).

    • Advantage: Maximum throughput
    • Disadvantage: If one of the drives in a RAID-0 should fail, you would lose all your data.

  • mir1.jpgRAID 1
    RAID 1 is often called mirroring because both drives have the same exact data on them. This is done for protection. If one drive fails, you still have all your data on the other. This means the total volume of storage in the RAID-1 is only as big as a single drive. (2 x 250GB drives in RAID-1 gives you 250GB of usable storage).

    • Advantage: Data protection.
    • Disadvantage: We don't recommend RAID-1 for video. You end up with less capacity and when you add on the overhead of the RAID, your throughput speed is actually less then a single drive alone.

  • 001.jpgRAID 0+1
    RAID 0+1 is one way to get all the throughput benefits of RAID-0 and the data protection of RAID-1. You would need 4 drives for this, with two pairs of drives striped together as RAID-0, then the two RAID-0s mirrored.

    • Advantage: Combination of maximum throughput and data protection.
    • Disadvantage: Cost of four drives for configuration with overall storage capacity equal to just two of the drives.


  • par5.jpgRAID 5
    RAID5 is our top recommendation for video editing! A RAID 5 set-up allows you to use parity bits that spread the risk of drive failure among the other drives in the RAID. Keeping with my previous illustrations 4 x 250GB gives you 750GB of usable storage with even faster throughput then RAID-0 and data protection.

    • Advantage: Combination of maximum throughput and data protection without sacrificing half of the overall storage capacity.
    • Disadvantage: Cost of four drives and please keep in mind that 4 or more disks create lots of heat, so you really need to take a solution like this outside of the computer. External housings and connections will add to the cost.

Which storage system should I use?
As of January, 2009 the Videoguys' Techs have agreed on these storage recommendations based on the availability and prices of current products:

  • If you want the lowest possible cost, get a pair of identical 7200RPM SATA drives (250GB or larger) and stripe them together yourself. This increases the throughput of the drives and lets you use the entire capacity. This is called a RAID-0 stripe. Striping together a pair of 250Gb drives will give you 500Gb of screaming fast storage. You can stripe them together using your operating systems Disk Management utility. For even more performance get a PCIe SATA RAID controller card with 3rd party RAID software utility or use a motherboard with a built in SATA EIDE RAID controller.
  • In the long run an external hard drive solution is the better value for most digital video editors. While you will pay a little more for an external storage solution you will find it worth every penny.
  • No hassle opening up your computer to install them.
  • No excessive fan noise from the extra cooling required by multiple hard drives in your case
  • No worries about the heat they generate deteriorating other components in your machine.
  • You can "sneaker net" your data between multiple computers – which means physically walking it from one machine to the next.
  • They work with laptops and workstations.
  • You can easily migrate your media to a new video-editing computer when the time comes to upgrade to a new one.
  • We also strongly recommend external storage in any environment with a multi-purpose PC. You need to protect your precious video memories and all the time you spent working on your video. If you have to use the family computer for video editing wouldn't you feel better knowing that you could simply turn off the external drive or safely remove it while the kids used the computer?

If you want to add an external storage solution to your PC or Mac; workstation or laptop; then we recommend the following solutions:

  • If you are using standard-definition DV footage and making simple videos less than an hour long you can use a single external drive solution. In order of preference we recommend connecting that drive to FireWire 800, FireWire 400 or USB 2.0.
  • If you are working with videos longer than an hour, or if you have some very creative and complex ideas, or if you are editing HD footage; then you'll want an external RAID solution like the G-Tech G-RAIDs.

G-RAIDs come pre-configured in a RAID-0 stripe for maximum throughput and they're specifically designed for video editing with excellent cooling and air flow. Heat is the enemy of any hard drive and constant video storage will surely create a lot of heat. G-Tech has taken this into account on all the G-RAID solutions including the newest G-RAID 3. G-RAID 3 allows you to connect to your computer via eSATA (in addition to USB2, FW400 & FW800), which is much faster then FireWire and even more reliable.

  • If you are doing complex HD productions and you want to have protection against drive failures than we recommend the G-Tech G-SPEED eS. The G-SPEED eS connects to your PC or Mac via the G-Tech eSATA PCIe RAID card and allows you to use the Videoguys top recommended RAID-5 the next level of storage. Many times that will include rack-mounted solutions. configuration
  • If you are doing broadcast level uncompressed HD work then you need
  • If you need to support multiple levels of uncompressed HD you are getting into more expensive storage, requiring expensive controller cards like Ultra 320SCSI or FibreChannel. These cards can cost up to and over $1,000.If you need allow access to your files by more then one editor, you to add special networking hardware, software and expertise.

We hope that this article gives you a better understanding of the various types of video storage and what you need for your own projects

Videoguys recommends G-Tech as our preferred storage partner
Heat is the enemy of all drives and Lacie and many other external drive vendors do not properly ventilate or cool their units. In addition the quality control on the drives these other vendors use in their drives are simply not as tight or rigorous as those used by G-Tech.

G-Tech drives are designed for good air flow and heat dissipation. Their Raids are also fan cooled. Their quality control is excellent. We've been selling GTech storage for over 5 years and the long-term reliability has been superb. We've been banging on a G-Speed eS unit with our DIY6 rig for almost 6 months now. It simply works and works. In a RAID5 you get throughput speed and redundancy.

G-Tech just introduced GRAID ver 4 with quad interface. Now you get USB, FireWire 400 & 800 and eSata. If your Mobo has an eSata port, this is a really nice solution. G-RAIDs are RAID0, so you don't get any redundancy.


techstorage gtech graid gspeed


CATEGORIES: 

Email | Permalink | Comments (0)

GUIDE CATEGORIES
 
HOT GUIDE TAGS

Order online anytime! The Videoguys are also available to answer your calls:
Mon - Fri from 9AM - 5PM EST. Local Phone: 516-759-1611 Fax: 516-671-3092
Home | Research | Support | About Us | Shopping Cart | Site Map
©2010 Videoguys.com