1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.
  2. We've had very few donations over the year. I'm going to be short soon as some personal things are keeping me from putting up the money. If you have something small to contribute it's greatly appreciated. Please put your screen name as well so that I can give you credit. Click here: Donations
    Dismiss Notice

Whats the best way to store data?

Discussion in 'Tilted Gear' started by Strange Famous, Jan 28, 2012.

  1. Strange Famous

    Strange Famous it depends on who is looking...

    Location:
    Ipswich, UK
    I have more files than I can store on my PC

    They are things I want to use regularly

    I previously have used USB external hard drives, but in the last 6 months 2 have got corrupted. Is there any other better alternative that isnt overly expensive?
     
  2. How much data needs to be stored? Do you need access to all of it frequently or is some of it for long term archive?
     
  3. Zweiblumen

    Zweiblumen Slightly Tilted

    Location:
    Iceland
    Of cause there are alternatives but a USB external HD is probable the cheapest solution. You might want to look into enclosures or NAS enclosures that have multiple drives inside for redundancy. I have had an external USB hd go corrupt on me but I have been able to format the drives again and continue to use them. This requires that there other copies of the files available somewhere else.
     
  4. Speed_Gibson

    Speed_Gibson Hacking the Gibson

    Location:
    Wolf 359
    I use Mozy.com for my 128 GB of pictures (currently, RAW picture files bulk that up quickly when I am active with the camera). Works well for the purpose and it is nice knowing there are offsite copies.
    My bigger question now is what to do when my new 1.5 TB drive gets to that 1/3 or 1/2 mark with the local copies of the previously mentioned pictures and especially lossless audio files that were my primary reason buy it.
     
  5. Strange Famous

    Strange Famous it depends on who is looking...

    Location:
    Ipswich, UK
    About 1TB, and it is stuff I want to use regularly.
     
  6. Speed_Gibson

    Speed_Gibson Hacking the Gibson

    Location:
    Wolf 359
    not the cheapest by any means but I my first thoughts with that much data are a file server with a good RAID setup.
     
  7. MSD

    MSD Very Tilted

    Location:
    CT
    It isn't a good time to need more storage. If you can afford a few bare drives, a pair of drives in RAID 1 backed up to at least 1 drive, preferably another RAID 1 pair, is the simplest, cheapest way to do it. Checking Newegg (not sure what the best place for parts in the UK is,) you're looking at $160 a piece for 1GB WD Caviar Green drives (slow, but that's not a big deal since you can set backups to run overnight.)
     
  8. greywolf

    greywolf Slightly Tilted

    I have recently added a 2TB network drive that I use for pictures/videos. It sits beside my router and is available no matter what machine I'm on. It's easier than running a file server, but without the RAID protection that can provide. For files I take off line, I use DVDs for permanent storage as they are far less susceptible to degradation. A lot of my old 5 and 3.5 inch floppy disks are now unreadable (yes, I still have them, even though they've all been migrated... I just plugged in the drives to see if they were still usable and a number are not).
     
  9. Zweiblumen

    Zweiblumen Slightly Tilted

    Location:
    Iceland
    Keep in mind that the shelf life for consumer written DVDs and CDs is (much) less than initially expected. I would recommend that you verify important data regularly, maybe once a year. And prior to throwing away the setup that created the discs, I have had cd's that could only be read in the machine/drive that created them.
     
  10. Stan

    Stan Resident Dumbass

    Location:
    Colorado
  11. MSD

    MSD Very Tilted

    Location:
    CT
    DVD-R discs will give you 5, maybe 10 years. I've had CD-Rs fade in a few months, after a year on the shelf I accidentally burned over a disc that I later noticed was labeled in highlighter. Magnetic tape is probably your best bet short of printing everything and shooting copies on slide film.
     
    • Like Like x 1
  12. martian

    martian Server Monkey Staff Member

    Location:
    Mars
    Disc rot is a thing. DVD isn't reliable, and also a pain in the ass for large amounts of data.

    Generally, the answer to the question depends on how much you're willing to spend. Tape is stable, but not typically used for home storage. It's also not convenient to access the data. Short of that, plain old hard disks are really your best choice. Two drives can be used to create a RAID 1 (mirrored) array. Three work well in RAID 5, and 4+ are good for RAID 6. Combine with one or more external drives to back up the data, and if you can keep one somewhere that isn't your home (like your office, if possible). Note that RAID can provide data continuity, but it's not a backup. It provides protection from disk failure, but it won't save you if you accidentally delete your pictures folder.

    (Pedant note: RAID 6 is a good choice for 4-10 drives, past which nested arrays are generally preferred. Given the unlikeliness of someone having more than 10 drives in a home PC, for the purposes of our dicussion nested arrays aren't relevant and can be safely ignored).

    External drives themselves aren't any different in construction from internal ones, but the enclosures can be hit or miss, and they do tend to suffer more wear and tear. If you're paranoid you can use a solid state drive for the purpose, although you'll have to figure out what's essential due to the lower capacity.

    There are other options. Several online services will back up and store data, but I wouldn't use them for anything you're worried about having someone else read/see. Backblaze is a popular example, though I've heard rumours that their customer support is not fantastic.
     
  13. greywolf

    greywolf Slightly Tilted

    I'm certainly not an expert, but I understood that disc rot was far less of an issue with the newer dyes as these are designed to reduce the inter-layer reactions that caused rot in earlier discs. Probably the greatest cause of damage to discs is still the user, whether through smudging, scratching, or allowing prolonged exposure to sunlight. And items that I archive are stored in jewel cases in file boxes and aren't handled often, so that becomes less of a concern.
     
  14. pspinblue

    pspinblue New Member

    I would definitely go with the network accessible storage route, but best practice is always never only store information on one platform (even with RAID5 I've heard horror stories). I've never trusted disks though, I've had way too many of them lose information to do so.
     
  15. ASU2003

    ASU2003 Very Tilted

    Location:
    Where ever I roam
    http://www.iosafe.com/products-rugged-portable-overview

    I will probably have to get one of these with a small pelican case and USB & Power Amphenol plugs.

    It is much cheaper to back-up the data in the first place then to try and recover it.

    My problem is that I have too many drive and they are all so disorganized, it would take me three to four weeks just to figure out what I have and where it is.
     
  16. Pixel

    Pixel Getting Tilted

    Location:
    Missoura
    I have a Synology at work and installed on at a consulting clients office. I really want one for home now. Tons of RAIDed storage and if set up correctly, you can access it from anywhere. Great OS software. Not cheap, but it's a hell of a setup.
     
  17. rogue49

    rogue49 Tech Kung Fu Artist Staff Member

    Location:
    Baltimore/DC
    NAS for online. (your NAS OS doesn't have to be the same as your primary, so that can save you on cost)
    Backup offsite. (there are storage repository/bank vendors all over for these)
     
  18. Shadowex3

    Shadowex3 Very Tilted

    Came here to say what martian already did. For a conventional home user a raid 5 array will be your best tradeoff of reliability and ease of use without being esoteric or expensive. Periodically back up things to some high quality DVDs and store them off-site and you're probably fine, yes disc rot is a thing, but it's not like Papa Nurgle has a special love of discs.

    The reason a lot of USB drives are flaky isn't usually the harddrives themselves, although that doesn't help, it's that a lot of external drive enclosures (in my experience, they may have finally started fixing this) will keep the drive spun up basically as long as it's on. A GOOD one will actually spin down the drives just like they were internal.
     
  19. MSD

    MSD Very Tilted

    Location:
    CT
    I still couldn't get behind DVD backup as an archival solution. Magnetic media is the only thing that's certain to last more than a few years, a hard drive in an anti-static bag in a safe deposit box will keep your data safe. It's not really a problem to mount 10-year-old drives with IDE-USB adapters, but it wouldn't hurt to drop a couple hundred dollars every 5 or so on a new drive or two that will hold all of your old backups plus your new stuff.