As Photographers, Are We Backing Up Too Much?

I was talking with my buddy Terry White earlier this week about my photo storage problems. It seems that no matter how much extra drive space I add, before long I’m out of space again. He’s got the same problem. Maybe worse.
Part of the problem is our files are just too darn big; now even entry-level DSLRs are 12 megapixels, and a Canon 50D is up to 15 megapixels. If you shoot in raw, after five or six clicks you’ve eaten up nearly 100MB, and if you’re shooting a wedding or event, you can eat up 10 or 12GB fairly easily. If you have a 500GB hard drive for backing up your photos, and you only shoot one wedding a week, it’ll start getting kinda full in around 8 or so months.
What got me to thinkin’
In a moment, I’m going to go over my backup strategy, but before we even get there, I honestly think I might be backing up too much. Here’s what made me start thinking like that. Terry recently did a portrait shoot where he took 710 photos during the shoot. His subject reviewed the images in Lightroom, and choose the shots she liked (around 70 initially, then she narrowed it down to her favorite 5 or 6). Then Terry picked his favorites, and he chose 5 or 6.
So, what do we all do next? That’s right, we back up all 710 photos, even though the subject has already said, “I only like these 70.” She looked at them all, told the photographer straight up, “I don’t want any of the other 640 images” but we back them all up anyway. Now, Terry asked me, “What are the chances that she is going to come back some time in the future and ask for one of the ones she didn’t like? Right. Slim to none. Yet, we still store ‘em, and watch them eat up our drive space, and add more complexity to our file management. Like Terry says, “Those 640 images are never going to see the light of day. I don’t have any use for them. She doesn’t have any use for them, but I’m backing ‘em up anyway. Why?”
Client Work Backups
Now, Terry can make a good case for not backing up all 710 shots, but if you’re doing work for a client, there will be cases where you’ll need to back up every single shot. Same thing with Weddings. You never know when two years later the couple might back to you and ask for another album for a relative, but this time it has to include photos of Uncle Ralph, who wasn’t in their original album.
In cases like these, I would build in the cost of archiving those photos, and pass it on to the client. Just buy a small portable hard drive, put all the files on it, put a label on the drive, wrap it in bubble wrap and put it on the shelf. A 20GB portable LaCie hard drive runs about $49.
But then Terry brought up a good point—how often do you really need 20GB for one client (or for one wedding)? He pointed me to an 8GB USB Flash drive, for only $29. If you only need 4GB of storage, you can get one for just $13.95. Heck, you might as well get two, and have two back-ups that hardly take any space at all. You could put them in a tiny zip-lock bag and staple them to your copy of the contract for the shoot. This changes the whole situation pretty dramatically; now its not eating up your main storage; you’re off-loading the finished job to USB drive (or external hard drive) dedicated to that shoot (and paid for by the client).
Family Photos
This is one area where I always back-up every single photo, because years later the perfect shot won’t matter, because since it’s family, I’ll want to see even the bad ones, but that’s really what this post is all about; choosing what we really need to back up for our type of work, and making smart decisions about managing our storage space and our image library.
My Backup Strategy
This is going to freak some photographers out, especially those who used to shoot film (like me), and who are used to saving every single shot, no matter what. Here’s what I do:
- I import one set of photos from my camera’s memory card, onto my computer
- I automatically back-up the same set (during import into Lightroom), onto my Drobo backup system
- I edit the photos on my computer in Lightroom, deleting all the really bad shots (out of focus, totally unusable, misfires, accidental shots, etc.), and I add keywords, metadata, etc. and then edit and finish the files in Lightroom and Photoshop.
- So far, so good, but after I’m done editing, deleting, keywording, etc. I then drag that folder from computer over to the Drobo, and replace the original back-up with this final edited set. (Yikes!).
Now, why that last controversial move? It’s because if I don’t do this, and one day I need to go back and use the backed up images on my Drobo, all the bad shots will still be there; none of the keywords will be there, none of the metadata I added will be in those files, and all my edits and finishing will be gone. All that work is gone forever, so although I have the original files back, I have to start all over from scratch. I know this flies in the face of what we’ve all done since the film days, but like I said; it’s my backup strategy; it doesn’t have to be yours.
The Bottomline
What I hope will come from this post is one thing; that you’ll give some thought to how much we’re all backing up, and ask yourself if you’re backing up too much, or if you’re just backing up too much to your main backup drive. Could you be off-loading some of these shoots to small portable drives, or better (and more stable) yet, to inexpensive USB Flash drives. There will still be plenty of instances where we do need to back up each and every file, but just give some thought to the idea of just keeping “the keepers.”











supersaurus: It looks nice, but this note on the wikipedia article worries me: “S3 comes with no guarantee that customer data will not be lost.”
source: http://en.wikipedia.org/wiki/Amazon_S3
For those that have mentioned Amazon S3 have you used/heard of Mozy? It’s only 5 bucks a month for unlimited data. I’ve been debating about giving it a try.
As for saving images… I keep them all, yep, even the out of focus blurry messes. My reasoning? I use it to see if I’m improving if at all. I also think it keeps me humble. I shot a football game a week ago and I ended up with 90 really good shots. As I was viewing just those 90 images I began thinking “wow, I’m good at this”. I then looked at them with the other 1,320 images that I took and it put my head back where it belongs. I need to keep learning so I can keep growing and improving. If I stop doing that I should put the camera away.
Scott:
Another thought-provoking posting; like many I am always trying to refine my backup strategy.
Currently, I have 2 x 1TB drives in my MacPro, in a RAID1 configuration, so my main working drive has the RAID backup. On import, everything goes to both my working library and to a backup folder, stored on a Drobo (which I decided to buy after reading your post). The Drobo is also the TimeMachine drive, so my working folders also back up there. After import, I make 2 CD or DVD copies of the “raw” import, so the original import is archived. I do this before starting to work on any of the files. Previously, the Drobo’s import copy remained as is, but after reading your post, I realize that this serves little purpose after the images have been edited/selected, so I have to rethink this strategy.
I had a few questions for you, maybe grist for another posting:
1) Presumably you have LR set to keep all metadata in XMP files so that when you copy the folder, the metadata goes with it.
2) Why not export a LR catalog as the backup after the editing is completed, rather than copy over the folder? Then, any information stored in the LR catalog is also archived with the project.
3) Do you use a new LR catalog for each shoot, or one giant catalog?
4) If one giant catalog, how do you deal with the slowdown that seems to occur as the catalog has larger numbers of images in it?
5) If multiple catalogs, do you keep an export of your keyword database and import it into each new catalog, so your keywords stay consistent across all catalogs? This is the biggest problem I face; it would be nice of Adobe provided a mechanism for a “global” keyword database that would automatically appear in every catalog, plus “local” keywords for those unique to one catalog.
6) If you use multiple catalogs, you seem to lose the ability to search over your entire image database, one of the purposes to using cataloging software. Thoughts on a solution to this? (Presets for the Develop, Web and Slideshow modules seem to be global across all catalogs).
Thanks for your thoughts!
I think some are misinterpreting what Scott is saying. When he says, “Backing up too much,” he’s not talking about backing up to too many sources (having several backups of important files) or backing up too often; he’s referring to backing up too much data or too many files. In other words, trim it down and back it up to whatever number of sources you need. I happen to agree wholeheartedly.
Just thought a little clarification was in order.
Scott - I don’t think you should go yikes. What’s the point of hanging onto the unprocessed images? It’s the processed ones your making money with.
Keeping your copies off site is important. Copies don’t do you any good if they burn down with the originals.
I like the idea of burning all the photos in the shoot to a DVD or small flash drive and adding that to the contract (price-wise, too). That way, the person paying for the photo not only gets the few shots they want printed, but they also get the rest of the shots to have for their viewing pleasure.
My new strategy (which hasn’t been tested very much) is to keep the best 50 or so as RAW + JPEG files out of 1000. Then any photos that are descent but not top shelf will have the RAW files deleted. If I should need something later, I’ll always have a very usable JPEG, it’s not quite as good but it’s a compromise. Also I am trying to get better about deleting near duplicates altogether. It’s obvious that you can delete the blurry pictures or misfires. What is taking me a little more discipline is if I exposure bracket a shot, or if I took a shot from 3 slightly different angles. I am trying to learn to find the best one and delete the others. Unfortunately that takes time. For a professional time is money, for me as an amateur it’s not as big a deal. Part of me always says that memory is constantly getting bigger and cheaper. I guess it’s just another balancing act.
I’m just getting started, so this is awesome! Thanks for the ideas…
What is interesting after reading your blog and all the comments, is that there is no perfect solution to this problem. We all have our own ideas and configurations but these are not ideal. Drobo seems to be the best of the bunch at the moment but even this solution has it’s pitfalls.
I think the field is ripe for someone out there to start thinking out-of-the-box and design a back-up solution that is worry-free, fast and uncomplicated.
James
Freiburg, Germany
No, I don’t backup too much. I only have 7 backups of every file I’ve ever created — 4 off-site, including two in a bank vault. All on HD by the way.
The thing I learned most from Moose is edit immediately (the evening after shooting) then keyword and rename files, etc. I use Digital Pro to do that, I keep trying other software, but for editing I think that the software that Moose and David Cardinal created is the best. As a professional shooter, I have files from the past ten years. I back up on hard drives and put in a safety deposit box. I just keep collecting drives. All files are on the computer at all times (Raid 0), one backup is on another drive in the computer and the third is stored in the box.
My backup runs at 9pm (usually when I’m at work), so I try and get the bulk of the selecting done by then! What about having a 2nd copy in the meantime? Well it’s still on the cards. If I’m in a real hurry, I’ll throw them onto my P-4000.
My backup and main drive are still full of photos that need to be deleted. And that’s all about time.
I don’t know if anyone is still reading these posts, but I wanted to point out a clarification. Poster #47 wrote:
“… also have a Drobo and follow a similar workflow. Since the drobo spreads my files out over 2 drives (up to 4) automatically, I essentially have 2 backups.”
This is a mistake. The inormation is spread across the drives ONCE and the drobo is not writing the same information to the two different drives. The drobo can be set up for mirroring, but I think you need to have more than two drives in there. Make sure you read your drobo documentation to ascertain whether you really have two backups in your drobo array!
All great ideas. The main thing is to have more than 1 back up. & test it every year & after a couple of years maybe move it to a new media to keep it current. Also use Adobe’s new DNG so your files will be able to be read. I have a drive that i keep at my dads house so i have an offsite backup.
The scary thing for me is I have seen so many of my friends & family & co-workers with their digital cameras not backing up at all.
Hell i have some friends that keep their shots on the card & just get a new 1 when it’s full. Tick..Tick.. Boom your pics are gone.
We can never back up enough. I’ve lost entire hard drives (both Mac and PC formatted) after anywhere from 6 months to 5 years old, and these were ranging from horrible no-name brands to more reliable brands. The important thing is to backup/archive on multiple formats–hard drives, DVDs, online storage, whatever it takes.
I’ve gone round and round with all my backing up worries. this is what I do:
1. Import from light room
2. Don’t delete anything.. I’ve gone back to my catalog and found pictures that didn’t jump out at me first and found some amazing shots.
3. Back Up online (backblaze)
Once the 1TB Drive that I have all my photo on gets close to being full (once a year) I buy another 1TB drive, put everything on that drive and put it back in the box and it goes on the shelf.
I’ve lost a drive before. it was expensive and I never want to have to go through that AGAIN!
Kevin
http://www.theshutterclick.com
I love the idea of putting the shoots on the USB drive ! Thanks Scott
I almost have the same backup strategy as you.
I must admit that I wouldn’t keep those 710 shots, I only keep my very tight selection and all the rest will be deleted. Only my final selection stays on my HD and backup disc.
Joe’s comment really caught my eye, I made great 8×10s from my 3 mp olympus 3030, I think most people will NEVER print every picture they take. I know this could make some teeth grind, but it’s possible my original 6 mp rebel takes better shots than my new 40D! How many of us will print a wall size poster to really need 21+ mp???.
Yes, back up, be selective, but also be sensible and realistic, things are getting WAY out of hand. I’m sure hard drive manufacturers an camera makers are loving it all the way to the bank. I love gadgets and features has much as the next guy, but I spend more time in Lightroom and thinking about what and how to save, transfer and protect, than actually taking pictures. Something has gone wrong!
>> Rich
I just want to point out that backing up to DVDs or Harddrive doesn’t mean that you just do it only one time. DVDs and harddrive both have their lifespan.
Why don’t you try to re-backup your stuff every 2 to 3 years.
I back up all my photographs, except the obvious shots that don’t make the grade, to an external HDD. It is time consuming, especially when shooting in RAW and I am way into the GB’s of data.
Recently, someone put me on to a free appliaction called “teracopy”, and it moves files, folders filled with whatever you want, at a rate almost triple that of the usual speeds we attain.
Last night I moved 12.9GB’s of data in 7mins, and I am only using USB.20.
I hope this helps someone out there, but I couldn’t go back after using this tiny application.
As for re-backing up, I back up to two drives, but the second backup is more at my leisure.
My strategy is to import via LR2 adding keywords upfront, delete the junk, rate, then backup to an external drive. I will rate them, place them into collections if need be, then work on them as needed. Only the ones I (personal) or a client are interested are backed up, similar to Scot’s last step. According to contract, I may store all images on an appropriate size flash drive or DVD, file with a contact copy, in case Uncle Joe is needed in the future. Again, similar to Scot’s blog. For personal and fine art work, I am ruthless, only the best are kept and backed up. I cannot afford a lot of backup space since even if some drives are relatively cheap, the costs add up. Even in film days, due to lack of space, I junked the junk. Why so different now?
Here’s my professional advice:
1: Tell the client that you back up for 3 months (or whatever). (Make sure client fully understand this for legal reasons).
2: Deliver the chosen pictures hi-res and keep the rest for 3 months.
3: Invoice client.
(4): Optional - Keep x pictures for your portfolio.
5: Delete files after 3 months.
Voilá - Computer is clean and you’ve got paid.
Scott Kelby shining the light once again. You’re the man.
For those of you that are having trouble with bad hard drives, do you use an uninterruptible power supply? Did you know that the electricity that comes out of the socket is subject to voltage spikes, dips and other harmful excursions EVERY DAY?
Get a UPS. Not the cheap ones — the ones with a battery inside. These UPSs filter out all the voltage dips and spikes and harmonics that are in EVERY power system. The electric company does not guarantee that your power will be clean enough to protect computer equipment — they only promise to protect your toaster and other electrical (not electronic) equipment. “Guarantee” is a misnomer, too. If your toaster does blow up from a power surge, don’t bother trying to sue the power company. If they don’t want to admit fault / volunteer to replace the toaster, tough luck. Most of them have a limited liability tariff which protects them from all claims except when they deliberately seek to cause injury (good luck proving that).
Electronic equipment and valuable electrical gear should always be behind a battery based UPS. It’s the only way to assure yourself you are getting clean power to your equipment.