The Holy Grail of Photo Management

I have a ton of photos that I’ve taken over the years, and managing them is a constant challenge. Part of the problem is simply the fact that there are so many great things you can do with digital photos — view them online, make cool photobooks, create collages, order prints, send them to friends and family, etc. There are many different applications that are useful for photos, and while some of them come close to doing it all, there still isn’t one solution that works for everything.

I have a few things that are essential to me in a “photo system”: secure backup, online permissioned viewing, and local viewing through a robust desktop app. I have several computers running Windows, Linux or OSX that I alternate between, so at any given point I might need to import or view photos from any one of them. Therefore, a photo solution needs to work across all three platforms and stay in sync and secure at all times. I found the ideal combination using rsync, Dropbox, Jungledisk, Picasa and Gallery2. It’s a lot of applications, but the result is perfect for what I’m looking for, and it takes very little time to maintain.

Here are my steps to getting pictures into the “system”. Basically,

1. Save pictures to some folder on the desktop of whatever computer I happen to be using. Remove the obvious “bad” photos.
2. Add the library to my Gallery2 library that’s hosted by Dreamhost. Gallery2 is one of the best online photo-view apps I’ve found, and since it’s hosted on my Dreamhost account, I have unlimited space to put pictures (unlike Picasa Web Albums which caps you out 1GB)
3. However, Dreamhost is by no means a secure backup location (they don’t claim to be, and they recently lost a bunch of user data), so I don’t feel very safe having my photos only stored there. Therefore, after my photos are uploaded to Dreamhost, I rsync the photo directory onto Dropbox. Dropbox is a great online storage and file-syncing utility, so it doesn’t matter which computer I’m using — the Dropbox folder is always the same on all of them. When I rsync to my Dropbox folder, the files are automatically backed up online and synced to the other computers that have Dropbox installed. If you’re curious, here is the rsync command I use:
   
rsync --verbose --progress --stats \
--compress --rsh=/usr/bin/ssh \
--recursive --times --perms --links \
/source/directory ~/Dropbox/Photos/.

   Note: That’s a space between /source/directory [space] ~/Dropbox/Photos

   From here, all of my computers have Picasa installed (since it works on Linux, OSX and Windows), and the Dropbox photo directory is set as a “watched” directory. This means that as new pictures are synced to the Dropbox folders on other computers, Picasa on that computer picks it up and adds it automatically.

4. The final, and probably unnecessary step is rsyncing the files to Amazon S3 via Jungledisk. This doesn’t really offer anything in the way of additional backup security, since Dropbox is S3 based on the backend anyways (so if anything happens to S3, both will go down). The reason I do this is because I look at S3 as my long-term “vault” and Dropbox as a shorter-term, more convenient storage place. The rsync itself is the same command as above, but replace the Dropbox destination directory with your Jungledisk directory.

If you’re on Windows, you can replace the rsync steps with a straight copy — you’ll still get most of the functionality. Rsync works fine on OSX and Linux.

Clearly, it’s an involved process when I add pictures. However, it’s not too bad — a bulk upload onto Dreamhost and then running 2 commands from the command line to get the photos onto Dropbox and Amazon. You can even remove the Amazon step if you want. Last time I checked there was no way to add photos to Gallery2 using a script, but if and when that becomes available, this whole process can be turned into a quick script to run in the background.

Follow these steps, and you’ll have secure, accessible and useful photos on all of your computers.