For small to medium-sized websites, I recommend BackupBuddy. This WordPress plugin is easy to use and allows you to save your backups to an off-site location, such as Dropbox, Google Drive, Amazon S3 or their cloud storage ‘BackupBuddy Stash’. It also includes an easy-to-use restore function and a migration tool that allows you to move your entire site to another domain or host.

I currently use this plugin on my websites, which don’t have an automated backup performed by the website host. I am “grandfathered in”, thanks to a special lifetime offer from iThemes.