{"id":475,"date":"2011-10-02T19:52:33","date_gmt":"2011-10-03T00:52:33","guid":{"rendered":"http:\/\/blog.xfloyd.net\/?p=475"},"modified":"2011-10-02T19:55:29","modified_gmt":"2011-10-03T00:55:29","slug":"when-everything-goes-wrong-deja-dup","status":"publish","type":"post","link":"https:\/\/xfloyd.net\/blog\/?p=475","title":{"rendered":"When Everything Goes Wrong D\u00e9j\u00e0 Dup"},"content":{"rendered":"

D\u00e9j\u00e0 Dup may fail. Maybe it crashes or gives you an error when you try to restore. When you really need your data back, the last thing you want do deal with is a bug. Consider filing a bug report<\/a>but in the meantime, here are some approaches to workaround a misbehaving D\u00e9j\u00e0 Dup and get your data back.<\/p>\n

This is going to get technical. If none of this makes sense to you, don’t be afraid to ask for help<\/a>.<\/p>\n

    \n
  1. Open a Terminal window by pressing Ctrl+Alt+T.<\/li>\n
  2. Create the directory in which you will place your restored files. This guide will use \/tmp\/restore:<\/li>\n<\/ol>\n
    mkdir -p \/tmp\/restore<\/pre>\n
    <\/p>\n
    Restoring with Duplicity<\/h3>\n
    On the assumption that D\u00e9j\u00e0 Dup is just not working for you right now, you’re going to use the command line tool duplicity that is used by D\u00e9j\u00e0 Dup behind the scenes to back up and restore your files.<\/p>\n
    If you want more information about duplicity than presented here, run man\u00a0duplicity<\/tt>.<\/p>\n
    The first thing we’ll try is a simple restore of all your data. Assuming your files are on an external drive mounted as \/media\/backup and you chose to encrypt the backup, try this:<\/p>\n
    duplicity --gio file:\/\/\/media\/backup \/tmp\/restore<\/pre>\n
    If you didn’t encrypt the backup, add –no-encryption to the command.<\/p>\n
    Other Backup Locations<\/h3>\n
    If you backed up to a remote or cloud server, the syntax you use with duplicity will be different than the external drive example above. See below for how to connect to your chosen backup location.<\/p>\n
    Remember to add –no-encryption to any example commands if you’re backup is not encrypted.<\/p>\n
    If duplicity appears to be having trouble connecting to your server, try downloading all the duplicity files yourself to a local folder and following the simpler example above.<\/p>\n
    Amazon S3<\/h4>\n
    Look up your Amazon S3 access key ID and secret access key and replace instances of ID<\/strong> and SECRET<\/strong>in the example below with those respective values.<\/p>\n
    You may have specified a folder in which to put the backup files. In the example below, replace any instance of FOLDER<\/strong>with that path.<\/p>\n
      \n
    1. export AWS_ACCESS_KEY_ID=ID<\/strong><\/li>\n
    2. export AWS_SECRET_ACCESS_KEY=SECRET<\/strong><\/li>\n
    3. duplicity s3+http:\/\/<\/tt>deja-dup-auto-LOWERCASE_ID<\/strong>\/FOLDER<\/strong> \/tmp\/restore<\/li>\n<\/ol>\n
      Rackspace Cloud Files<\/h4>\n
      Look up your Rackspace username and API key and replace instances of USERNAME<\/strong> and KEY<\/strong>in the example below with those respective values.<\/p>\n
      You may have specified a container in which to put the backup files. In the example below, replace any instance of CONTAINER<\/strong>with that name.<\/p>\n
        \n
      1. export CLOUDFILES_USERNAME=USERNAME<\/strong><\/li>\n
      2. export CLOUDFILES_APIKEY=KEY<\/strong><\/li>\n
      3. duplicity cf+http:\/\/<\/tt>CONTAINER<\/strong> \/tmp\/restore<\/li>\n<\/ol>\n
        FTP<\/h4>\n
        Look up your server address, port, username, and password and replace instances of SERVER<\/strong>, PORT<\/strong>, USERNAME<\/strong>, and PASSWORD<\/strong>in the example below with those respective values.<\/p>\n
        You may have specified a folder in which to put the backup files. In the example below, replace any instance of FOLDER<\/strong>with that path.<\/p>\n
        If you chose to not log in with a username, use anonymous as your USERNAME<\/strong>below.<\/p>\n
          \n
        1. gvfs-mount ftp:\/\/<\/tt>USERNAME<\/strong>@SERVER<\/strong>:PORT<\/strong>\/FOLDER<\/strong><\/li>\n
        2. duplicity –gio ftp:\/\/<\/tt>USERNAME<\/strong>@SERVER<\/strong>:PORT<\/strong>\/FOLDER<\/strong> \/tmp\/restore<\/li>\n<\/ol>\n
          SSH<\/h4>\n
          Look up your server address, port, username, and password and replace instances of SERVER<\/strong>, PORT<\/strong>, USERNAME<\/strong>, and PASSWORD<\/strong>in the example below with those respective values.<\/p>\n
          You may have specified a folder in which to put the backup files. In the example below, replace any instance of FOLDER<\/strong>with that path.<\/p>\n
            \n
          1. gvfs-mount ssh:\/\/<\/tt>USERNAME<\/strong>@SERVER<\/strong>:PORT<\/strong>\/FOLDER<\/strong><\/li>\n
          2. duplicity –gio ssh:\/\/<\/tt>USERNAME<\/strong>@SERVER<\/strong>:PORT<\/strong>\/FOLDER<\/strong> \/tmp\/restore<\/li>\n<\/ol>\n
            WebDAV<\/h4>\n
            Look up your server address, port, username, and password and replace instances of SERVER<\/strong>, PORT<\/strong>, USERNAME<\/strong>, and PASSWORD<\/strong>in the example below with those respective values.<\/p>\n
            You may have specified a folder in which to put the backup files. In the example below, replace any instance of FOLDER<\/strong>with that path.<\/p>\n
            If you chose to use a secure connection (HTTPS) when backing up, use davs:\/\/<\/tt> instead of dav:\/\/<\/tt>in the example below.<\/p>\n
              \n
            1. gvfs-mount dav:\/\/<\/tt>USERNAME<\/strong>@SERVER<\/strong>:PORT<\/strong>\/FOLDER<\/strong><\/li>\n
            2. duplicity –gio dav:\/\/<\/tt>USERNAME<\/strong>@SERVER<\/strong>:PORT<\/strong>\/FOLDER<\/strong> \/tmp\/restore<\/li>\n<\/ol>\n
              Windows Share<\/h4>\n
              Look up your server address, username, and password and replace instances of SERVER<\/strong>, USERNAME<\/strong>, and PASSWORD<\/strong>in the example below with those respective values.<\/p>\n
              You may have specified a folder in which to put the backup files. In the example below, replace any instance of FOLDER<\/strong>with that path.<\/p>\n
              If you specified a domain for your Windows server, add it to the beginning of USERNAME<\/strong> with a semicolon between them. For example, domain;username<\/em>.<\/p>\n
                \n
              1. gvfs-mount smb:\/\/<\/tt>USERNAME<\/strong>@SERVER<\/strong>\/FOLDER<\/strong><\/li>\n
              2. duplicity –gio smb:\/\/<\/tt>USERNAME<\/strong>@SERVER<\/strong>\/FOLDER<\/strong> \/tmp\/restore<\/li>\n<\/ol>\n
                Restoring by Hand<\/h3>\n
                If even duplicity isn’t working for you, there may be little hope. The backup file format is complicated and not easily manipulated. But if you’re desperate, it’s worth a try.<\/p>\n
                If you used a remote or cloud server to store your backup, first download all the duplicity files and place them in a folder on your computer. Then enter that folder in your terminal.<\/p>\n
                Duplicity stores your data in small chunks called volumes. Some volumes belong to the periodic ‘full’ or fresh backups and others to the ‘inc’ or incremental backups. Starting with a full backup set of volumes at volume 1, you’ll need to restore files volume by volume.<\/p>\n
                If you encrypted your backup, first you must decrypt the volume with gpg. Say you have duplicity-full.20110127T131352Z.vol1.difftar.gpg<\/em>:<\/p>\n
                gpg --output duplicity-full.20110127T131352Z.vol1.difftar --decrypt duplicity-full.20110127T131352Z.vol1.difftar.gpg<\/pre>\n
                Or to do all at once (make sure you have plenty of space!):<\/p>\n
                gpg --multifile --decrypt duplicity-full.20110127T131352Z.*.difftar.gpg<\/pre>\n
                Now you have either a .difftar<\/em> or a .difftar.gz<\/em>volume (depending on whether you had to decrypt it or not). Use tar on whichever one you have to extract the individual patch files:<\/p>\n
                tar xf duplicity-full.20110127T131352Z.vol1.difftar<\/pre>\n
                Or again, to do all at once:<\/p>\n
                for t in duplicity-full.20110127T131352Z.*.difftar; do tar xf $t; done<\/pre>\n
                Now the patch files will be in multivolume_snapshot<\/em> and snapshot<\/em> folders. Each file that spanned multiple volumes will be in multivolume_snapshot<\/strong>. Let’s say you backed up \/home\/jane\/essay.txt<\/tt>:<\/p>\n
                cd multivolume_snapshot\/home\/jane\/essay.txt\r\ncat * > essay.txt<\/pre>\n
                To recover data from incremental backups, use rdiff to stitch the files together. See man\u00a0rdiff<\/tt> for usage.<\/p>\n","protected":false},"excerpt":{"rendered":"
                D\u00e9j\u00e0 Dup may fail. Maybe it crashes or gives you an error when you try to restore. When you really need your data back, the last thing you want do deal with is a bug. Consider filing a bug reportbut in the meantime, here are some approaches to workaround a misbehaving D\u00e9j\u00e0 Dup and get […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/xfloyd.net\/blog\/index.php?rest_route=\/wp\/v2\/posts\/475"}],"collection":[{"href":"https:\/\/xfloyd.net\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/xfloyd.net\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/xfloyd.net\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/xfloyd.net\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=475"}],"version-history":[{"count":4,"href":"https:\/\/xfloyd.net\/blog\/index.php?rest_route=\/wp\/v2\/posts\/475\/revisions"}],"predecessor-version":[{"id":480,"href":"https:\/\/xfloyd.net\/blog\/index.php?rest_route=\/wp\/v2\/posts\/475\/revisions\/480"}],"wp:attachment":[{"href":"https:\/\/xfloyd.net\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=475"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/xfloyd.net\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=475"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/xfloyd.net\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=475"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}