Discussion:
[Duplicity-talk] how do I delete an entire backup+metadata?
Ted Timmons
2016-04-28 17:49:29 UTC
Permalink
I'm just getting started in Duplicity, now that there's a Backblaze B2
plugin. Below is my output; I started a backup without a gpg key, and now
it fails (after 180 minutes) because the metadata/backup isn't signed
properly. I'd like to just delete any data that's in B2. I see conditional
deletions like "remove-older-than" and "remove-all-but-..". But I don't see
"nuke it all".

time PASSPHRASE="xxx" /usr/local/bin/duplicity /mnt/nas/pictures --name
nas_pictures --num-retries 10 --encrypt-sign-key 44ASDFGH --tempdir
/mnt/nas/tmp/ --progress b2://***@tedder-duplicity-nas-pictures/
Local and Remote metadata are synchronized, no sync needed.
Last full backup left a partial set, restarting.
Last full backup date: Mon Apr 25 23:58:40 2016
Reuse configured PASSPHRASE as SIGN_PASSPHRASE
RESTART: Volumes 381 to 382 failed to upload before termination.
Restarting backup at volume 381.
Volume was signed by key None, not 44ASDFGH
e***@web.de
2016-04-28 18:09:14 UTC
Permalink
Post by Ted Timmons
I'm just getting started in Duplicity, now that there's a Backblaze B2
plugin. Below is my output; I started a backup without a gpg key, and now
it fails (after 180 minutes) because the metadata/backup isn't signed
properly. I'd like to just delete any data that's in B2. I see conditional
deletions like "remove-older-than" and "remove-all-but-..". But I don't see
"nuke it all".
time PASSPHRASE="xxx" /usr/local/bin/duplicity /mnt/nas/pictures --name
nas_pictures --num-retries 10 --encrypt-sign-key 44ASDFGH --tempdir
Local and Remote metadata are synchronized, no sync needed.
Last full backup left a partial set, restarting.
Last full backup date: Mon Apr 25 23:58:40 2016
Reuse configured PASSPHRASE as SIGN_PASSPHRASE
RESTART: Volumes 381 to 382 failed to upload before termination.
Restarting backup at volume 381.
Volume was signed by key None, not 44ASDFGH
for a left over partial you should be able to run the 'clean' command. also a new forced full backup should do the trick here.

..ede/duply.net
Ted Timmons
2016-05-02 04:03:59 UTC
Permalink
Thanks Edgar. '--force' didn't work, but 'clean' did. I'm now seeing
"stalled" and 403 errors when backing up to duplicity. It ran for 8 hours
before this- maybe it was just too many network hiccups in those 8 hours?


Looking in Backblaze, it has ~1gb and 38 files. Here is what I'm seeing on
a couple of runs. The 403 forbidden is especially weird- that one errored
out aftero 10 hours.




0.0KB 01:47:57 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:00 [0.0B/s] [> ] 0% ETA Stalled!
Attempt 9 failed. HTTPError: HTTP Error 403: Forbidden
0.0KB 01:48:03 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:06 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:09 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:12 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:15 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:18 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:21 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:24 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:27 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:30 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:33 [0.0B/s] [> ] 0% ETA Stalled!
Giving up after 10 attempts. HTTPError: HTTP Error 403: Forbidden


second run, with -vwarning:
Attempt 1 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 2 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 3 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 4 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 5 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 6 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 7 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 8 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 9 failed. HTTPError: HTTP Error 403: Forbidden
Giving up after 10 attempts. HTTPError: HTTP Error 403: Forbidden
Post by Ted Timmons
Post by Ted Timmons
I'm just getting started in Duplicity, now that there's a Backblaze B2
plugin. Below is my output; I started a backup without a gpg key, and now
it fails (after 180 minutes) because the metadata/backup isn't signed
properly. I'd like to just delete any data that's in B2. I see
conditional
Post by Ted Timmons
deletions like "remove-older-than" and "remove-all-but-..". But I don't
see
Post by Ted Timmons
"nuke it all".
time PASSPHRASE="xxx" /usr/local/bin/duplicity /mnt/nas/pictures --name
nas_pictures --num-retries 10 --encrypt-sign-key 44ASDFGH --tempdir
Local and Remote metadata are synchronized, no sync needed.
Last full backup left a partial set, restarting.
Last full backup date: Mon Apr 25 23:58:40 2016
Reuse configured PASSPHRASE as SIGN_PASSPHRASE
RESTART: Volumes 381 to 382 failed to upload before termination.
Restarting backup at volume 381.
Volume was signed by key None, not 44ASDFGH
for a left over partial you should be able to run the 'clean' command.
also a new forced full backup should do the trick here.
..ede/duply.net
_______________________________________________
Duplicity-talk mailing list
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
e***@web.de
2016-05-02 09:07:04 UTC
Permalink
'--force' is an option to destructive commands like 'clean, purge'. the manpage describes when it's needed.

1. try w/o progress, sometimes it disrupts things.

2. looks like an auth issue, maybe a bug in the still new backend.

..ede/duply.net
Post by Ted Timmons
Thanks Edgar. '--force' didn't work, but 'clean' did. I'm now seeing
"stalled" and 403 errors when backing up to duplicity. It ran for 8 hours
before this- maybe it was just too many network hiccups in those 8 hours?
Looking in Backblaze, it has ~1gb and 38 files. Here is what I'm seeing on
a couple of runs. The 403 forbidden is especially weird- that one errored
out aftero 10 hours.
0.0KB 01:47:57 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:00 [0.0B/s] [> ] 0% ETA Stalled!
Attempt 9 failed. HTTPError: HTTP Error 403: Forbidden
0.0KB 01:48:03 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:06 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:09 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:12 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:15 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:18 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:21 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:24 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:27 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:30 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:33 [0.0B/s] [> ] 0% ETA Stalled!
Giving up after 10 attempts. HTTPError: HTTP Error 403: Forbidden
Attempt 1 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 2 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 3 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 4 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 5 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 6 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 7 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 8 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 9 failed. HTTPError: HTTP Error 403: Forbidden
Giving up after 10 attempts. HTTPError: HTTP Error 403: Forbidden
Post by Ted Timmons
Post by Ted Timmons
I'm just getting started in Duplicity, now that there's a Backblaze B2
plugin. Below is my output; I started a backup without a gpg key, and now
it fails (after 180 minutes) because the metadata/backup isn't signed
properly. I'd like to just delete any data that's in B2. I see
conditional
Post by Ted Timmons
deletions like "remove-older-than" and "remove-all-but-..". But I don't
see
Post by Ted Timmons
"nuke it all".
time PASSPHRASE="xxx" /usr/local/bin/duplicity /mnt/nas/pictures --name
nas_pictures --num-retries 10 --encrypt-sign-key 44ASDFGH --tempdir
Local and Remote metadata are synchronized, no sync needed.
Last full backup left a partial set, restarting.
Last full backup date: Mon Apr 25 23:58:40 2016
Reuse configured PASSPHRASE as SIGN_PASSPHRASE
RESTART: Volumes 381 to 382 failed to upload before termination.
Restarting backup at volume 381.
Volume was signed by key None, not 44ASDFGH
for a left over partial you should be able to run the 'clean' command.
also a new forced full backup should do the trick here.
..ede/duply.net
_______________________________________________
Duplicity-talk mailing list
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
_______________________________________________
Duplicity-talk mailing list
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
Ted Timmons
2016-05-02 15:59:44 UTC
Permalink
Aha, here's more on the auth issue from -vdebug. I'll remove --progress for
the next run.

Getting https://api000.backblaze.com/b2api/v1/b2_list_file_names
Request of https://api000.backblaze.com/b2api/v1/b2_list_file_names
returned with status 200
Getting https://api000.backblaze.com/b2api/v1/b2_delete_file_version
Getting https://api000.backblaze.com/b2api/v1/b2_get_upload_url
0.0KB 00:05:33 [0.0B/s] [> ] 0% ETA Stalled!
Backtrace of previous error: Traceback (innermost last):
File "/usr/local/lib/python2.7/dist-packages/duplicity/backend.py", line
367, in inner_retry
return fn(self, *args)
File "/usr/local/lib/python2.7/dist-packages/duplicity/backend.py", line
520, in put
self.__do_put(source_path, remote_filename)
File "/usr/local/lib/python2.7/dist-packages/duplicity/backend.py", line
506, in __do_put
self.backend._put(source_path, remote_filename)
File
"/usr/local/lib/python2.7/dist-packages/duplicity/backends/b2backend.py",
line 111, in _put
info = self.get_upload_info(self.bucket_id)
File
"/usr/local/lib/python2.7/dist-packages/duplicity/backends/b2backend.py",
line 247, in get_upload_info
return self.get_or_post(url, {'bucketId': bucket_id})
File
"/usr/local/lib/python2.7/dist-packages/duplicity/backends/b2backend.py",
line 268, in get_or_post
with OpenUrl(url, data, encoded_headers) as resp:
File
"/usr/local/lib/python2.7/dist-packages/duplicity/backends/b2backend.py",
line 345, in __enter__
self.file = urllib2.urlopen(request)
File "/usr/lib/python2.7/urllib2.py", line 154, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python2.7/urllib2.py", line 437, in open
response = meth(req, response)
File "/usr/lib/python2.7/urllib2.py", line 550, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python2.7/urllib2.py", line 475, in error
return self._call_chain(*args)
File "/usr/lib/python2.7/urllib2.py", line 409, in _call_chain
result = func(*args)
File "/usr/lib/python2.7/urllib2.py", line 558, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 403: Forbidden
Giving up after 10 attempts. HTTPError: HTTP Error 403: Forbidden
Post by e***@web.de
'--force' is an option to destructive commands like 'clean, purge'. the
manpage describes when it's needed.
1. try w/o progress, sometimes it disrupts things.
2. looks like an auth issue, maybe a bug in the still new backend.
..ede/duply.net
Post by Ted Timmons
Thanks Edgar. '--force' didn't work, but 'clean' did. I'm now seeing
"stalled" and 403 errors when backing up to duplicity. It ran for 8 hours
before this- maybe it was just too many network hiccups in those 8 hours?
Looking in Backblaze, it has ~1gb and 38 files. Here is what I'm seeing
on
Post by Ted Timmons
a couple of runs. The 403 forbidden is especially weird- that one errored
out aftero 10 hours.
0.0KB 01:47:57 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:00 [0.0B/s] [> ] 0% ETA Stalled!
Attempt 9 failed. HTTPError: HTTP Error 403: Forbidden
0.0KB 01:48:03 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:06 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:09 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:12 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:15 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:18 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:21 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:24 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:27 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:30 [0.0B/s] [> ] 0% ETA Stalled!
0.0KB 01:48:33 [0.0B/s] [> ] 0% ETA Stalled!
Giving up after 10 attempts. HTTPError: HTTP Error 403: Forbidden
Attempt 1 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 2 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 3 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 4 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 5 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 6 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 7 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 8 failed. HTTPError: HTTP Error 403: Forbidden
Attempt 9 failed. HTTPError: HTTP Error 403: Forbidden
Giving up after 10 attempts. HTTPError: HTTP Error 403: Forbidden
Post by Ted Timmons
Post by Ted Timmons
I'm just getting started in Duplicity, now that there's a Backblaze B2
plugin. Below is my output; I started a backup without a gpg key, and
now
Post by Ted Timmons
Post by Ted Timmons
Post by Ted Timmons
it fails (after 180 minutes) because the metadata/backup isn't signed
properly. I'd like to just delete any data that's in B2. I see
conditional
Post by Ted Timmons
deletions like "remove-older-than" and "remove-all-but-..". But I don't
see
Post by Ted Timmons
"nuke it all".
time PASSPHRASE="xxx" /usr/local/bin/duplicity /mnt/nas/pictures --name
nas_pictures --num-retries 10 --encrypt-sign-key 44ASDFGH --tempdir
Local and Remote metadata are synchronized, no sync needed.
Last full backup left a partial set, restarting.
Last full backup date: Mon Apr 25 23:58:40 2016
Reuse configured PASSPHRASE as SIGN_PASSPHRASE
RESTART: Volumes 381 to 382 failed to upload before termination.
Restarting backup at volume 381.
Volume was signed by key None, not 44ASDFGH
for a left over partial you should be able to run the 'clean' command.
also a new forced full backup should do the trick here.
..ede/duply.net
_______________________________________________
Duplicity-talk mailing list
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
_______________________________________________
Duplicity-talk mailing list
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
_______________________________________________
Duplicity-talk mailing list
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
Loading...