BREAKING CHANGE(deps): Update gilbertchen/duplicacy 1.8.0 → v3.2.5

[truecharts-admin]

This PR contains the following updates:

Package	Update	Change
gilbertchen/duplicacy	major	1.8.0 → v3.2.5

---

Warning

Some dependencies could not be looked up. Check the Dependency Dashboard for more information.

---

Release Notes

gilbertchen/duplicacy (gilbertchen/duplicacy)

v3.2.5: Duplicacy Command Line Version 3.2.5

Compare Source

• Fixed bugs in OneDrive related to the handling of fossils: df76bd0
• Use regex in swift storage url parsing to allow a username to contain a @: 065ae50

v3.2.4: Duplicacy Command Line Version 3.2.4

Compare Source

• Fixed a bug causing prune to repeatedly overwrite collection 1 in -collect-only mode
• Remove incomplete_files when backup completes successfully
• Do not save incomplete snapshots for dry run to avoid corrupting subsequent backups
• Corrected zstd compression level name from "fast" to "fastest"
• Save the list of verified chunks every 5 minutes for crash resilience
• Don't add corrupt chunks to verified_chunks
• Use a different API to find the id of a GCD drive by name for cases with more than 10 shared drives
• Upgrade go to version 1.21.13

v3.2.3: Duplicacy Command Line Version 3.2.3

Compare Source

• Upgrade storj.io/uplink to v1.12.1 to fix an 64 bit alignment issue: e99dfea

v3.2.2: Duplicacy Command Line Version 3.2.2

Compare Source

• Save storj credentials in keychain/keyring after a storj storage has been successfully created: 7bfc0e7

v3.2.1: Duplicacy Command Line Version 3.2.1

Compare Source

• Removed a false check that caused an initialization error with zstd-enabled storages: #​653 (thanks @​gorbak25)
• Allow two copy-compatible storages to have different compression levels: 4e9d2c4
• Skip identical entries when listing chunks: d92b173
• Upgraded Go version to 1.19.13

v3.2.0: Duplicacy Command Line Version 3.2.0

Compare Source

• Added a Samba backend: 3a81c10
• Implemented zstd compression: 53b0f3f
• Added support for custom OneDrive credentials: #​632 (thanks to @​sevimo123)
• Added support for SharePoint document libraries to the ODB backend: #​633 (thanks to @​sevimo123)
• Fixed a connection leak in the Dropbox backend on some http errors: gilbertchen/go-dropbox#5 (thanks to @​northnose)
• Fixed bugs that caused the B2 and Google Drive backends to fail to download metadata chunks that have been marked as fossils: ff207ba 1f9ad0e
• Fixed a crash when some backends return with an empty entry path: cdf8f5a
• Fixed a crash caused by concurrent access to a map during chunk verification: #​649 (thanks to @​northnose)
• Fixed a chunk leak when listing files in a revision: 9be475f

v3.1.0: Duplicacy Command Line Version 3.1.0

Compare Source

• Updated github.com/minio/highwayhash to 1.02 to fix incorrect hashes for Erasure Coding on arm64 [1]: 6a7a2c8
• Add -rewrite to the check command to fix corrupted chunks with Erasure Coding enabled:
• Fixed a bug that didn't preserve the version bit when copying snapshots in the old V2 format [2]: 58f0d2b
• Use the updated access token after a token refresh in the dropbox backend: gilbertchen/go-dropbox@60ebcdb (by @​stuckj)
  bc2d762
• Fixed a chunk leak with check -files: b8c7594
• Fixed 2 bugs that are results of handling zero-byte files incorrectly: 3472206

Notes:
[1] The highwayhash is only used to calculate the checksum of each shard in Erasure Coding and not used anywhere else. So you are affected by this bug only if you enable Erasure Coding on arm64 machines. This bug is present in both 3.0.1 and 2.7.2 versions of the macOS m1 builds, and only in 3.0.1 of the linux arm64 builds.

In this release both the correct and incorrect versions of the highwayhash will be calculated so there is no need to fix existing storages, but you can use the newly added -rewrite option to rewrite affected chunks using the correct version of the hash if desired.

[2] If you are using 3.0.1 to copy snapshots created with 2.7.2 or earlier, this bug will affect you. In 3.0.1, the version bit (0 for V2 snapshots and 1 for V3 snapshots) was the only flag used to determine the format of a snapshot. However, in this release, the first byte of the snapshot file is also used to distinguish between V2 and V3 formats. As a result, there is no need to rewrite V2 snapshots that were already copied with the incorrect version bit.

v3.0.1: Duplicacy Command Line Version 3.0.1

Compare Source

• Completely rewrite the backup engine to achieve near-constant memory usage regardless of backup size (#​625)
• New storage backend for Storj (6009f64)
• Use long-lived refresh token for the Dropbox backend (cde660e)
• Update the Swift storage to V2 (#​626)
• Add a global option -print-memory-usage to print memory usage during execution
• Find the storage path in shared folders first when connecting to Google Drive (e43e848)
• Support GCD impersonation via modified service account file (#​612)
• Built with Go 1.16.15 with Go modules enabled

v3.0.0: Duplicacy Command Line Version 3.0.0

Compare Source

• Completely rewrite the backup engine to achieve near-constant memory usage regardless of backup size (#​625)
• New storage backend for Storj (6009f64)
• Use long-lived refresh token for the Dropbox backend (cde660e)
• Update the Swift storage to V2 (#​626)
• Add a global option -print-memory-usage to print memory usage during execution
• Find the storage path in shared folders first when connecting to Google Drive (e43e848)
• Support GCD impersonation via modified service account file (#​612)
• Built with Go 1.19 with Go modules enabled

v2.7.2: Duplicacy Command Line Version 2.7.2

Compare Source

• Make -vss work with Big Sur: 7c36311
• Skip chunks already verified in previous runs when running check -chunks: d7c1903
• Fixed reading/writing extended attributes on Linux by switching to github.com/pkg/xattr: b392302
• Fixed a bug that caused a fresh restore of large files to fail without the -overwrite option: bec3a0e
• Validate that a repository id can only contain letters, numbers, dashes, and underscores: 5eed6c6
• Fixed a crash in the Dropbox backend caused by a nil Seeker: gilbertchen/go-dropbox@2233fa1

v2.7.1: Duplicacy Command Line Version 2.7.1

Compare Source

This release is mainly to fix a crash caused by unaligned 64-bit integers on 32-bit OS. If you're running Duplicacy on 64-bit OS there is no need to upgrade.

Changes:

• Fixed a 64-bit integer alignment problem on 32-bit OS: 0da55f9
• Allow chunks subdirectories in the local disk storage to be symlinks : 7e372ed 2f407d6

v2.7.0: Duplicacy Command Line Version 2.7.0

Compare Source

• Added support for erasure coding to detect and recover from corrupt chunks: #​606
• Added a -persist option to check and restore to continue despite errors: #​595 (by @​twlee79)
• Added exclude_by_attribute preference to exclude files based on os-specific extended attributes: #​498 (by @​plasticrake)
• Fix and improvements for the OneDrive backend: eecbb8f
• Improvements for the WebDAV backend: #​549 (by @​Jos635), e3e3e97
• Fixed a bug that broke the Swift backend: #​594 (by @​alecuyer)
• Added a -download-threads option to the copy command for specifying the number of downloading threads: 9470064
• Show progress log messages during copy: 9470064
• Show progress log messages when verifying chunks (check -chunks): d0b3b5d

v2.6.2: Duplicacy Command Line Version 2.6.2

Compare Source

This release is to fix a bug where upload errors may be ignored by the sftp backend resulting in incomplete chunk files.

If you're backing up to an sftp storage, we suggest you upgrade to this version and run a check command with the -chunks option to find out if any chunk is affected by this bug.

v2.6.1: Duplicacy Command Line Version 2.6.1

Compare Source

This release is to fix a bug that causes a check command to fail if there are empty temporary chunk files in the disk or sftp storage. These files may be created by a failed or ongoing chunk upload so they are usually harmless and should not throw an error.

v2.6.0: Duplicacy Command Line Version 2.6.0

Compare Source

New Features:

• Add a new backend for StorageMadeEasy's File Fabric storage: ed8b439
• Add a -key-passphrase option to pass in passphrase for RSA private key: 089e19f
• Use multiple threads to list the chunks directory for Google Drive: 153f6a2
• Add a variation of the SFTP backend to support older ciphers and key exchange algorithms for compatibility: 1adcf56
• Error out in the check command if there are 0-size chunks: fe854d4

Bug fixes:

• Fix a crash when a username is not specified in the WebDAV storage url: 1da7e2b
• Fixed a bug in Dropbox backend that can cause 0-byte files to be uploaded after retrying on an error: 5e28dc4
• Retry on "unexpected EOF" errors for the webdav backend: f2f07a1
• Clear the loaded content after a snapshot has been verified to reduce memory usage: 5d45999
• Ignore 0-byte chunks passed in by the chunk reader: 09e3cdf

v2.5.2: Duplicacy Command Line Version 2.5.2

Compare Source

• Fixed a bug that caused check -chunks to store every chunk in the local cache .duplicacy/cache: 6ca8b8d
• Fixed a bug that the token file path for OneDrive Business isn't saved to KeyChain/Keyring: 9c3122b

v2.5.1: Duplicacy Command Line Version 2.5.1

Compare Source

• Fixed a bug in ssh login with encrypted private key: 835af11

v2.5.0: Duplicacy 2.5.0 Command Line Version

Compare Source

• Add support for Microsoft OneDrive for Business: d26ffe2
• Add support for Google Shared Drive: #​579 by @​rsanger
• Ignore a "operation not supported" error when backing up to a Samba share that doesn't support the sync operation: #​590 by @​fbarthez
• Add a -chunks option to the check command for verifying chunks: 22d6f3a
• Allow a ssh private key file to be used together with a signed certificate trusted by the server: #​547 by @​philband
• Fail the backup if the repository can't be accessed or there are no files in the repository: 810303c
• Access Google Drive via service accounts: 7208adb
• Add a global -suppress option to suppress logs with given ids: 749db78
• Call ReadAll() on the http body to allow the http keepalive connection to be reused in the dropbox backend: #​593 by @​freaksdotcom
• Update github.com/aws/aws-sdk-go and google.golang.org/api to the latest: eebcece

v2.4.1: Duplicacy 2.4.1 Command Line Version

Compare Source

This is an emergency release for fixing a bug in the copy command when the destination storage is RSA-encrypted: 6699e2f

You're affected by this bug if you're

1. running 2.3.0 and copying from a source storage of any type (unencrypted, RSA-encrypted, and non-RSA-encrypted) to an RSA-encrypted destination storage
2. running 2.4.0 and copying from a source storage (unencrypted or non-RSA-encrypted) to an RSA-encrypted destination storage

You'll need to clean up the storage and start from fresh; otherwise either all chunks are not encrypted by RSA (case 2), or all chunks are encrypted by RSA (case 1) causing all commands (backup, list, check, and prune) to require the private key to work.

v2.4.0: Duplicacy 2.4.0 Command Line Version

Compare Source

• Reduced the memory usage of the copy command by releasing the list of chunk hashes after processing each snapshot: d43fe1a
• Fix the retry logic in the sftp backend: e888b6d
• Support free downloading from B2 with a custom URL: #​589
• Fixed a bug that caused all copied chunks to be RSA encrypted: cc88abd
• Fixed handling of repository ids with spaces in the b2 backend: a6ce64e

v2.3.0: Duplicacy 2.3.0 Command Line Version

Compare Source

Features:

• RSA encryption (https://forum.duplicacy.com/t/new-feature-rsa-encryption/2662)
• Allow a custom location for the filters file (a99f059)

Bug fixes:

• For the check command, -tabular should imply -all just like -stats (1651524)
• Make -vss work on Mac OS Catalina (#​578 by @​gboudreau)
• Update pkg/sftp to 1.10.1 to fix a deadlock in the sftp backend (9abfbe1, see discussion at https://forum.duplicacy.com/t/deadlock-during-backup/2835)
• If a symlink is a directory, match it against the patterns as a directory (b32c3b2)
• Fixed a path not found error on Windows when the path to a symlink is too long (ca7d927)

Improvements:

• Throw an error, instead of a warning, if pre/post script fails (694494e)
• Increase the number of retries for the b2 backend (e02041f)

v2.2.3: Duplicacy 2.2.3 Command Line Version

Compare Source

• Fix a B2 401 error when using an application key by providing the bucket name to b2_list_buckets (#​570 by @​philband)

v2.2.2: Duplicacy 2.2.2 Command Line Version

Compare Source

• Better handling of B2 authorization failures (045be39)
• Fixed a bug that caused 'check -files' to download the same chunk multiple times if shared by multiple small files (4da7f7b)
• Update github.com/gilbertchen/go.dbus to fix a double close bug when accessing keyring on linux (41668d4)
• Don't compare hashes of empty files in the diff command (9d4ac34)
• Retry on broken pipe errors in the Azure backend (6efcd37)

v2.2.1: Duplicacy 2.2.1 Command Line Version

Compare Source

This release is mostly a bug fix version for 2.2.0 which has a bug that can't restore individual files due to parent directories not being created correctly: 47c4c25

Other changes:

• Licensing change: the CLI license is now per-computer: 37781f9
• Add a TRACE log message when skipping an unchanged file during restore: 6e7d45c

v2.2.0: Duplicacy 2.2.0 Command Line Version

Compare Source

• Allow the filters file to include other filters files (#​514)
• On Windows add the \?\ prefix to add paths to support UNC paths in the storage URL (53548a8)
• Support ssh private key files encrypted by passphrases (8aa67c8)
• Add a Sync call before closing a file when uploading a file to local storage (bb652d0)
• Ignore false malware warnings from Google Drive that prevent some chunks to be downloaded (#​447)
• Retry on EOF errors in the SFTP backend (#​489)
• Replace special characters in environment variable name with underscores (#​495)
• Fixed a webdav compatibility issue with rclone (2b56d57)
• Set the content length for upload in the webdav backend (d16273f)
• Fixed a bug where a wrong variable is used as the number of threads causing incorrect rate limits (43a5ffe)
• Fixed a bug where filenames starting with i or e are mistakenly interpreted as regex (abcb4d7)
• Fix a memory issue that causes check -tabular uses too much memory with hundreds of revisions (4b69c11)
• Add an additional lookup for a chunk not in the known chunk list (1da151f)
• Fixed a MoveFile bug in Wasabi when the storage is at the root of a bucket (a6fe3d7)
• Retry on 408 errors from Google Drive (#​529)
• The cat command doesn't need to load the entire file into memory (458687d)
• Rework the Backblaze B2 backend (57a408a)
  • All APIs include UploadFile are done via the call() function
  • New retry mechanism limiting the maximum backoff each time to 1 minute
  • Add an env var DUPLICACY_B2_RETRIES to specify the number of retries
  • Handle special/unicode characters in repositor ids
  • Allow a directory in a bucket to be used as the storage destination

v2.1.2: Duplicacy 2.1.2 Command Line Version

Compare Source

• Fixed a bug in calculating the padding size during chunk encryption: 21b3d9e
• Print the number of files if available in the snapshot file before downloading the file list: 244b797
• Don't list snapshots whose tags don't match the given one when the -tag is provided: 0732920
• Show more statistics in the check command (for the new web-based GUI): 15f15aa
• In some backends the benchmark command may incorrectly list the chunks directory when looking for previous temporary files: d8e13d8
• Optimizing restore to avoid reading newly created sparse file: bfb4b44
• Align snapshot times to the beginning of days when calculating the time differences so that prune operations running on the same day will prune the same set of old snapshots: 22a0b22
• Make B2 backend work with application keys (based on #​475 by @​bekriebel): 674d35e
• Restore UID and GID of symlinks: a7d2a94
• Fixed a divide by zero bug when the repository has only zero-byte files: 39d71a3
• Do not update the Windows keyring file if the password remains unchanged: 9d10cc7
• Continue to check other snapshots when one snapshot has missing chunks: e8b8922
• Record deleted snapshots in the fossil collection and if any deleted snapshot still exists then nuke the fossil collection: 93cc632
• Add Git commit numbers to version info: 48cc5ea
• Removed a redundant call to manager.chunkOperator.Resurrect (which can cause a crash): f304b64
• Remove extra newline in the PRUNE_NEWSNAPSHOT log message: 8ae7d2a
• Fix crashes on 32 bit machines caused by misaligned 64 bit integers: fce4234
• Fix "Failed to fossilize chunk" errors in wasabi backend: #​459 (by @​jtackaberry)
• Add a -storage option to the benchmark comman: 89769f3

v2.1.1: Duplicacy 2.1.1 Command Line Version

Compare Source

• Fixed a bug causing certain new snapshots to be not counted when deciding which fossils can be deleted (72dfaa8)
• Added a benchmark command to test disk and transfer performance (#​449)
• Support multi-threaded pruning (#​441)
• Fixed restoration of basic UNIX file permissions (#​417)
• Added macOS APFS snapshot support (#​415)
• Fixed a crashing bug when showing the history of excluded files (0e585e4)
• Add unreferenced fossils to the fossil collection instead of deleting them immediately (e03cd2a)
• Added an -enum-only option to the backup command to enumerate the repository only (aadd2aa)
• Added a -repository option to the init and add command to specify an alternate repository path (72239a3)
• Implemented the WebDAV backend (#​394)
• Added a -nobackup-file option to the set command to skip directories containing the specified file (#​392)
• Add an environment variable DUPLICACY_DECRYPT_WITH_HMACSHA256 to force compatibility with Vertical Backup (b1c1b47)
• Skipped chunks should not be counted when calculating downloading percentage during restore (23a2d91)
• Added a global option -commend to allow Duplicacy processed to be identified by arguments (#​391)
• Follow symlinks that point to UNC paths on Windows (b99f4bf)
• Added a -vss-timeout option to set VSS creation timeout (be2856e)
• Reduced memory consumption for prune operation (#​329)
• Added a new Wasabi storage backend largely based on S3 but optimized to reduce storage cost for deleted objects (#​322)
• Print git commit number in version string (48cc5ea)
• Record deleted snapshots in the fossil collection and if any deleted snapshot still exist nuke the fossil collection (93cc632)
• Continue to check other snapshots when one snapshot has missing chunks (e8b8922)

v2.1.0: Duplicacy 2.1.0 Command Line Version

Compare Source

• Retry on temporary network errors in the Azure backend
• Added an OpenStack Swift backend based on github.com/ncw/swift
• Fixed a bug when both tag and the retention policy are specified for the prune command
• Fixed bugs in restoring extended attributes
• Unload the extended attributes from last snapshot in order to save memory
• Limited derivation keys to 64 bytes since snapshot file paths used as keys may be longer
• Fixed a bug that caused -hash to have no effect
• Correctly handle spaces in file paths for the B2 backend
• Improved the Hubic backend to retry on various errors
• Fixed a bug that caused -hash to have no effect
• Don't download a fossil directly; turn it back to a chunk and download the chunk instead
• Add a -storage-name option to the init command to specify the storage name
• Add the global -profile option to enable profiling via http
• Allow the -bit-identical option to the add command to copy the config file as it is
• Disable caching when restoring files in SnapshotManager
• Removed aes128-cbc from the supported ciphers by HiDrive
• Refresh expired tokens unconditionally on authorization errors for Hubic and OneDrive
• Fixed a bug that prevents the file specifying the chunk nesting levels from being loaded and parsed
• Fix the GCD directory creating bug; only save directories in the id cache
• Remove existing config and save a local copy when changing the storage password
• Create the storage folder on gcd storage if it doesn't exist

v2.0.10: Duplicacy 2.0.10 Command Line Version

Compare Source

• Optimize the copy command to skip chunks existing on the destination storage
• Add the -dry-run option to the backup command
• Include storage name when looking up passwords for non-default storages
• Fix prune bug when last snapshot is removed for issue
• Add regex matching to include/exclude filters
• Add the -tabular option to the check command to show tabular usage and deduplication statistics
• Improve the backoff algorithm for the Google Drive storage
• Use b2_download_file_by_name rather than b2_list_file_names to check file existence
• Retry downloads with corrupted content up to three times
• Use random salt and make the number of iterations configurable for storage key derivation
• Add an -ignore-owner option to skip setting uid/gid on restored files
• Unify the chunk nesting level to 1 for all storages
• Fix a bug in splitting the existing file that caused all chunks to be redownloaded
• Add a -bit-identical option to the add command to make a bit-identical copy of the config file
• Increase the timeout for shadow copy creation on Windows
• Various changes to improve password management

v2.0.9: Duplicacy 2.0.9 Command Line Version

Compare Source

• Fixed OneDrive 503 errors by sending GET requests with a nil body
• Fixed symbolic link handling on Windows
• The copy command now skips chunks already on destination
• Fixed a bug in setting the upload/download rate limit for the copy command
• Fixed a bug in setting the number of threads for the copy command
• Update aws/aws-sdk-go to version 1.10.41
• Don't save passwords/credentials to keyring if they are retrieved from environment/preference
• Don't ask for ssh password if a ssh key file is available
• Fixed a bug in retrieving passwords from gnome-keyring
• In GCD backend each thread should have its own backoff value
• Fixed a bug in storage passwords in preferences for non-default storages

v2.0.7: Duplicacy 2.0.7 Command Line Version

Compare Source

• Updated Azure storage backend to support retrying on temporary errors
• The restore command now preserves empty directories
• Fixed a chunk not found error caused by Windows drives with data deduplication on
• Fixed a bug that caused truncated files not to be restored correctly
• Added a flat:// storage backend that can take a flat chunks directory on local or networked drives
• Added a samba:// storage backend that is basically a local drive backend but with caching enabled (for networked drives)

v2.0.6: Duplicacy 2.0.6 Command Line Version

Compare Source

• Fixed incorrect progress statistics during backup and restore
• Increased HTTPS timeouts for overloaded Hubic servers
• Force in-place restore mode with a non-default preference path
• Added new S3 storage backends to support minio and other s3-compatible providers
• Fixed a bug that caused a size -1 error
• The history command can now skip revisions in which the specified file does exist
• Fixed a bug in the fixed-size chunking algorithm
• Improve OneDrive backend by retrying on various errors
• Full sparse file support

v2.0.5: Duplicacy 2.0.5 Command Line Version

Compare Source

• Retry on authentication errors for Google Drive
• Fixed inaccurate restore statistics that mistakenly take existing files into account
• Enhance the B2 storage backend to retry on 3xx status codes
• Fixed a bug that caused backup to fail due to incorrect file size
• Fixed incorrect progress report during restore
• Verify ids of snapshot chunks before uploading them

v2.0.3: Duplicacy 2.0.3 Command Line Version

Compare Source

• Fixed a bug in disk or SFTP storage backends that caused a directory creation error when multiple threads are used
• Fixed a bug that caused the copy operation to crash
• Added a -pref-dir option to the init command to specify an alternate location for the .duplicacy preference directory (contributed by @​ech1965)
• Rewrote the S3 storage backend using the official Amazon S3 client library

v2.0.2: Duplicacy 2.0.2 Command Line Version

Compare Source

• Allow a root drive to be selected as the storage on Windows
• Fixed a divide by zero error when verbose logging is turned on
• Fixed a bug that caused restoration of two adjacent files to crash

---

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

---

• If you want to rebase/retry this PR, check this box

---

This PR has been generated by Renovate Bot.

[Crow-Control]

Auto approved automated PR