extern/rclone
1
0
Fork 0
mirror of https://github.com/rclone/rclone.git synced 2025-02-16 10:32:39 +01:00
Code Issues Packages Projects Releases Wiki Activity

Updated Big syncs with millions of files (markdown)

lc63 2023-07-21 17:20:37 +02:00
parent e9a3ecc761
commit 4379b4245c
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
Big-syncs-with-millions-of-files.md

@ -36,7 +36,7 @@ You now have a list of files you need to transfer from src to dst and another li
Then break the need-to-transfer file up into chunks of (say) 10,000 lines with something like `split -l 10000 need-to-transfer` and run this on each chunk to transfer 10,000 files at a time. The `--files-from` and the `--no-traverse` means that this won't list the source or the destination:
```
rclone copy src:bucket dst:bucket --files-from need-to-transfera --no-traverse
rclone copy src:bucket dst:bucket --files-from need-to-transfer --no-traverse
rclone delete src:bucket dst:bucket --files-from need-to-delete --no-traverse
```