Managing large datasets or research wikis across multiple devices can be a headache, especially with Google Drive’s native client limitations on Linux. Rclone is the gold standard for bridging this gap, offering a powerful, command-line interface for seamless cloud synchronization.
In this guide, I’ll walk you through setting up a robust, “permanent” connection that doesn’t require daily re-authentication, along with my recommended daily workflow.
If you use the default rclone configuration, you might find yourself logging in and authorizing every few days. To stop this and gain better performance, you should create your own Google Client ID.
rclone-sync.Run rclone config, edit your existing gdrive remote (or create a new one), and paste your new client_id and client_secret when prompted. This makes your connection much more stable and faster.
To keep your files synced without accidents, I recommend this routine:
If you’ve worked on another device, bring those changes to your local machine:
rclone copy gdrive:works /home/paul/works -P
Back up your locally modified files to the cloud:
rclone copy /home/paul/works gdrive:works -P
If you’ve only updated one project and don’t want to scan your entire works directory, you can target that specific subfolder to save time:
rclone copy /home/paul/works/academics gdrive:works/academics -P
[!TIP] Use
copyinstead ofsyncmost of the time.copyonly adds files to the destination;synccan delete files if they are missing on the source.
Before a big transfer, see what has actually changed:
rclone check /home/paul/works gdrive:works --size-only
Google Drive sometimes creates two files with the exact same name. Rclone can fix this automatically:
rclone dedupe gdrive:works
If you ever get an “Authorization failed” error, run:
rclone config reconnect gdrive:
Checks: 2679 / 2679: Rclone compared all files and found them identical. It did NOT re-transfer them, saving you time and bandwidth.Progress (-P): Always use this flag to see real-time transfer speeds and percentages.By following this setup, your research data and wiki will stay synchronized and secure, allowing you to focus on the science rather than the plumbing.
Happy Syncing! 📂✨
Powered by Jekyll and Minimal Light theme.