Migrating Data to Stook Using Rclone
Last updated
Was this helpful?
Last updated
Was this helpful?
Rclone is a versatile command-line tool that allows you to copy data between different cloud storage providers, including Medianova’s S3-compatible cloud-based object storage; Stook. In this guide, we'll walk through the process of using Rclone to migrate data from another S3-compatible storage provider to Stook.
Install Rclone: You can download and install Rclone from the official website ().
Open your terminal or command prompt and run the following command to configure Rclone:
Follow the interactive configuration wizard:
Choose n for a new remote.
Give your remote a name (e.g., "s3-source").
Select the S3-compatible storage provider you are migrating data from.
Enter the necessary configuration details, including endpoint URL, access key, secret key, and any other provider-specific information.
Repeat the above steps to configure a remote for your target bucket (e.g., "stook-target"). When picking the s3 compatible storage type, choose the Ceph Object Storage.
Now that you've configured both source and target remotes, you can start copying data. Use the rclone copy command to transfer your data:
Replace source-bucket-name with the name of your source bucket and target-bucket-name with the name of your target bucket. This command will copy all data from the source to the target bucket.
If you want to copy only specific files or directories, you can specify them in the command. For example:
Rclone will now display progress information, including the number of files transferred and their sizes. You can monitor the progress of the data transfer in real-time.
After the data transfer is complete, it is recommended to verify the integrity of the data in Stook. You can use rclone check for this. It compares sizes and hashes (MD5 or SHA1) and logs a report of files that don not match.
This command will ensure that the data in Stook matches the source bucket.
