Thank you for your donation!


Cloudsmith graciously provides open-source package management and distribution for our project.


Idea: API connection to Cloud, like Google Drive, OneDrive and Dropbox
#5
(11-01-2019, 04:11 AM)godt2p4 Wrote: Fortunately, I've added my music folder from GoogleDrive as a local folder under /mnt by rclone, via curl https://rclone.org/install.sh | sudo bash

The stream of playing cloud music is OK.

But I still have some confusion, how to speed up the process to add the cloud into Library, about 400 tracks per hour, quite slow.

Thank you.

I tested several approaches after you broached the subject and passed my findings to Tim. Rclone certainly works and is what I ended up suggesting he try instead of ocamlfuse.

First, the client_id. Google Drive's rate limit is imposed on a by-user basis. If you are using rclone's internal client_id (aka internal key) instead of your own you'll be sharing that limit with all others who do the same. To quote the docs, "If you leave this blank, it will use an internal key which is low performance." 

To create your own you'll have to create a Google developer's account, yada yada yada. See https://rclone.org/drive/#making-your-own-client-id

Second, the rate limit. Again, to quote the rclone docs, "Drive has quite a lot of rate limiting. This causes rclone to be limited to transferring about 2 files per second only. Individual files may be transferred much faster at 100s of MBytes/s but lots of small files can take a long time." There are some rclone option settings which possibly can optimize this but I didn't explore any. Google is your friend. Try searching on terms like "slow sync to Google Drive".

Regards,
Kent
Reply


Messages In This Thread
RE: API connection to Cloud, like Google Drive, OneDrive and Dropbox - by TheOldPresbyope - 11-01-2019, 11:59 AM

Forum Jump: