Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Slow upload speed with 1000+ files #289

Open
absolutelynothinghere opened this issue Nov 30, 2021 · 2 comments
Open

Slow upload speed with 1000+ files #289

absolutelynothinghere opened this issue Nov 30, 2021 · 2 comments

Comments

@absolutelynothinghere
Copy link

Hello. First off I wanna say huge thanks for this app, it's quite comfortable to use unlike all the other CLI tools.

Second, I'm having an issue with slow uploads when uploading a lot (1000+) of files to my phone. The transfer speed would start high, then go lower and lower, reaching around 100 kB/s (for 5000+ files)... I'm not sure if this is due to the app or the Linux kernel.

A workaround is to manually copy files in "batches", so that the slowdown is not as drastic. This workaround is, of course, very tedious. Could this be implemented in the app? For example any upload operation gets automatically split into 500-1000 file batches to minimize slowdowns.

Thank you.

@whoozle
Copy link
Owner

whoozle commented Jan 8, 2022

I wonder why it happens.
One of the reason could be that storage in your device is slower than your upload speed. Normally linux does all file operation through the cache. So your file start writing in write cache first. Then linux decide to flush some pages to the device. And if storage in your device is not fast enough this could result in read cache pages being evicted (all executables are just mapped to memory, and basically active pages are in read cache), so everything on the phone becomes very very slow and sluggish.
Write pages make code page to be flushed and removed, then code page for some program needs to be read again, then linux wait until write page will be written and could be evicted, read that executable page again, and it happens over and over again :(

Can you test your IO speed on the phone somehow?

@absolutelynothinghere
Copy link
Author

Can you test your IO speed on the phone somehow?

If you know a way to do that, sure. Although I have a strong feeling that the problem isn't coming from the phone, because copying to it is smooth whenever I'm on Windows.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants