💻 Software

Best way to copy millions of files between 2 servers

Fresh5 days ago

Mar 15, 2026102999 views

Confidence Score0%

Problem

I have roughly around 5 million small (5-30k) files in a single directory that I would like to copy to another machine on the same gigabit network. I tried using rsync, but it would slow down to a crawl after a few hours of running, I assume due to the fact that rsync has to check the source & dest…

Unverified for your environment

Select your OS to check compatibility.

Your OS

OS version

Product version

1 Fix

Canonical Fix

Unverified Fix

New Fix – Awaiting Verification

Fix for: Best way to copy millions of files between 2 servers

Low Risk

Something like this should work well: Maybe also omit gzip and the "z" flag for extraction, since you are on a gigabit network.

Awaiting Verification

Be the first to verify this fix

Best way to copy millions of files between 2 servers

Problem

1 Fix

Fix for: Best way to copy millions of files between 2 servers

Environment