FG
💻 Software

Xargs and Wget stops working after an hour

Fresh5 days ago
Mar 15, 2026767 views
Confidence Score0%
0%

Problem

Running script with Cygwin on Windows XP with Dual Core and 4GB Ram I am trying to trawl through 4GB of URL to download (approx 43 Million) Works okay for about the first hour, then the Bash shell and downloads stop even though its only 2% through the URL list. Any ideas at what could be wrong? Wha…

Error Output

cat url_list.txt | xargs -P50 wget -i

Unverified for your environment

Select your OS to check compatibility.

1 Fix

Canonical Fix
Unverified Fix
New Fix – Awaiting Verification

Fix for: Xargs and Wget stops working after an hour

Low Risk

It's possible wget is taking time to download some of the files. Are there any wget/xargs processes in memory during the period that it appears to be hung? If so, is it the full 50 processes as you allocated with the -P50 flag to xargs, or has it so…

Awaiting Verification

Be the first to verify this fix

Sign in to verify this fix

Environment