FG
💻 Software

Running commands in parallel with a limit of simultaneous number of commands

Fresh5 days ago
Mar 15, 202626696 views
Confidence Score0%
0%

Problem

Sequential: - too slow Parallel: - too much load How to run commands in parallel, but not more than, for example, 20 instances per moment? Now usually using hack like , but this is not a good solution. Update 2: Converted the accepted answer into a script: http://vi-server.org/vi/parallel Note that…

Error Output

#!/bin/bash

NUM=$1; shift

if [ -z "$NUM" ]; then
    echo "Usage: parallel <number_of_tasks> command"
    echo "    Sets environment variable i fro…

Unverified for your environment

Select your OS to check compatibility.

1 Fix

Canonical Fix
Unverified Fix
New Fix – Awaiting Verification

Fix for: Running commands in parallel with a limit of simultaneous number of commands

Low Risk

GNU Parallel is made for this. It can even run jobs on remote computers. Here's an example for re-encoding an MP3 to OGG using server2 and local computer running 1 job per CPU core: Watch an intro video to GNU Parallel here: http://www.youtube.com/w…

Awaiting Verification

Be the first to verify this fix

Sign in to verify this fix

Environment