Python
How to Use asyncio to Run Shell Commands Concurrently
Run shell commands concurrently with asyncio.create_subprocess_exec: capture output, cap concurrency with a semaphore, add timeouts and kill stuck children.
6 min read
Tag
parallel
3 posts
Python
How to Run Parallel Jobs in Python With concurrent futures
Run jobs in parallel with Python's concurrent.futures: threads for waiting work and commands, processes for CPU work, as_completed, errors and limits.
6 min read
Automation
How to Download Many Files in Parallel From a List
Download many files in parallel from a list with xargs -P and curl or aria2c, limit concurrency, resume partial files, and keep output readable and safe.
6 min read