multiprocessing

The multiprocessing module enables parallel processing by spawning separate processes, bypassing the GIL. It’s ideal for CPU-bound tasks and offers an API similar to threading, with higher resource usage but better computational performance.

Official Website Github Website

Resource Introduction

Related Resources

threading

threading is a built-in module in Python for implementing multi-threaded concurrency. It is suitable for I/O-bound tasks but has limited performance gains in CPU-bound workloads due to the Global Interpreter Lock (GIL).

concurrent.futures

concurrent.futures provides a high-level interface for managing thread and process pools, simplifying concurrent task execution. It abstracts low-level details of threading and multiprocessing, improving code readability and maintainability.

gevent

gevent is a coroutine-based high-performance networking library using greenlets for lightweight user-space threads. It automatically converts synchronous blocking I/O into asynchronous non-blocking mode, ideal for building highly concurrent web servers and crawlers.

curio

curio is a modern, lightweight pure-Python async concurrency library emphasizing safety and simplicity. It uses a strict coroutine model to prevent common concurrency issues, making it suitable for teaching and small-scale projects.