Concurrent File I/O in Python: Faster File I/O With Threads, Processes, and AsyncIO

Front Cover
SuperFastPython.com - Computers

File I/O can be faster in Python when using concurrency.


* Discover how to write files 3x faster with processes

* Discover how to read files 3x faster with processes and threads

* Discover how to unzip files 4x faster with processes and threads


File I/O stands for File Input/Output, referring to the process of reading data from and writing data to files on a storage device like a hard drive.


Studying how to bring concurrency to file I/O is critical for Python developers. Adding concurrency into your file I/O tasks, you can unlock the full potential of modern computer hardware, making your applications more efficient and capable of handling large workloads.


The problem is, there is no silver bullet. Each program and each task is different and unique. We cannot know which approach to Python concurrency will give good or even the best performance.


Therefore in addition to learning how to perform file I/O operations concurrently, Python developers must learn how to benchmark a suite of different approaches to implementing file I/O operations concurrently.


Introducing: "Concurrent File I/O in Python". A new book designed to teach you how to bring concurrency to your file I/O tasks in Python, super fast!


You will get rapid-paced tutorials showing you how to bring concurrency to the most common file I/O tasks.


Including:


* How to perform file I/O operation in the background.

* How to concurrently read files from disk and write files to disk.

* How to concurrently delete files from disk.

* How to concurrently copy, move, and rename files on disk.

* How to efficiently append files on disk.

* How to concurrently zip files and unzip files on disk.


Don't worry if you are new to file I/O or concurrency, you will also get primers on the background required to get the most out of this book, including:


* The importance of concurrency for high-performance file I/O.

* How to perform common file I/O operations in Python.

* How to use Python concurrency APIs including threading, multiprocessing, and asyncio.

* How to perform file I/O with coroutines in asyncio using the aiofiles library.

* How to use programming patterns for concurrent file I/O.


Each tutorial is carefully designed to teach one critical aspect of how to bring concurrency to file I/O tasks.


Stop copy-pasting code from StackOverflow answers.


Learn Python concurrency correctly, step-by-step.

 

Selected pages

Other editions - View all

Common terms and phrases

About the author

Jason Brownlee, Ph.D. helps Python developers bring modern concurrency methods to their projects with hands-on tutorials. Learn more at https://SuperFastPython.com

Jason is a software engineer and research scientist with a background in artificial intelligence and high-performance computing. He has authored more than 20 technical books on machine learning and has built, operated, and exited online businesses.

Bibliographic information