Post Parsing JSON at tens of gigabytes per second… in Python

23 October 2026

PythonHub

Link
click to show

Parsing JSON at tens of gigabytes per second… in Python Free-threaded Python 3.14 can push JSON parsing into the tens of gigabytes per second when fastsimdjson spreads work across many cores and avoids eagerly materializing Python objects. On a 64-core machine, Lemire reports throughput around 66 GB/s, showing how dramatically multithreaded parsing can scale when Python’s GIL is no longer the limiting factor. https://lemire.me/blog/2026/10/12/parsing-json-at-tens-of-gigabytes-per-second-in-python/

2 · 92 · 16:15

Nearby in the feed

PythonHub08:15AirLLM AirLLM is a Python library for running very large language models on consumer GPUs with limited memory by loading model layers sequentially instead of ke P

PythonHub12:15A Clean Way to Implement Undo in Python This video explains how to implement the Memento design pattern in Python to handle state restoration and undo functiona

this message

PythonHub20:15why .parquet dominates modern data engineering This video explains why the Parquet file format has become a dominant standard in modern data engineering by usin P

PythonHub00:15fastapi-stream-lease Distributed stream and SSE concurrency lease manager for FastAPI and Starlette backed by atomic Redis Lua scripts. https://github.com/agust