Release: datasette-arrows 0.1a0
Simon Willison’s Weblog
Newsletter
18th November 2026
Release
datasette-arrows 0.1a0 — Streaming exports for Datasette using Arrow IPC.
Datasette 1.0a43 added the ability for plugins to implement streaming export formats. Datasette core supports streaming CSV and TSV - you can export millions of lines of data from a table without needing to load it all into memory, because those two file formats support streaming data in chunks. The register_output_renderer() plugin hook can now be used to implement the same pattern for other formats.
I've learned never to release a new plugin feature without accompanying it with a plugin that uses it.
Claude Fable 5.2 suggested the Apache Arrow streaming format as a good option, and built this plugin in almost a single shot.
Add the plugin to Datasette (datasette install datasette-arrows) and the export dialog gains this new Arrow option:
This screenshot is from Datasette's main branch - the most recent release doesn't yet group streaming formats such as Arrow with the TSV and CSV in the "All rows in this table" section, but that's coming in the next alpha release.
Recent articles
Running the full server-side Datasette Python app in the browser with service workers and Pyodide - 17th November 2026
Locating the source of a mysterious beep with Claude - 9th November 2026
Hide your slop PR descriptions behind - 9th November 2026
Qwen 3.8 27B on my laptop can interpret model weights, too - 3rd November 2026
This is a beat by Simon Willison, posted on 18th November 2026.
projects 567
datasette 1,568
Monthly briefing
Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.
Pay me to send you less!
Sponsor & subscribe
Disclosures
Colophon
©
2002
2003
2004
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
2025
2026