Skip to content
AI News HubLIVE
More
Original source1 min read

datasette-arrows 0.1a0

Summary

Simon Willison released datasette-arrows 0.1a0, the first plugin to use Datasette's new streaming export hook, letting tables be exported as Apache Arrow IPC streams for DuckDB, pandas, Polars and similar tools.

datasette-arrows 0.1a0
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions
Read article

Release: datasette-arrows 0.1a0

Simon Willison’s Weblog

Newsletter

18th November 2026

Release

datasette-arrows 0.1a0 — Streaming exports for Datasette using Arrow IPC.

Datasette 1.0a43 added the ability for plugins to implement streaming export formats. Datasette core supports streaming CSV and TSV - you can export millions of lines of data from a table without needing to load it all into memory, because those two file formats support streaming data in chunks. The register_output_renderer() plugin hook can now be used to implement the same pattern for other formats.

I've learned never to release a new plugin feature without accompanying it with a plugin that uses it.

Claude Fable 5.2 suggested the Apache Arrow streaming format as a good option, and built this plugin in almost a single shot.

Add the plugin to Datasette (datasette install datasette-arrows) and the export dialog gains this new Arrow option:

This screenshot is from Datasette's main branch - the most recent release doesn't yet group streaming formats such as Arrow with the TSV and CSV in the "All rows in this table" section, but that's coming in the next alpha release.

Recent articles

Running the full server-side Datasette Python app in the browser with service workers and Pyodide - 17th November 2026

Locating the source of a mysterious beep with Claude - 9th November 2026

Hide your slop PR descriptions behind - 9th November 2026

Qwen 3.8 27B on my laptop can interpret model weights, too - 3rd November 2026

This is a beat by Simon Willison, posted on 18th November 2026.

projects 567

datasette 1,568

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe

Disclosures

Colophon

©

2002

2003

2004

2005

2006

2007

2008

2009

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2022

2023

2024

2025

2026

Key points and analysis

Article intelligence

EngineersAdvanced

Key points

  • Datasette 1.0a43 lets plugins implement streaming export formats via register_output_renderer().
  • The plugin was suggested and almost single-shot built by Claude Fable 5.2.
  • Installing it adds an Arrow option to the export dialog for whole-table streaming exports.
  • The latest release does not yet group Arrow with CSV/TSV under "All rows in this table"; that is coming in the next alpha.

Highlights and analysis are generated automatically and may contain errors. Check the original source.