Show HN: SOCBench – an open benchmark for AI on SoC tasks
SOCBench is an open benchmark that evaluates frontier reasoning LLMs as SOC agents on raw NetFlow data. It provides a multi-turn agent loop with persona-scoped tools, multiple provider adapters, and scoring lenses. The repository is local-first and requires only a laptop, three API keys, and a sample parquet to reproduce. It is currently in alpha with a full end-to-end pipeline.
Show HN: SOCBench – an open benchmark for AI on SoC tasks
Report an error
The correction channel is not available yet. You can copy the article reference below for later.
Correction instructionsSummary only
Under the source content permission, this page provides an editorial summary, key points, and a link to the original article.