Posted August 6, 2025

LLM-Based RAG Evaluation Metrics: Model Relatedness and Consistency

Evaluating the Evaluators: How LLM Relatedness Impacts Scoring-Based Metrics in RAG Systems

Read more

Latest News

Posted February 8, 2013

Vault Report: STAC-N with Chelsio and WireDirect UDP

Unaudited STAC-N Benchmark of Chelsio T420-LL-CR network adapter with WireDirect UDP.

Read more
Posted January 23, 2013

Recap of 2012 activities

Document reviews STAC Benchmark Council activities from 2012 and previews some of the things ahead in 2013.

Read more
Posted November 26, 2012

STAC-M3 baseline and scale benchmarks of DDN SFA 12K with kdb+ on IBM x3850

Fastest mean response time in the YRHIBID test of all publicly disclosed results using kdb+. Significantly faster than the same tests conducted on the previous-generation DDN storage last year.

Read more
Posted November 6, 2012

STAC Report: Comparison of MapReduce Implementations

Audited benchmark shows Apache Hadoop with IBM Platform Symphony performed jobs 7.3 times faster, on average, than pure Apache Hadoop.

Read more
Posted November 6, 2012

STAC Report: McObject eXtremeDB with Kove XPD L2

Audited STAC-M3 Benchmark of McObject eXtremeDB 5.0 Financial Edition with Kove XPD L2 Storage and Dell R910 servers sets records in 15 of 17 STAC-M3 benchmarks.

Read more
Posted October 21, 2012

STAC, Intel, and Catskills invited to present STAC-A2 at SC12

Click here to review the workshop submission.
Read more
Posted October 15, 2012

STAC Report: Redline/Intel/HP tick-to-trade

6.1 usec mean latency at market rate, with 1.4 usec jitter

Read more

Pages

About STAC News

For the latest on research, events and related news please see stacresearch.com/news

This page is where you will find archived articles.

Sign up to Our Newsletter

(If you're a human, don't change the following field)
Your first name.
(If you're a human, don't change the following field)
Your first name.