Streaming 500M rows into Apache Arrow in 2.3 seconds | Hacker News - But Better

Streaming 500M rows into Apache Arrow in 2.3 seconds questdb.com

We built a naive parallel reader to see how fast QuestDB's new QWP protocol can stream query results into Arrow, compared it against ClickHouse and TimescaleDB, and stripped out three measurement artifacts before the…

2 points•jinqueeny•7 days ago•0 comments•

#arrow #streaming #rows #500m #apache #streaming 500m #apache arrow #500m rows

0 comments

No comments yet.

Related stories

The Disney protests were a wake-up call about the risks of streaming mergersarstechnica.com
Ars Technica · 0 points · about 6 hours ago
Show HN: Sensored – streaming-first PII/PHI redactiongithub.com
Hacker News · 1 points · 1 day ago
Count It or Compute It: When a Tool Returns Rows, the Models That Count Them Right Spend the Tokensdev.to
DEV Community · 15 points · 2 days ago
All roads lead to cabletheverge.com
The Verge · 0 points · 11 days ago
Amazon’s new Fire TV Stick 4K can pull power directly from your TVtheverge.com
The Verge · 0 points · about 12 hours ago
Apache Iceberg Governance: Access Control, Policies, and Audit for Open Lakehousesdev.to
DEV Community · 0 points · 8 days ago