Delivering Billions of Messages Exactly Once

Lobsters·14 points·Caustic·over 9 years ago·segment.com

The single requirement of all data pipelines is that they cannot lose data. Data can usually be delayed or re-ordered–but never dropped.

Read the full article at segment.com →

#messages #data #exactly #billions #delivering #messages exactly #delivering billions #distributed

Related stories

Show HN: Datastory, Data storytelling with AI and an open knowledge graphdatastory.tech
Hacker News · 6 points · about 9 hours ago
Show HN: Beyond "chat with your database" – agentic data explorationreportr.com
Hacker News · 1 points · about 10 hours ago
Show HN: Capsule – Single-file web apps that save their data into SQLitewithcapsule.app
Hacker News · 377 points · 16 days ago
Matrix | Eventually consistent, distributed, persistent data fabricmatrix.org
Lobsters · 9 points · over 11 years ago
Google's first Suncatcher orbital data center test launches October 1arstechnica.com
Ars Technica · 0 points · 6 days ago
Google fined €403M by Irish data watchdog over location datarte.ie
Hacker News · 3 points · 10 days ago

Related topics

ai2028 muse87 metas50 agent430 private45 asked30 never79 text102 parliament5 commit9 terminal57