A study of sequence weighting at scale

Lobsters·2 points·eatonphil·10 days ago·blog.janestreet.com

TL;DR: We study the scaling laws of data weighting across in-house and open-weight LMs, finding non-monotonic behavior across scales. We vary the weight assi...

Read the full article at blog.janestreet.com →

#study #weighting #sequence #scale #sequence weighting #ml #weight #across

Related stories

A study of sequence weighting at scaleblog.janestreet.com
Hacker News · 2 points · 10 days ago
A study of sequence weighting at scaleblog.janestreet.com
Hacker News · 6 points · 10 days ago
Most powerful obesity drug yet: People lost up to 25% of weight in trialarstechnica.com
Ars Technica · 0 points · 1 day ago
Merge Claude Code desktop sessions across accounts (macOS)github.com
Hacker News · 1 points · 3 days ago
This study looks at how and with whom connected cars share your dataarstechnica.com
Ars Technica · 0 points · 1 day ago
Show HN: Deskies – ambient presence for friends across companiesdeskies.vercel.app
Hacker News · 1 points · 10 days ago

Related topics

ai2039 cars32 weight24 short36 scale38 sequence weighting3 sequence4 across57 weighting3 data292 electric26 petrol3