sequence weighting

3 stories and discussions about sequence weighting, aggregated from every source we track.

1.

TL;DR: We study the scaling laws of data weighting across in-house and open-weight LMs, finding non-monotonic behavior across scales. We vary the weight assi...

6 points•pranitha_m•9 days ago•1 comment•
2.

TL;DR: We study the scaling laws of data weighting across in-house and open-weight LMs, finding non-monotonic behavior across scales. We vary the weight assi...

2 points•eatonphil•10 days ago•0 comments•
3.

TL;DR: We study the scaling laws of data weighting across in-house and open-weight LMs, finding non-monotonic behavior across scales. We vary the weight assi...

2 points•eatonphil•10 days ago•0 comments

Related topics