Benchmark for tracking model capability after release. - ninjahawk/livenerf

5 points•ninjahawk1•8 days ago•2 comments•

2 comments

_aavaa_3 days ago
If you don’t trust and are on the lookout for silent nerfing, how are you protecting against it detecting a benchmark and using the un-nerfed model?
ethan19987 days ago
I have no idea how to do it. Keep rerunning benchmarking test can be costly.

Read the full thread on Hacker News →

Related stories