I ran a 397B-parameter model on 20 GPUs with 16 GB each

I ran a 397B-parameter model on 20 GPUs with 16 GB each diljitpr.net

Splitting Qwen3.5-397B across 20 rented GPUs that can only reach each other through a relay: what limits the speed, what two days of testing fixed, and the real numbers.

2 points•diljitr•about 18 hours ago•0 comments•

#397b #gpus #ran #parameter #parameter model #397b parameter #397b parameter model #splitting

0 comments

No comments yet.

Read the full thread on Hacker News →

0 comments

Related stories