5 comments
sylware7 days ago
What heavy CPU workloads AVX10 V2 AUX could help accelerate significantly?
It has a smells of 'we need to push back our IP deadlines' thingy.
rbanffy7 days ago
These instructions are part of the ACE set, so I assume they are useful for AI - there are format conversions, rounding, comparison, and, of course, operations on these formats in the vector and mask registers. Looking at the documentation, which is huge, gives me the impression this will improve quantized models the most, but this is a guess.
sylware7 days ago
No other workloads? Really?
Because, if I am not too mistaken, inference hardware would do all that and directly on the silicon, namely much faster and using much less energy.
Or is this to run quantized models on consumer CPUs??? Weird, because, if I do run models on my consumer system, I will want the full weights of the frontier open weight models.
Read the full thread on Hacker News →
Related stories
- The Verge · 0 points · 2 days ago
- Ars Technica · 0 points · 1 day ago
- Hacker News · 1 points · 8 days ago
- DEV Community · 11 points · 13 days ago
- Hacker News · 1 points · 9 days ago
- DEV Community · 12 points · 14 days ago