An MI300X Over MCP: What the Matrix Cores Execute, and What They Don't
DEV Community·12 points·xbill·14 days ago·dev.to
One AMD Instinct MI300X on AMD Developer Cloud, managed entirely through a tag-scoped Python MCP server, with every figure read off the card rather than a spec sheet. fp8 e4m3fnuz runs 1.77x bf16; int8, which AMD rates identically to fp8, runs 0.69x; fp4 is not on this silicon at all. One droplet, $1.99 an hour, and two readings that were wrong the first time.
Read the full article at dev.to →
Related stories
- Hacker News · 1 points · 6 days ago
- DEV Community · 11 points · 13 days ago
- Launch HN: Vespper (YC F24) – SOTA Docx MCPvespper.comHacker News · 31 points · 2 days ago
- Hacker News · 1 points · 4 days ago
- DEV Community · 10 points · 11 days ago
- Show HN: Vespper (YC F24) – Docx MCPvespper.comHacker News · 5 points · 2 days ago