gpu

84 stories and discussions about gpu, aggregated from every source we track.

1.

The real difference between texture-atlas, SDF, MSDF, and Slug glyph rendering on the GPU: how each works, where each breaks, and when to use which.

156 points•ibobev•about 2 months ago•58 comments•
2.

[Experimental] A virtio device for near-native NVIDIA GPU access in KVM virtual machines. - nestrilabs/virtio-nvgpu

144 points•WanjohiRyan•about 2 months ago•59 comments•
3.

The GPU in your computer is about 10 to 100 times more powerful than the CPU, depending on workload. For real-time graphics rendering and machine learning, you are enjoying that power, and doing those workloads on a…

61 points•gpm•over 1 year ago•13 comments
4.

A high-performance and high-level purely functional data-parallel array programming language that can execute on the GPU and CPU.

26 points•fanf•about 2 months ago•0 comments
5.

There's a new kind of technical debt, and it doesn't come from cutting corners. It comes from...

25 points•cyclopt_dimitrisk•about 2 months ago•21 comments
6.

Serving Gemma 4 E2B q4_0 through llama.cpp on one laptop, twice: CPU-only and on a 2021-era 4 GB GTX 1650 Ti. Same GGUF, same binary, same prompts, one flag apart. The card takes decode by 4.3x, and needs only 1598 MiB to do it.

15 points•xbill•2 months ago•6 comments
8.

Single-source pure-Rust heterogeneous GPU compute platform - enkiruntime/enki

10 points•enki_runtime•about 2 months ago•1 comment•
9.

Gemma 4 E2B q4_0 served by llama.cpp on one laptop, CPU-only and on a GTX 1650 Ti, rebuilt on CUDA 13.4 and re-measured in CPU, GPU, GPU, CPU order with a temperature gate. The card takes decode by 4.14x, and run order moves the answer by about 2%.

10 points•xbill•about 2 months ago•2 comments
10.

Step-by-step: running Google's quantization-aware-trained Gemma 4 E2B on a 10th-gen Core i7 laptop with a 4 GB GTX 1650 Ti — why bf16 and int8 cannot fit, why the QAT GGUF does with room to spare, and managing it with an MCP server.

10 points•xbill•2 months ago•3 comments
11.

The live demo, step by step: Gemma 4 E2B answering at 76 tok/s from a GTX 1650 Ti with 4 GB of memory, and the exact re-pack of Google's QAT weights on Hugging Face that makes it fit, run faster and stay close to bf16.

9 points•xbill•about 2 months ago•0 comments
12.

Apple's container CLI 1.4.1 cannot boot the official debian:13 image as a machine, because it has no /sbin/init. A small Dockerfile fixes that and gives you a persistent Debian 13 VM with systemd, your Mac user and your home folder. The VM has no GPU, so Ollama runs on macOS and the VM calls it at 192.168.64.1:8000. From inside Debian, gemma4:e2b answered at 45.2 tok/s, loaded 100% on the M3 GPU.

9 points•xbill•2 months ago•1 comment
13.

Pretrained text classifiers you can run and retrain on CPU - nicobrenner/jeffy

8 points•nico•about 2 months ago•5 comments•
16.

How our Kimi K3 megakernel on TPU v7 reaches over 700 tokens/s with speculative decoding and nearly 2× GB200's batch-one decode throughput.

5 points•xutingl•about 2 months ago•1 comment•
18.

Maximizing perf on AI-SQL queries with the KV-optimal left-deep join

4 points•charles_irl•about 2 months ago•1 comment•
19.
4 points•winwang•about 2 months ago•0 comments•
21.

Nobody ever thinks of RISC-V when they think of Nvidia, but it's actually incredibly important to Nvidia's GPUs.

4 points•giuliomagnifico•2 months ago•0 comments•
22.

Bulk Synchronous Parallelism (BSP) in distributed deep learning clusters induces severe rate-of-change current transients (dI/dt) across data center power delivery networks. When thousands of accelerators synchronously…

4 points•samganyx•2 months ago•0 comments•
24.

A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference. - wafer-ai/gpu-perf-engineering-resources

3 points•bogdiyan•about 2 months ago•0 comments•
25.
3 points•ilreb•about 2 months ago•0 comments•
26.
3 points•jinhongyii•about 2 months ago•0 comments•
27.
3 points•sonabinu•about 2 months ago•0 comments•
28.

[Experimental] A virtio device for near-native NVIDIA GPU access in KVM virtual machines. - nestrilabs/virtio-nvgpu

3 points•jeanthomas•about 2 months ago•0 comments
29.

A GPU-accelerated Pedersen vector commitment engine for Ethereum Verkle trees (EIP-6800) - Dyslex7c/cuda-verkle

3 points•grobat79•about 2 months ago•0 comments•
30.
3 points•thinkevolve•2 months ago•0 comments•
31.
2 points•nodesocket•about 2 months ago•2 comments•
32.

A homelab census of 41 Docker and 9 LXC containers, and how one 6 GB GPU decides which AI agents run on local Ollama, OpenRouter or a subscription.

2 points•c1-anderson•about 2 months ago•2 comments
33.

We introduce PTXBench, a benchmark for evaluating and adapting large language models (LLMs) to use architecture-specific PTX for GPU kernel optimization. PTXBench measures functional correctness, whether selected…

2 points•matt_d•about 2 months ago•0 comments•
34.
2 points•matt_d•about 2 months ago•0 comments•
35.
2 points•wslh•about 2 months ago•1 comment•
36.

GPU Trace Visualizer. Contribute to mikesart/gpuvis development by creating an account on GitHub.

2 points•luu•about 2 months ago•0 comments•
37.

KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs) - ScalingIntelligence/KernelBench

2 points•peter_d_sherman•about 2 months ago•0 comments•
38.
2 points•ksec•about 2 months ago•0 comments•
39.

GPUs are expensive, yet inference-serving GPU clusters remain heavily underutilized. To improve utilization, state-of-the-art systems adopt GPU multiplexing. However, optimizing solely for utilization can…

2 points•matt_d•about 2 months ago•0 comments•
40.
2 points•roastedpillows•about 2 months ago•0 comments•
41.
2 points•ibobev•about 2 months ago•0 comments•
42.
2 points•mattyw•about 2 months ago•0 comments
43.

Crop a line of text and get the closest fonts from Google Fonts, DaFont, Adobe Fonts, GitHub font repositories, Debian and more, with their weight and italic.

2 points•made_by_dy•about 2 months ago•0 comments•
44.
2 points•gtsnexp•about 2 months ago•0 comments•
45.

Glyd stores open models' bf16 weights in about 11 bits instead of 16 and decodes them inside the GPU's matrix multiply: bit for bit, often faster.

2 points•surya-koritala•about 2 months ago•0 comments•
46.

VRAM-aware single-node GPU job scheduler. Contribute to ceruleane/gpusched development by creating an account on GitHub.

2 points•mothproof•about 2 months ago•0 comments•
47.

NEO Emacs (WIP): GPU powered Emacs written in Rust with a modern display engine. Aiming for modern design & multi-threaded Elisp, 10x performance, zero-pause concurrent GC and 100% Emacs compat...

2 points•tagfowufe•about 2 months ago•2 comments•
48.

A high-performance, GGUF-native Rust & CUDA inference engine optimized for cold-start latency and real-time 'System 1' agent decision loops. - lateos-ai/reflex

2 points•leochong•about 2 months ago•0 comments•
49.
2 points•AbuAssar•about 2 months ago•0 comments•
50.

We won 2nd overall at HackMIT for building a GPU in 24 hours.

2 points•arghunter•about 2 months ago•0 comments•
51.

A modern LLM can spend most of its time doing something that looks almost embarrassingly simple: C...

2 points•shrsv•2 months ago•0 comments
52.
1 points•thunderbong•about 2 months ago•0 comments•
53.

A high-performance and high-level purely functional data-parallel array programming language that can execute on the GPU and CPU.

1 points•ibobev•about 2 months ago•0 comments•
54.

You need to first ensure that all the necessary drivers (CUDA most important) for the Nvidia GPU are installed. This post will NOT cover how to do...

1 points•saltytechsailor•about 2 months ago•0 comments•
55.

DevOps & Cloud SI Assistant that runs locally with Ollama for complete privacy. - tara-vision/taracode

1 points•stefanoski•about 2 months ago•0 comments•
56.
1 points•crowwork•about 2 months ago•0 comments•
57.

GPU-Rendered UI library built from scratch in Rust [WIP] - artemtsitronov/glacex

1 points•adamnemecek•about 2 months ago•0 comments•
58.

Five years of GPU infrastructure at Beam — from ECS and Knative cold starts to a custom container runtime, FUSE lazy-loading, and a trustless binary.

1 points•Mernit•about 2 months ago•0 comments•
59.

Stop wasting hours waiting for video to be built from the web page in a browser. Vibe code your video on GPU using Rust & SVG framework.

1 points•neogoose•about 2 months ago•0 comments•
60.

Institutional-grade real-time AI cloud GPU spot rates, cluster arbitrage, and inventory intelligence across 31 global cloud providers.

1 points•nurturely•about 2 months ago•0 comments•

Related topics