Tech Articles
Curated developer articles, tutorials, and guides – auto-updated hourly
xbill6d ago • 9 min read
Running Gemma 4 on EC2 G5g: Graviton2 AMD with NVIDIA GPU
A field report on serving Gemma 4 E2B under vLLM on AWS G5g — the only aarch64 + SM 7.5 hardware the...
#aws#vllm#cuda#machinelearning
13 0
xbill5d ago • 10 min read
Installing Rust for vLLM on Graviton: a G5g walk-through 🦀
Step-by-step: getting vLLM's Rust frontend built and running on an aarch64 EC2 G5g box. rustup, setu...
#rust#vllm#aws#cuda
0 0
xbill6d ago • 9 min read
Running Gemma 4 on EC2 G5g: Graviton2 AMD with NVIDIA GPU
A field report on serving Gemma 4 E2B under vLLM on AWS G5g — the only aarch64 + SM 7.5 hardware the...
#aws#vllm#cuda#machinelearning
0 0
Michał Piszczek2d ago • 11 min read
Qwen3.8 27B at 256K: 50 TPS on a 24 GB GPU
The quantized model from this write-up is public on Hugging Face:...
#aiinfrastructure#llm#cuda#performance
1 1
xbill5d ago • 10 min read
Serving Gemma4 with Rust on vLLM 🦀
Step-by-step: getting vLLM's Rust frontend built and running on an aarch64 EC2 G5g box. rustup, setu...
#rust#vllm#aws#cuda
5 0
Muhammad Adil 7h ago • 4 min read
Finding a Random Island with Geometry and CUDA
How to use spherical math and GPU acceleration to pinpoint any island on Earth when all you have is ...
#gpucomputing#geospatial#cuda#geometry
0 0
Aarush Karak6d ago • 2 min read
Understanding GPU Memory: VRAM, Bandwidth, and Why Your Model Won't Fit
HBM Architecture GPU memory is the most constrained resource in ML. This post explains HBM...
#gpu#cuda#vram#memory
1 0
soy1d ago • 3 min read
llama.cpp b10481: CUDA MMVQ & Dynamic MoE Optimize Dense Model Inference
The latest llama.cpp release, b10481, introduces substantial CUDA optimizations for dense models and...
#gpu#cuda#performance#llm
0 0