Tech Articles
Curated developer articles, tutorials, and guides – auto-updated hourly
xbill1d ago • 8 min read
Gemma 4 on Amazon SageMaker or a VM? The Same Model Server at 1.40x the Price
The same Gemma 4 build, vLLM version and GPU served from a SageMaker endpoint and from a plain EC2 i...
#aws#sagemaker#gemma#vllm
1 0
xbill6d ago • 9 min read
Gemma 4 on Amazon SageMaker: QAT Weights Decode 2.05x Faster Than bf16 on One L4
A short background on SageMaker real-time endpoints, then a measured comparison of Gemma 4 E2B's QAT...
#aws#sagemaker#gemma#vllm
0 0
xbill6d ago • 10 min read
Gemma 4 on an Amazon SageMaker Endpoint: AWS CLI, NVIDIA L4, and an MCP Server
Step by step deployment of Gemma 4 E2B to a SageMaker real-time endpoint on one NVIDIA L4 with the A...
#aws#sagemaker#gemma#mcp
0 0
xbill1d ago • 9 min read
Gemma 4 on Amazon SageMaker: The NVIDIA T4 Decodes at 0.8x of the L4 With the Same Answers
Gemma 4's 4-bit builds on SageMaker's smallest GPU, an NVIDIA T4, against the L4: a Turing patch for...
#aws#sagemaker#gemma#vllm
1 0
xbill1d ago • 9 min read
Gemma 4 on Amazon SageMaker: The NVIDIA T4 Decodes at 0.8x of the L4 With the Same Answers
Gemma 4's 4-bit builds on SageMaker's smallest GPU, an NVIDIA T4, against the L4: a Turing patch for...
#aws#sagemaker#gemma#vllm
15 1
xbill5d ago • 9 min read
Gemma 4 on Amazon SageMaker: QAT Weights Decode 2.05x Faster Than bf16 on One L4
A short background on SageMaker real-time endpoints, then a measured comparison of Gemma 4 E2B's QAT...
#aws#sagemaker#gemma#vllm
7 0
xbill1d ago • 11 min read
Gemma 4 on Amazon SageMaker: 4-Bit Embeddings Decode up to 1.39x Faster on One L4
Repacking Gemma 4's QAT weights five ways and serving each on the same SageMaker NVIDIA L4 endpoint:...
#aws#sagemaker#gemma#vllm
1 0
xbill5d ago • 10 min read
Gemma 4 on an Amazon SageMaker Endpoint: AWS CLI, NVIDIA L4, and an MCP Server
Step by step deployment of Gemma 4 E2B to a SageMaker real-time endpoint on one NVIDIA L4 with the A...
#aws#sagemaker#gemma#mcp
7 0