Tech Articles
Curated developer articles, tutorials, and guides – auto-updated hourly
AI OpenFree2d ago • 4 min read
VIDRAFT Opens Up Its AI Framework Technology Amid the LLM Efficiency Race
한국 AI 스타트업 VIDRAFT(비드래프트)가 LLM 추론 속도와 비용 절감을 위한 AI 프레임워크 기술을 공개했습니다. 효율적인 LLM 서빙 인프라에 관심 있는 개발자라면 주목...
#vidraft#llmefficiency#aiframework#llminference
0 0
Umesh Malik4d ago • 10 min read
Qwen3.8 27B VRAM: how to fit 262K context in 16 GiB, not 64
Qwen3.8 27B VRAM math: 25.9 GiB of FP8 weights plus 16 GiB of KV cache at 262,144 tokens, not 64. Th...
#llminference#vllm#qwen#kvcache
0 0