LLM Engineering
How LLM applications get built and shipped: inference and serving, structured output, token formats, evaluation, and the libraries powering production language-model systems.
157 articles
LLM Engineering
How Gitleaks Uses Entropy Analysis to Find Secrets Your Regex Patterns Miss
LLM Engineering
LLM Checker: Hardware-Aware Model Selection for Local AI Inference
LLM Engineering
RuVector: The Rust Vector Database That Rewrites Its Own Index
LLM Engineering
PyReason: Graph-Based Temporal Logic for Explainable AI
LLM Engineering
PlanAI: Type-Safe Graph Orchestration for Hybrid LLM Workflows
LLM Engineering
Parameter Golf: OpenAI's $1M Challenge to Train the Most Efficient Language Model in 16MB
LLM Engineering
Flash-MoE: Running a 397B Parameter Model on 48GB RAM by Streaming Experts from SSD
LLM Engineering
Inside Hyperspace AGI: Building a Decentralized Research Network with P2P Gradient Pooling
LLM Engineering
Building a Deliberative LLM Council: Multi-Model Consensus Through Peer Review
LLM Engineering
MemPalace: The AI Memory System That Refuses to Forget (or Summarize) Anything
LLM Engineering
Inside Unsloth's 250+ Notebook Arsenal: A Deep Dive into Production-Ready LLM Fine-Tuning
LLM Engineering
ML Intern: Building an Autonomous ML Agent That Reads Papers and Ships Models
LLM Engineering