LLM Engineering
How LLM applications get built and shipped: inference and serving, structured output, token formats, evaluation, and the libraries powering production language-model systems.
157 articles
LLM Engineering
SRMT: Teaching Robots to Share Their Thoughts Through Memory
LLM Engineering
Building Resumable LLM Evaluations: A Template for Rate-Limited API Testing
LLM Engineering
Burpference: Adding LLM Intelligence to Your Security Proxy Workflow
LLM Engineering
LLMmap: Fingerprinting Large Language Models Through Behavioral Analysis
LLM Engineering
Inside Transformer Debugger: OpenAI's Circuit Tracing Tool for Mechanistic Interpretability
LLM Engineering
Dora-VAE: How Inference-Time Scalability Solves the 3D Diffusion Training Bottleneck
LLM Engineering
Repomix: Why Packing Your Entire Codebase Into One File Is the Future of LLM Workflows
LLM Engineering
Reasoning Gym: How Procedural Generation Solved RL Training's Ground Truth Problem
LLM Engineering
Swark: Auto-Generating Architecture Diagrams by Feeding Your Codebase to GitHub Copilot
LLM Engineering
Open Interface: Teaching GPT-4 Vision to Drive Your Desktop with Screenshots and PyAutoGUI
LLM Engineering
Chainlit: The Python Framework That Turns LLM Scripts Into Production UIs
LLM Engineering
MoBA: How Moonshot AI Serves 1M-Token Contexts in Production with Learned Sparse Attention
LLM Engineering
Inside the LLM Post-Training Knowledge Base That 2,400+ Researchers Are Using
LLM Engineering
Search-R1: Training Language Models to Think and Search Without Supervision
LLM Engineering
AgentDojo: The Security Benchmark That Exposes LLM Agents' Achilles Heel
LLM Engineering
SEAL: Teaching Language Models to Write Their Own Training Data
LLM Engineering
Onyx: Building ChatGPT-Grade AI Search with Hybrid RAG and MCP Agents
LLM Engineering
Unsloth: How Custom Triton Kernels Make LLM Fine-Tuning Possible on Consumer GPUs
LLM Engineering
TOON: The Data Format That Makes LLMs Pay Attention to Your Tables
LLM Engineering
TheAgentCompany: The First Real-World Benchmark That Makes AI Agents Look Bad
LLM Engineering
SEC-bench: A NeurIPS Framework for Benchmarking LLM Agents Against Real Security Vulnerabilities
LLM Engineering
Heretic: Automatic Abliteration for Uncensoring Language Models
LLM Engineering
SelfCheckGPT: Catching LLM Hallucinations by Making Models Contradict Themselves
LLM Engineering