LLM Engineering
How LLM applications get built and shipped: inference and serving, structured output, token formats, evaluation, and the libraries powering production language-model systems.
149 articles
LLM Engineering
Building Threat Models in Draw.io: How XML Libraries Turn Free Diagrams into Security Tools
LLM Engineering
AWS Lambda Layers: How a GitHub List Solved Serverless Dependency Hell
LLM Engineering
Building API Documentation from Network Traffic: Inside Postman's Observability CLI
LLM Engineering
Gepetto: Teaching IDA Pro to Think with Language Models
LLM Engineering
Inside Hugging Face Tokenizers: How Rust Powers Sub-Second NLP Preprocessing at Scale
LLM Engineering
How Open-Assistant Built a ChatGPT Alternative with 160,000 Crowdsourced Conversations
LLM Engineering
Stanford Alpaca: The $500 Experiment That Democratized LLM Fine-Tuning
LLM Engineering
OpenAI Evals: Building a Declarative Framework for LLM Benchmarking
LLM Engineering
Dalai: The Time Capsule That Democratized Local LLMs
LLM Engineering
Kor: Extracting Structured Data When Your LLM Doesn't Have Function Calling
LLM Engineering
GPT4All: Running Production LLMs on a 2015 MacBook
LLM Engineering
Unlimiformer: Turn Any Transformer Into a Long-Context Model with Retrieval-Augmented Attention
LLM Engineering
StructGPT: Teaching ChatGPT to Query Databases Without Fine-Tuning
LLM Engineering
Prompt Optimizer: Cutting LLM API Costs by Compressing Tokens Without Model Access
LLM Engineering
AIx: ProjectDiscovery's Minimalist CLI for Piping Unix Philosophy into GPT
LLM Engineering
Gorilla: Building LLMs That Actually Call APIs Without Hallucinating
LLM Engineering
Inside Microsoft's UniLM: A Research Catalog of Foundation Models from BitNet to Kosmos
LLM Engineering
Marsha: The Programming Language That Compiles English Into Tested Python Using LLMs
LLM Engineering
OWASP's Open Asset Model: Treating Your Attack Surface Like a Knowledge Graph
LLM Engineering
DeepEval: Testing LLM Applications Like You Test Your Code
LLM Engineering
Training Custom LLMs with Synthetic Data: How GPT-4 Can Build Your Dataset
LLM Engineering
Axflow: A Zero-Dependency TypeScript Framework That Treats AI Like First-Class Infrastructure
LLM Engineering
LLM Guard: Building a Security Middleware Layer for Large Language Models
LLM Engineering