LLM Engineering
How LLM applications get built and shipped: inference and serving, structured output, token formats, evaluation, and the libraries powering production language-model systems.
149 articles
LLM Engineering
LLMFuzzer: Security Testing for the Application-LLM Boundary
LLM Engineering
Inside pallms: A Security Arsenal for Breaking LLM Guardrails
LLM Engineering
Guidance: Programming with LLMs Like They're Regular Expressions
LLM Engineering
SGLang: How RadixAttention and Prefix Caching Achieve 5x Faster LLM Inference
LLM Engineering
Medusa: Accelerating LLM Inference by Predicting Multiple Tokens in Parallel
LLM Engineering
mergekit: Combining LLMs Without Training by Operating in Weight Space
LLM Engineering
Building a Prompt Injection Firewall: Inside Vigil's Multi-Layer Defense System
LLM Engineering
How GPT-2 Leaks Its Training Data: A Deep Dive into Language Model Memorization
LLM Engineering
Inside Microsoft's Responsible AI Toolbox: A Widget Architecture for Model Accountability
LLM Engineering
LLM OSINT: When AI Becomes a Digital Private Investigator
LLM Engineering
LLM Canary: OWASP-Aligned Security Testing for Language Models
LLM Engineering
ModelScan: Detecting Malicious Code in ML Models Before It Executes
LLM Engineering
BIG-bench: Google's 200+ Task Gauntlet for Language Model Evaluation
LLM Engineering
OpenVLA: Training Vision-Language-Action Models That Actually Manipulate Objects
LLM Engineering
How a Single Adversarial Image Can Jailbreak Vision-Language Models
LLM Engineering
LaVague: Building Web Agents That Actually Understand What They're Doing
LLM Engineering
Inside JailbreakHub: What 15,000 Real-World ChatGPT Exploits Reveal About LLM Security
LLM Engineering
Chain-of-Thought Reasoning for Any LLM in 150 Lines of PHP
LLM Engineering
Building a RAG System from Scratch: A 90-Minute Workshop Walkthrough
LLM Engineering
Model Inversion Attack ToolBox: Benchmarking How Machine Learning Models Leak Training Data
LLM Engineering
Haystack: Building Production LLM Applications Without the Black Box
LLM Engineering
Building Privacy-First File Organization with On-Device AI Models
LLM Engineering
Broken Hill: Production GCG Attacks Against LLMs on Consumer Hardware
LLM Engineering