LLM Engineering
How LLM applications get built and shipped: inference and serving, structured output, token formats, evaluation, and the libraries powering production language-model systems.
157 articles
LLM Engineering
Inside Microsoft's UniLM: A Research Catalog of Foundation Models from BitNet to Kosmos
LLM Engineering
Marsha: The Programming Language That Compiles English Into Tested Python Using LLMs
LLM Engineering
OWASP's Open Asset Model: Treating Your Attack Surface Like a Knowledge Graph
LLM Engineering
DeepEval: Testing LLM Applications Like You Test Your Code
LLM Engineering
Training Custom LLMs with Synthetic Data: How GPT-4 Can Build Your Dataset
LLM Engineering
Axflow: A Zero-Dependency TypeScript Framework That Treats AI Like First-Class Infrastructure
LLM Engineering
LLM Guard: Building a Security Middleware Layer for Large Language Models
LLM Engineering
Tree of Thoughts: Teaching Language Models to Think by Exploring, Not Just Reasoning
LLM Engineering
CircuitStream: A Lightweight LLM Proxy for Teams Sharing Rate Limits
LLM Engineering
Building a Slack Doppelgänger: Fine-Tuning LLMs on Your Message History with Modal
LLM Engineering
Inside the Foundation Model Transparency Index: How Stanford Scores AI Giants on Disclosure
LLM Engineering
SimplyRetrieve: Building Privacy-First RAG Systems That Treat LLMs as Context Interpreters, Not Oracles
LLM Engineering
Deconstructing Sparse Matrix Performance: A Case Study in Rust Optimization
LLM Engineering
LLM-CLI: A Crystal-Fast Command Generator That Learns What You Mean
LLM Engineering
Instructor: How Pydantic Models Turned LLM JSON into Type-Safe Python Objects
LLM Engineering
Inside Microsoft's LMOps: Research Prototypes That Reveal How LLMs Actually Work
LLM Engineering
Paxml: Google's JAX Framework for Training Models at Trillion-Parameter Scale
LLM Engineering
BishopFox/llm-testing-findings: The Missing Standard for Documenting AI Security Vulnerabilities
LLM Engineering
LitGPT: The Zero-Abstraction Framework for Production LLM Training
LLM Engineering
getML: The C++ Engine That Makes Feature Engineering on Relational Data 1000x Faster
LLM Engineering
Weaponizing Machine Learning Models: How Pickle Deserialization Turns TensorFlow into a Trojan Horse
LLM Engineering
Inside GCG: The Gradient-Based Attack That Broke LLM Alignment
LLM Engineering
AutoRedTeam: Training Language Models to Attack Other Language Models
LLM Engineering