All articles

Automation

121 articles

Automation

Building Production Web Scrapers in Go: Inside Colly's Event-Driven Architecture

By Rob Ragan ★ 25.3k Unknown May 12, 2026
Automation

Illume: A Case Study in Asyncio-Based Distributed Crawling Architecture

By Rob Ragan ★ 6 Unknown May 12, 2026
Automation

Testing Web Security Crawlers with Google's Security Crawl Maze

By Rob Ragan ★ 165 Unknown May 11, 2026
Automation

Katana: Why ProjectDiscovery Built a Crawler That Speaks Both HTTP and Chrome

By Rob Ragan ★ 16.7k Unknown May 11, 2026
Automation

Undetected Chromedriver: Evading Bot Detection in the Selenium Arms Race

By Rob Ragan ★ 12.6k Unknown May 11, 2026
Automation

Crawlee: The Web Scraping Framework That Lets You Start Simple and Scale Complex

By Rob Ragan ★ 23.2k Unknown May 11, 2026
Automation

Keep: Building an Open-Source AIOps Platform That Actually Reduces Alert Fatigue

By Rob Ragan ★ 11.8k Unknown May 11, 2026
Automation

reNgine: Building a Reconnaissance Command Center for Web Application Security

By Rob Ragan ★ 9 Unknown May 10, 2026
Automation

Astro's Islands Architecture: How Partial Hydration Redefined Content-First Frameworks

By Rob Ragan ★ 59.2k Unknown May 10, 2026
Automation

Read Aloud: Building a Cross-Browser TTS Extension with Multi-Provider Voice Synthesis

By Rob Ragan ★ 1.7k Unknown May 10, 2026
Automation

Flyscrape: Web Scraping With JavaScript Configuration Instead of Python Boilerplate

By Rob Ragan ★ 1.3k Unknown May 10, 2026
Automation

Inside AUTOMATIC1111: How a Gradio Wrapper Became the De Facto Stable Diffusion Interface

By Rob Ragan ★ 162.8k Unknown May 10, 2026
Automation

Reverse Engineering APIs with Browser DevTools: How OpenAPI DevTools Intercepts and Documents Network Traffic

By Rob Ragan ★ 4.3k Unknown May 10, 2026
Automation

Codify-rs: Embedding Complex Data Structures at Compile Time Without Serialization Overhead

By Rob Ragan ★ 1 Unknown May 10, 2026
Automation

Building a Web Scraper That Sees: GPT-4 Vision Meets Puppeteer

By Rob Ragan ★ 310 Unknown May 10, 2026
Automation

Web Scraping Through Vision: How GPT-4V Reads Websites Like Humans Do

By Rob Ragan ★ 563 Unknown May 10, 2026
Automation

Reverse Engineering ChatGPT's Frontend: How One Developer Built a Time Machine for Webpack Bundles

By Rob Ragan ★ 300 Unknown May 10, 2026
Automation

Hunting Secrets in 50 Billion Web Pages: Inside Troll-A's WARC Processing Engine

By Rob Ragan ★ 140 Unknown May 10, 2026
Automation

WARC-GPT: Teaching Language Models to Read Web Archive History

By Rob Ragan ★ 270 Unknown May 10, 2026
Automation

Untangle: Multi-Layer Web Server Fingerprinting Based on NDSS 2024 Research

By Rob Ragan ★ 13 Unknown May 9, 2026
Automation

Proving WebAssembly Sandboxes Are Safe: When Formal Verification Meets Performance

By Rob Ragan ★ 41 Unknown May 9, 2026
Automation

Firecrawl: Web Scraping Infrastructure Built for LLM Contexts, Not Human Eyes

By Rob Ragan ★ 117.3k Unknown May 9, 2026
Automation

Crawl4AI: The Open-Source Web Scraper That Speaks LLM

By Rob Ragan ★ 65.3k Unknown May 9, 2026
Automation

Argus: How 135 Reconnaissance Modules Became One Python CLI

By Rob Ragan ★ 3.5k Unknown May 9, 2026