# gocolly/colly

> Go scraping and crawling framework with a clean callback API

Navigation: [Developer Tools](category/developer-tools.txt) · [Index](../llms.txt)

## Facts

- GitHub: https://github.com/gocolly/colly
- HTML: https://awesomeopensource.dev/project/gocolly-colly
- Website: https://go-colly.org/
- License: Apache-2.0
- Language: Go
- stars: 25593
- Topics: crawler, crawling, framework, go, golang, scraper, scraping, spider
- Activity score: 3.4/5 (Maintained)
- Last commit (any branch): 2026-10-16
- Last release: v2.2.0 2025-03-27

## Description

Colly provides a collector interface for writing crawlers and spiders in Go, with callbacks for HTML elements, requests and responses. It manages request delays, concurrency per domain, cookies, sessions, caching, robots.txt and non-UTF-8 encodings, and supports synchronous, asynchronous and parallel scraping. Extensions add features such as distributed crawling, and it handles more than a thousand requests per second on a single core.

## Maintenance activity

- Recency: 80% (weight 40%) — last commit: 28 days ago
- Commit volume: 70% (weight 25%)
- Releases: 5% (weight 25%) — last release: 596 days ago
- Bug fixes: 100% (weight 10%)
- Commits: 8 / 90d, 45 / 365d

## Similar projects

- [stablyai/orca](stablyai-orca.md): Run several coding agents in parallel, each in its own Git worktree · Activity score 5.0/5 (Thriving)
- [tauri-apps/tauri](tauri-apps-tauri.md): Build small desktop and mobile apps with a web frontend and a Rust core · Activity score 5.0/5 (Thriving)
- [microsoft/terminal](microsoft-terminal.md): Tabs, panes and GPU rendering for PowerShell, cmd, WSL and SSH on Windows · Activity score 5.0/5 (Thriving)
- [ant-design/ant-design](ant-design-ant-design.md): A UI Design Language. · Activity score 5.0/5 (Thriving)
- [microsoft/playwright](microsoft-playwright.md): End-to-end testing and browser automation across Chromium, Firefox and WebKit · Activity score 5.0/5 (Thriving)
- [nvm-sh/nvm](nvm-sh-nvm.md): POSIX shell script for installing and switching between Node.js versions · Activity score 5.0/5 (Thriving)
