- name
- info-spider
- description
- WeChat Official Account article crawler (微信公众号爬虫) CLI tool built in Rust. Use this skill when working on the info-spider crate, debugging spider commands, adding features, or when the user mentions 微信, WeChat, 公众号, official account, article scraping, MP platform, or info-spider. Also use when dealing with WeChat QR login flow (NOT IAAA), article-to-Markdown conversion, anti-crawler delays, or mp.weixin.qq.com API.
- version
- 1.0.0
Info-Spider - 微信公众号爬虫 CLI
A CLI crawler for WeChat Official Account (公众号) articles via the MP backend.
Architecture
- Crate location:
crates/info-spider/ - Auth flow: WeChat QR code login (completely separate from IAAA, does NOT use info-common)
- API: mp.weixin.qq.com backend API
- Config:
~/.config/info-spider/(separate from info-common Store) - Flow docs:
docs/wechat-mp-flow.md
Key Source Files
src/main.rs— Entry pointsrc/cli.rs— Clap CLI definitionsrc/commands.rs— Command implementationssrc/api.rs— WeChat MP API clientsrc/session.rs— Own session persistence (token, fingerprint, bizuin)src/client.rs— reqwest client builders
CLI Commands
| Command | Function |
|---|---|
login | WeChat QR code scan login to mp.weixin.qq.com |
logout / status | Session management |
search <QUERY> | Find Official Accounts by name/ID (returns fakeid list) |
articles | Fetch articles from an OA (--name or --fakeid) |
scrape <URL> | Convert single article URL to Markdown |
Articles Command Options
--begin— Start offset for pagination--count— Articles per page--limit— Maximum total articles to fetch--delay-ms— Random delay between requests (anti-crawler)--format {table|json|jsonl}— Output format
Development Notes
- Standalone auth: Uses its own WeChat QR login, NOT the IAAA flow from info-common
- Own session.rs: Stores token, fingerprint, bizuin (different from info-common session format)
- Mimics real user behavior with configurable delays to bypass risk controls
- Article scraping extracts content to clean Markdown
- Multiple output formats: table (default), JSON, JSONL
- All user-facing strings in Chinese
- Error handling:
anyhow::Resultwith.context("中文描述")