pangolinfo-scrape-legacy（pangoinfo 刮掉遗产）

Pangolin SERP & Scrape

New canonical (AI SERP): https://clawhub.ai/pangolinfo/pangolinfo-ai-serp Amazon skill: https://clawhub.ai/pangolinfo/pangolinfo-amazon-scraper

Search Google and scrape Amazon programmatically via Pangolin APIs. Extract AI overviews, organic search results, Amazon product data, and page screenshots.

Prerequisites

• Python 3.6+ (uses only standard library)
• Pangolin account at pangolinfo.com
• Environment variables (one of):

- PANGOLIN_TOKEN -- existing bearer token - PANGOLIN_EMAIL + PANGOLIN_PASSWORD -- for automatic login

Quick Start

AI Mode Search (Google AI Overview)

python3 scripts/pangolin.py --q "what is quantum computing" --mode ai-mode

Standard SERP with AI Overview

python3 scripts/pangolin.py --q "how does java work" --mode serp --screenshot

Multi-Turn Dialogue

python3 scripts/pangolin.py --q "python web frameworks" --mode ai-mode \
  --follow-up "compare flask vs django" \
  --follow-up "which is better for beginners"

Amazon Product Detail

python3 scripts/pangolin.py --url "https://www.amazon.com/dp/B0DYTF8L2W" --mode amazon

Amazon Keyword Search

python3 scripts/pangolin.py --q "wireless mouse" --mode amazon --parser amzKeyword

Workflow

1. Authenticate -- Token resolved from env var, cache (~/.pangolin_token), or fresh login
2. Choose API mode -- ai-mode | serp | amazon
3. Execute -- Script builds the request, calls the API with retry logic
4. Parse output -- Structured JSON to stdout

Usage

AI Mode (--mode ai-mode)

Uses parserName: "googleAISearch" with udm=50 to get Google AI Mode results.

python3 scripts/pangolin.py --q "explain machine learning" --mode ai-mode

Output includes ai_overview with content paragraphs and source references.

AI Overview SERP (--mode serp)

Uses parserName: "googleSearch" for standard SERP results with AI overview extraction.

python3 scripts/pangolin.py --q "best programming languages 2025" --mode serp

Output includes both organic_results and optional ai_overview.

Multi-Turn Follow-Up

Add follow-up questions to an AI Mode search. Keep to 5 or fewer for optimal performance (more is allowed but slower):

python3 scripts/pangolin.py --q "kubernetes" --mode ai-mode \
  --follow-up "how to deploy" \
  --follow-up "monitoring tools" \
  --follow-up "cost optimization"

Amazon (--mode amazon)

Scrape Amazon product data using various parsers.

Product detail by URL:

python3 scripts/pangolin.py --url "https://www.amazon.com/dp/B0DYTF8L2W" --mode amazon

Keyword search:

python3 scripts/pangolin.py --q "mechanical keyboard" --mode amazon --parser amzKeyword

Best sellers:

python3 scripts/pangolin.py --url "https://www.amazon.com/gp/bestsellers/electronics" \
  --mode amazon --parser amzBestSellers

With custom zipcode and raw HTML:

python3 scripts/pangolin.py --url "https://www.amazon.com/dp/B0DYTF8L2W" \
  --mode amazon --zipcode 90210 --format rawHtml

Available Amazon parsers:

Authentication Only

python3 scripts/pangolin.py --auth-only

Raw API Response

python3 scripts/pangolin.py --q "test" --mode ai-mode --raw

All CLI Options

--q QUERY          Search query
--url URL          Target URL (for Amazon product pages, category pages, etc.)
--mode MODE        ai-mode (default) | serp | amazon
--screenshot       Capture page screenshot (Google only)
--follow-up TEXT   Follow-up question (repeatable, ai-mode only)
--num N            Number of results (default: 10, Google only)
--parser PARSER    Amazon parser name (default: amzProductDetail)
--zipcode CODE     Amazon zipcode (default: 10041)
--format FMT       Amazon response format: json (default) | rawHtml | markdown
--auth-only        Authenticate and show token info
--raw              Output raw API response

Choosing the Right API

Output Format

Google (ai-mode / serp)

{
  "success": true,
  "task_id": "...",
  "results_num": 1,
  "ai_overview_count": 1,
  "ai_overview": [{"content": ["..."], "references": [{"title": "...", "url": "...", "domain": "..."}]}],
  "organic_results": [{"title": "...", "url": "...", "text": "..."}],
  "screenshot": "https://..."
}

Amazon

{
  "success": true,
  "task_id": "...",
  "url": "https://www.amazon.com/dp/...",
  "results_count": 1,
  "product": {"asin": "...", "title": "...", "price": "...", "star": "...", "rating": "..."}
}

See reference files for full response schemas.

Exit Codes

Troubleshooting

See references/error-codes.md for the full error code reference.

Deep-Dive Documentation