canonicalizing-urls（规范化网址）

canonicalizing-urls

Canonicalize URLs by running scripts/canonicalize.py (requires uv).

Proactive use

When a URL appears in a context where it will be saved, shared, or cited:

1. uv run scripts/canonicalize.py <url> (offline, static rules only)
2. If the URL matches an opaque short-link pattern (e.g. /share/p/), add --online
3. If the result differs from the input, substitute the canonical form
4. Note the change inline: "(canonicalized: removed fbclid)"

Explicit use

When the user asks to canonicalize a URL:

1. uv run scripts/canonicalize.py <url>
2. If unchanged and URL looks non-canonical, run --probe to discover rules

Adding a new rule

When the script returns unchanged output but the URL is clearly non-canonical:

1. uv run scripts/canonicalize.py --probe <url> — review suggested actions
2. Ask user: generalize to a pattern, or keep domain-specific?
3. Add a failing UAT row to tests/test_uat.py (BEFORE→AFTER)
4. Add the confirmed Rule(...) to RULES in scripts/rules.py

- Insert before HostGlob rules if the rule rewrites the host for a specific domain (the specific Host(...) rule must fire first to prevent the generic glob from also running) - Otherwise insert after similar-domain rules, before the closing bracket

1. uv run scripts/canonicalize.py <original_url> — verify output
2. uv run --group dev pytest tests/ -v — confirm all tests pass
3. Commit: feat: add <domain> canonicalization rule