drjones 78885c275e Round-robin proxy rotation + per-call timeout enforcement ...

- itertools.cycle() + threading.Lock() for thread-safe round-robin
- _next_proxy() returns (name, url) — never hits same proxy twice in a row
- DEFAULT_TIMEOUT = 300s (5 min) per API call
- crawl_url: timeout param, thread-enforced, returns proxy name
- research_topic: same timeout + proxy reporting
- Proxies: Tokyo/London/Sydney — no rate limits ever

2026-08-04 07:07:37 -07:00

53 KiB

Raw Blame History

View Raw