| Problem | Quick fix | |---------|------------| | Site blocks you | Rotate User‑Agents, use proxies, add random delays | | Data loaded dynamically (JavaScript) | Use Playwright, Selenium, or a tool that renders JS | | Changing HTML structure | Write flexible selectors (e.g., data-* attributes), set up change alerts | | Huge scale | Use headless browsers + proxy rotation + cloud runners |