Property data powers valuation models, investment lead-gen, and market analytics — and the portals that hold it fight scrapers harder than almost any vertical. Here's how property data is defended in 2026 and the stack that collects it cleanly.
Real-estate portals defend listings as proprietary data: Zillow runs Imperva/Incapsula (JS challenges, fingerprinting, IP blacklisting), Redfin blocks datacenter IP ranges, and UK portals like Rightmove/Zoopla have no public property-data API and expect local visitors. Official APIs are capped (Zillow ~1,000 calls/day, scraping prohibited). The working stack: a real browser on residential/mobile IPs in the target country, plus RESO Web API / IDX feeds where you can license them. Check each site's terms and the law first.
Real estate is hyper-local, and the big portals know it. Zillow draws an enormous audience — roughly 221 million average monthly unique users and around 2.1 billion quarterly visits — so the value of its Zestimates, listings and price history is immense, and it's guarded with enterprise anti-bot. The same is true across the category: this is data worth defending.
Two consequences for anyone collecting property data. First, datacenter IPs lose immediately — their hosting ASN is flagged before a page renders. Second, geography matters: region-locked portals serve and price differently by visitor location, so you collect from inside the target market with a residential or mobile IP. It's the same logic as travel geo-pricing — local IP, local truth.
| Portal | Main obstacle | What unlocks it |
|---|---|---|
| Zillow (US) | Imperva/Incapsula: JS challenge, fingerprint, IP blacklist | Real browser + residential/mobile IP |
| Redfin (US) | Datacenter IP blocking | Residential/mobile IP is the unlock |
| Rightmove / Zoopla (UK) | No public API; region-gated | UK-geo residential/mobile IP + browser |
| MLS / IDX | Licensing, not anti-bot | RESO Web API feed where you qualify |
Anti-bot setups change; treat this as the 2026 baseline and test your specific targets. Where a licensed RESO/IDX feed is available to you, prefer it.
Beating Imperva/Incapsula with real-browser + residential IPs.
Redfin blocks datacenter IPs — residential is the key.
No public API + region-gating → UK-geo IPs required.
The licensed route vs portal scraping — when to use which.
Property listings, prices, and comps are valuable proprietary data, so portals defend them hard. Zillow runs Imperva (Incapsula) with JavaScript challenges, fingerprinting and IP blacklisting; Redfin blocks datacenter IP ranges on sight. Their official APIs are tightly capped — Zillow's developer APIs limit you to roughly 1,000 calls/day and the terms prohibit scraping. That pushes most real data collection to browser automation over trusted residential/mobile IPs.
Yes for region-locked portals. UK sites like Rightmove and Zoopla expect UK visitors and have no public property-data API, so you need UK-geo residential/mobile IPs to see and collect listings the way a local user does. US portals (Zillow, Redfin) are less country-gated but still block datacenter ASNs, so residential or mobile IPs are the unlock.
Collecting publicly displayed listing data is common for valuation, market research and lead generation, but the rules depend on each site's terms, your jurisdiction, and whether you touch personal data. Official MLS/IDX feeds via the RESO Web API are the licensed route where you qualify. This guide is educational — review each platform's terms and applicable law before running at scale.
Real 4G/5G mobile + residential IPs across 17+ countries — $4/GB, free endpoints, free rotation. US for Zillow/Redfin, UK for Rightmove/Zoopla.