Independent Insurance Agency Directory Scraper

Scrapes independent insurance agency profiles from InsuranceDirectory.com (the Big Ⓘ / IIABA network) — one of the largest independent insurance agency directories in the US. Covers 60,000+ agency profiles with contact details, carrier appointments, and service areas.

What data is extracted

For each agency profile, the scraper extracts:

Field	Description
agency_name	Agency's display name
agent_name	Primary agent name from the agency's team roster, when published
phone	Main phone number
email	Contact email
website	Agency's own external website
address	Street address
city	City
state	State (2-letter code)
zip	ZIP code
latitude	Geocoded latitude of the agency address
longitude	Geocoded longitude of the agency address
carriers_represented	Pipe-separated list of carrier names
area_served	States or regions where the agency provides coverage
years_licensed	Approximate years in business (calculated from founding date)
founding_year	Year the agency was founded
description	Agency description / about us text
member_id	InsuranceDirectory.com internal ID
profile_url	Direct URL to the agency's profile page
iiaba_id	IIABA (Big I) member identifier, when published
iiaba_member	Whether the directory marks the agency as an IIABA member
rating	Average rating out of 5, when the agency has published reviews (most have none)
review_count	Number of reviews backing the rating, when published

How to use

Set Max Items to control how many agency profiles to scrape. Leave it at the default (10) to test with a small batch, or increase it to scrape the full directory (60,000+ agencies).

Use cases

• Wholesale carrier prospecting — filter by carriers_represented to find agencies appointed with your target carriers
• AMS / insurtech sales — build a prospect list of independent agencies with contact details
• Agency M&A research — identify acquisition targets by geography, carrier mix, and years in business
• Market intelligence — map the independent agency landscape by state and carrier relationship

Notes

• License data (numbers, types, disciplinary actions) is not published on InsuranceDirectory.com profiles.
• Ratings and review counts are only present for the minority of agencies that have published reviews.
• Covers 60,000+ agencies listed in the InsuranceDirectory.com (Big Ⓘ / IIABA) network.