Independent Insurance Agency Directory Scraper

Scrapes independent insurance agency profiles from InsuranceDirectory.com (the Big Ⓘ / IIABA network) — one of the largest independent insurance agency directories in the US. Covers 60,000+ agency profiles with contact details, carrier appointments, and service areas.

What data is extracted

For each agency profile, the scraper extracts:

Field	Description
agency_name	Agency's display name
legal_name	Legal business name (if different from display name)
phone	Main phone number
email	Contact email
website	External agency website
address	Street address
city	City
state	State (2-letter code)
zip	ZIP code
carriers_represented	Pipe-separated list of carrier names
area_served	States or regions where the agency provides coverage
years_licensed	Approximate years in business (calculated from founding date)
founding_year	Year the agency was founded
description	Agency description / about us text
member_id	InsuranceDirectory.com internal ID
profile_url	Direct URL to the agency's profile page

How to use

Set Max Items to control how many agency profiles to scrape. Leave it at the default (10) to test with a small batch, or increase it to scrape the full directory (60,000+ agencies).

Use cases

• Wholesale carrier prospecting — filter by carriers_represented to find agencies appointed with your target carriers
• AMS / insurtech sales — build a prospect list of independent agencies with contact details
• Agency M&A research — identify acquisition targets by geography, carrier mix, and years in business
• Market intelligence — map the independent agency landscape by state and carrier relationship

Notes

• License data (numbers, types, disciplinary actions) is not published on InsuranceDirectory.com profiles.
• Individual agent names are not available — data covers agencies, not individual licensed agents.
• Covers 60,000+ agencies listed in the InsuranceDirectory.com (Big Ⓘ / IIABA) network.