MTGGoldfish MTG Card Price Index Scraper

Scrape the full MTGGoldfish Magic: The Gathering card price index. Extracts paper, online (MTGO), and foil prices for cards across all MTG sets with weekly price-change data.

What it scrapes

• Source: mtggoldfish.com — the canonical paper + MTGO price aggregator used by the MTG community
• Coverage: All ~333 MTG sets including current and historical sets
• Data per card: set name, card name, card URL, rarity, paper price (USD), online/MTGO price (USD), foil price (USD, where applicable), weekly price-change percentage

Use cases

• Buylist tracking: monitor card prices across all sets to identify buylist opportunities
• Deck cost analysis: compute total deck cost using current paper or MTGO prices
• MTG arbitrage: spot price disparities across paper and online markets
• Price history research: track weekly price movement for specific cards

Output schema

Field	Type	Description
set_name	string	Full set name (e.g., "Aether Revolt")
set_url	string	MTGGoldfish set page URL
card_set_code	string	Set code (e.g., "AER")
card_name	string	Card display name
card_url	string	MTGGoldfish card price page URL
rarity	string	Card rarity (Common / Uncommon / Rare / Mythic)
paper_price_usd	number	Current paper market price in USD (null for foil cards)
foil_price_usd	number	Current foil paper price in USD (null for non-foil cards)
online_price_usd	number	Current MTGO tix price (decimal)
price_change_pct	number	Weekly price change percentage
format	string	Always null at the per-card level

Input

Parameter	Type	Default	Description
maxItems	integer	10	Maximum number of records to return. Set high or omit for a full run (~66,000+ records across all sets).

Notes

• Uses residential proxies (DataImpulse) to handle MTGGoldfish's Cloudflare IP-reputation layer. Only the clean /sets/* surface is used — the /prices/* paths are CF-blocked.
• For full-fleet scrapes, runtime is approximately 30–60 minutes at default concurrency. Memory: 512 MB.
• Foil cards are identified by a foil flag in the source data and are assigned to foil_price_usd rather than paper_price_usd.