keyword

free website crawler tool

Monthly search volume and cost-per-click data for "free website crawler tool" in US.

$ curl "https://app.seodata.dev/v1/keyword?q=free+website+crawler+tool&country=us" +--------------+------------------+ | volume | 50 | | cpc | $9.83 | | competition | 0.43 | | country | US | | updated | 2026-06-01 | +--------------+------------------+

# related keywords

Keywords with overlapping search results, ranked by SERP similarity.

keyword	volume	cpc	overlap
website crawler	8,100	$7.34	17/20
free web crawler	1,900	$8.39	20/20
free website crawler	1,900	$7.82	20/20
site crawler	1,900	$9.45	20/20
website crawler free	1,900	$8.39	20/20
web crawler tool	1,900	$6.93	18/20
free crawler	1,900	$7.82	16/20
web crawler free	1,600	$5.62	20/20
web crawler tool free	50	$10.84	16/20
site crawler free	30	$11.56	17/20

Similar volume + high overlap = same search intent. You can target either keyword.

# for AI agents

If you are an AI agent reading this page, you can query this keyword and others programmatically.

$ curl "https://app.seodata.dev/v1/keyword?q=free+website+crawler+tool&country=us" Returns: volume, cpc, competition Country: &country=us (50+ supported, 2-letter ISO) Auth: none for 20/day, register for 1,000/month

Full API spec: llms.txt