A field guide to scraping with AI

Claude can find almost anything on the internet.

Most people have no idea what it's capable of. You point it at the web, give it a little instruction, and it goes and gets you the thing. A list of companies. The software they run. The people who work there. These are the plays I use, explained so anyone can run them.

It's simpler than it sounds

1

The data is already public

The stuff you want is sitting on websites in plain sight. Nobody hid it well. The trick is knowing where to look.

2

Claude reads it for you

Instead of you copying and pasting for hours, Claude reads each page the way a person would and pulls out exactly the parts you asked for.

3

You get a clean list

What comes back is a tidy spreadsheet, ready to use. No code degree required. Just the right handful of tricks.

The plays

Seven things you can have Claude go find.

Each one is a real technique I use. Click in for the plain-English walk-through, what it pulls back, and how to run it yourself.

See what software any business runs

Look at a company's website and tell which tools it's built on. Works on any industry. I'll show you on dentists.

Read the play
Build a competitor's customer list

Every tool leaves a trail of the companies that use it. Follow the trail and you've got the whole list.

Read the play
Find a website's hidden pages

Most sites have pages that aren't in the menu anywhere. There's a public record that lists them. Here's how to read it.

Read the play
Get the data a site loads behind the scenes

A lot of sites quietly download their data in a neat, ready-made form, then dress it up for you. You can grab the neat version directly.

Read the play
Turn any website into a clean list

The everyday workhorse. Grab a page, hand it to Claude, ask for the bits you want in plain words. It does the rest.

Read the play
Scrape the sites that need a real browser

Some pages look empty until they finish loading. The fix is to open them in a real browser Claude can drive, then read what shows up.

Read the play
Reach the sites that try to block you

A few sites slam the door on anything automated. There's a way through for the stubborn ones. Use it last, it costs a little.

Read the play
Find anyone's work email

A bonus play. Build a verified list of work emails for about three cents each. The full write-up lives on my site.

See Three Cent Contacts

Want the list without the work?

Tell me what to find. I'll have Claude go get it.

Every play here is free to copy. But if you'd rather just have the finished list, send me what you're after and I'll run it. No subscription, no contract. One list, you keep it.

DM me @chris_as_is

Who's behind this

I'm Chris. I do marketing and GTM engineering, and somewhere along the way pulling data off the web with AI became the thing people ask me about most. So I wrote down how I actually do it.

Everything here works. The sample data is made up to protect anyone's real numbers, but the techniques are exactly what I run. More about me at chris-as-is.com.