Use Cases / Lead Generation
Lead Generation
Sales teams and agencies use web scraping to build prospect lists from public sources - job boards, business directories, company websites, and industry listings. Instead of manually browsing and copying data, you can collect thousands of leads in the time it takes to write the parsing code.
Where to find leads
Job boards
Companies that are hiring are often growing and buying. LinkedIn Jobs, Indeed, and Glassdoor list companies along with the roles they are filling. A company hiring three sales reps is probably expanding their revenue team - that is a signal for SaaS vendors, consultancies, and service providers.
Business directories
Google Maps, Yelp, and industry-specific directories list businesses with their name, address, phone number, website, and sometimes revenue or employee count. These are publicly available data points that can be collected and filtered into targeted prospect lists.
Company websites
Once you have a list of target companies, you can scrape their websites for additional context - what products they sell, what technology they use, how many locations they have, and whether they have a specific need your product addresses.
Review platforms
Trustpilot, G2, and Capterra list companies along with their reviews, ratings, and customer feedback. Companies with poor reviews of a competitor's product might be ready to switch - a useful signal for sales outreach.
Find companies that are hiring
This example scrapes LinkedIn's public job search to find companies that are hiring for a specific role. The results include company names and locations - useful for building a targeted prospect list.
from browser7 import Browser7
from bs4 import BeautifulSoup
client = Browser7(api_key="b7_your_api_key")
result = client.render(
"https://www.linkedin.com/jobs/search/?keywords=hiring+manager",
country_code="US",
)
soup = BeautifulSoup(result.html, "html.parser")
for card in soup.select("div.base-card")[:10]:
title = card.select_one("h3.base-search-card__title")
company = card.select_one("h4.base-search-card__subtitle")
location = card.select_one("span.job-search-card__location")
print({
"title": title.get_text(strip=True) if title else None,
"company": company.get_text(strip=True) if company else None,
"location": location.get_text(strip=True) if location else None,
})CSS selectors may change if the site updates their page structure. See our LinkedIn scraping guide for the latest verified selectors and additional examples.
Data points for lead qualification
Raw company names are just the starting point. The more context you collect, the better you can qualify and prioritize leads:
Company basics
- Company name and website
- Industry and description
- Location and office count
- Employee count (where available)
Hiring signals
- Open roles and departments
- Job posting frequency
- Seniority of open positions
- Growth indicators (new offices, teams)
Technology signals
- Tech stack mentioned in job posts
- Tools listed on career pages
- Integration partners on website
- Technology review site profiles
Reputation data
- Review scores and trends
- Customer complaints and themes
- Competitor comparisons
- Social media presence
Why Browser7 works well for lead generation
Access protected sources
The most valuable lead sources - LinkedIn, Google Maps, industry directories - have strong anti-bot protection. Browser7's residential proxies and real browser rendering get through these defenses without custom workarounds.
Target specific markets
If you sell to businesses in a specific country or region, geo-targeting ensures you see the same search results and directory listings that local users see. A US-targeted search from a US IP returns different results than the same search from a European IP.
Cost-effective for one-time campaigns
Lead generation is often a burst activity - build a list, run a campaign, then build another list later. Browser7's pay-as-you-go pricing means you pay for the scraping when you need it and nothing when you do not. No monthly subscription to maintain between campaigns.
What this costs
Every page costs $0.01. A LinkedIn job search page shows 25 results per page, so 100 pages gives you up to 2,500 company leads for $1. Even after deduplication, that is a cost per lead that is hard to beat with any other method.
Related guides
- How to Scrape LinkedIn - public job listings and company data
- How to Scrape Indeed - job listings with salary and company info
- How to Scrape Google Maps - local business names, addresses, and ratings