Web MCP
Featuredby
Provides real-time web access for AI models, delivering search, markdown‑ready scraping, and optional browser automation while bypassing geo‑restrictions, rate limits, and CAPTCHAs.
Web MCP Overview
Web MCP Overview
What is Web MCP about? Web MCP delivers reliable, unblockable web access for large language models and AI agents, enabling them to fetch up‑to‑date information, scrape structured data, and control browsers without manual infrastructure.
How to use Web MCP?
- Obtain an API token from Bright Data.
- Run the server locally with
npx @brightdata/mcp(or use the hosted endpointhttps://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN). - Configure your LLM connector (e.g., Claude Desktop) to point to the MCP URL.
- Invoke tools such as
search_engineorscrape_as_markdownfrom your AI workflow. EnablePRO_MODE=trueto access the full suite of 60+ advanced tools.
Key features of Web MCP
- Real‑time web search optimized for AI responses.
- Clean markdown conversion of any webpage.
- Global access with automatic geo‑restriction bypass.
- Anti‑bot protection that prevents blocks and rate‑limits.
- Optional browser automation for interactive sites (Pro mode).
- Over 60 additional tools for e‑commerce, social media, maps, and more.
- Free tier: 5,000 requests/month; pay‑as‑you‑go Pro mode.
Use cases of Web MCP
- Real‑time research: fetch current prices, news, weather, or stock data.
- E‑commerce intelligence: monitor product availability and pricing across platforms.
- Market analysis: track competitor sites and industry trends.
- AI agents: empower autonomous agents to browse the web and act on live data.
- Content creation: supply up‑to‑date facts for articles, reports, or academic papers.
FAQ
- What if I get a "spawn npx ENOENT" error? Install Node.js or provide the full path to the
nodeexecutable. - Can I increase request limits? Upgrade to Pro mode or contact Bright Data for custom plans.
- How do I handle time‑outs on complex sites? Increase the client‑side timeout setting (e.g., to 180 seconds).
- Is the free tier sufficient for prototyping? Yes, 5,000 requests/month covers typical development and testing scenarios.
- Where can I find detailed tool documentation? See the Tools.md file in the repository or the online docs linked in the README.
Web MCP's README
🌟 Overview
The Web MCP is your gateway to giving AI assistants true web capabilities. No more outdated responses, no more "I can't access real-time information" - just seamless, reliable web access that actually works.
Built by Bright Data, the world's #1 web data platform, this MCP server ensures your AI never gets blocked, rate-limited, or served CAPTCHAs.
🎯 Perfect For
- 🔍 Real-time Research - Get current prices, news, and live data
- 🛍️ E-commerce Intelligence - Monitor products, prices, and availability
- 📊 Market Analysis - Track competitors and industry trends
- 🤖 AI Agents - Build agents that can actually browse the web
- 📝 Content Creation - Access up-to-date information for writing
- 🎓 Academic Research - Gather data from multiple sources efficiently
⚡ Quick Start
Perfect for users who want zero setup. Just add this URL to your MCP client:
https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN_HERE
Setup in Claude Desktop:
- Go to: Settings → Connectors → Add custom connector
- Name:
Bright Data Web - URL:
https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN - Click "Add" and you're done! ✨
{
"mcpServers": {
"Bright Data": {
"command": "npx",
"args": ["@brightdata/mcp"],
"env": {
"API_TOKEN": "<your-api-token-here>"
}
}
}
}
🚀 Pricing & Modes
💡 Note: Pro mode is not included in the free tier and incurs additional charges based on usage.
✨ Features
🔥 Core Capabilities
🎯 Example Queries That Just Work
✅ "What's Tesla's current stock price?"
✅ "Find the best-rated restaurants in Tokyo right now"
✅ "Get today's weather forecast for New York"
✅ "What movies are releasing this week?"
✅ "What are the trending topics on Twitter today?"
🎬 Demos
Note: These videos show earlier versions. New demos coming soon! 🎥
Basic Web Search Demo
https://github.com/user-attachments/assets/59f6ebba-801a-49ab-8278-1b2120912e33
Advanced Scraping Demo
https://github.com/user-attachments/assets/61ab0bee-fdfa-4d50-b0de-5fab96b4b91d
🔧 Available Tools
⚡ Rapid Mode Tools (Default - Free)
| Tool | Description | Use Case |
|---|---|---|
🔍 search_engine |
Web search with AI-optimized results | Research, fact-checking, current events |
📄 scrape_as_markdown |
Convert any webpage to clean markdown | Content extraction, documentation |
💎 Pro Mode Tools (60+ Tools)
| Category | Tools | Description |
|---|---|---|
| Browser Control | scraping_browser.* |
Full browser automation |
| Web Data APIs | web_data_* |
Structured data extraction |
| E-commerce | Product scrapers | Amazon, eBay, Walmart data |
| Social Media | Social scrapers | Twitter, LinkedIn, Instagram |
| Maps & Local | Location tools | Google Maps, business data |
📚 View complete tool documentation →
🎮 Try It Now!
🧪 Online Playground
Try the Web MCP without any setup:
🔧 Configuration
Basic Setup
{
"mcpServers": {
"Bright Data": {
"command": "npx",
"args": ["@brightdata/mcp"],
"env": {
"API_TOKEN": "your-token-here"
}
}
}
}
Advanced Configuration
{
"mcpServers": {
"Bright Data": {
"command": "npx",
"args": ["@brightdata/mcp"],
"env": {
"API_TOKEN": "your-token-here",
"PRO_MODE": "true", // Enable all 60+ tools
"RATE_LIMIT": "100/1h", // Custom rate limiting
"WEB_UNLOCKER_ZONE": "custom", // Custom unlocker zone
"BROWSER_ZONE": "custom_browser" // Custom browser zone
}
}
}
}
📚 Documentation
🚨 Common Issues & Solutions
❌ "spawn npx ENOENT" Error
Solution: Install Node.js or use the full path to node:
"command": "/usr/local/bin/node" // macOS/Linux
"command": "C:\\Program Files\\nodejs\\node.exe" // Windows
⏱️ Timeouts on Complex Sites
Solution: Increase timeout in your client settings to 180s
🔑 Authentication Issues
Solution: Ensure your API token is valid and has proper permissions
📡 Remote Server Connection
Solution: Check your internet connection and firewall settings
🤝 Contributing
We love contributions! Here's how you can help:
- 🐛 Report bugs
- 💡 Suggest features
- 🔧 Submit PRs
- ⭐ Star this repo!
Please follow Bright Data's coding standards.
📞 Support
📜 License
MIT © Bright Data Ltd.
Web MCP Reviews
Login Required
Please log in to share your review and rating for this MCP.
Actions
Web MCP's Information
- Author
- brightdata
- Category
- Web Scraping
- Language
- JavaScript
- License
- MIT License
- Version
- v2.5.0
- Stars
- 1,303
- Updated
- 1 month ago
Configuration
{
"mcpServers": {
"Bright Data": {
"command": "npx",
"args": [
"@brightdata/mcp"
],
"env": {
"API_TOKEN": "<YOUR_API_TOKEN>"
}
}
}
}Claude Code (Terminal)
claude mcp add Bright Data npx @brightdata/mcpConfigure Clients
Similar MCP Servers like Web MCP
Explore related MCPs that share similar capabilities and solve comparable challenges
Fetch
Officialby modelcontextprotocol
A Model Context Protocol server that provides web content fetching capabilities.
Playwright MCP
Officialby microsoft
Provides fast, lightweight browser automation using Playwright's accessibility tree, enabling LLMs to interact with web pages through structured snapshots instead of screenshots.
Firecrawl MCP Server
by firecrawl
Provides web scraping, crawling, search, and structured data extraction for LLM clients through a Model Context Protocol server.
Firecrawl MCP Server
by firecrawl
Provides powerful web scraping capabilities for LLM clients such as Cursor, Claude, and others, enabling content extraction, crawling, search, and batch processing through a Model Context Protocol server.
Tavily MCP
by tavily-ai
Provides real‑time web search, intelligent data extraction, structured website mapping, and systematic crawling through an MCP server, ready to be integrated with AI coding assistants and other tools.
Hyperbrowser MCP Server
by hyperbrowserai
Provides tools to scrape, extract structured data, crawl webpages, and access general‑purpose browser agents such as OpenAI CUA, Anthropic Claude Computer Use, and lightweight Browser Use via a Model Context Protocol server.
Fetch MCP Server
by zcaceres
Fetches web content and returns it in HTML, JSON, plain‑text, or Markdown formats, optionally applying custom request headers.
AgentQL MCP
Officialby tinyfish-io
Extract structured data from any web page by invoking AgentQL's extraction tool through a Model Context Protocol server, enabling AI assistants to retrieve and format web information on demand.
Oxylabs MCP Server
by oxylabs
Enables AI models to access, render, and extract clean, structured data from any website through a single API.