ByCrawl n8n Node: Scrape 15+ Platforms in n8n
ByCrawl's n8n community node ships 70+ operations across 15 platforms. Install one package, add your API key, and pull social media data into any n8n workflow — no scrapers needed.
The n8n ecosystem now has over 5,800 community nodes, growing at roughly 14 new nodes per day (NCNodes, 2026). Today we're adding one more — and it connects your workflows to 15 social media, review, and job platforms in a single install.
The package is @bycrawl/n8n-nodes-bycrawl. It's live on npm right now.
TL;DR: The ByCrawl n8n community node gives you 70+ operations across 15 platforms — Threads, Facebook, X, Instagram, TikTok, YouTube, Reddit, LinkedIn, Dcard, PTT, Google Maps, Trustpilot, Job104, 591 Rent, and Web Fetch. Install via Settings > Community Nodes, add your API key from bycrawl.com, and start pulling structured social data into n8n workflows. The web scraping market hit $1.03 billion in 2025 (Mordor Intelligence, 2025) — this node lets you tap into that without writing a single scraper.
What Does the ByCrawl n8n Node Do?
Social media content accounts for 26.1% of all web scraping targets, second only to product pricing at 34.8% (Scrapingdog, 2026). The ByCrawl node puts that data within reach of anyone who can drag and drop nodes in n8n.
Here's how it works. You select a platform — say, Reddit. You pick an operation — say, "Search Posts." You fill in the keyword and hit run. Back comes structured JSON: post titles, authors, scores, comment counts, timestamps. That JSON feeds directly into whatever comes next in your workflow: a Google Sheet, a Slack message, an AI summarization step, a database insert.
No HTTP Request nodes to configure. No headers to set. No response parsing to debug.
In our experience building social media scrapers across a dozen platforms, the hardest part isn't the initial request — it's maintaining the pipeline when platforms change their APIs or anti-bot systems. The ByCrawl node abstracts that maintenance away. We handle the scraping infrastructure; you handle the workflow logic.
Which Platforms Does the Node Support?
n8n now serves over 230,000 active users, with 75% actively using AI tools within the platform (Sacra, 2025). Those users can now access all 15 ByCrawl platforms without leaving the n8n canvas.
Global Social Media
| Platform | Operations | What You Can Do |
|---|---|---|
| Threads | 8 | Get users, search posts, pull public feeds, batch fetch posts |
| 8 | Get pages, search posts, browse Marketplace, pull comments | |
| X (Twitter) | 4 | Get users, get posts, search posts by keyword |
| 5 | Get user profiles, get posts, search by hashtag | |
| TikTok | 7 | Get users, search videos, pull comments, extract subtitles |
| YouTube | 5 | Get channels, get videos, pull comments, extract transcriptions |
| 6 | Get subreddits, get users, search posts, pull user history | |
| 7 | Get users, get companies, search jobs, pull company posts |
Local and Niche Platforms
| Platform | Operations | What You Can Do |
|---|---|---|
| Dcard | 4 | Get forums, search posts, get user personas |
| PTT | 4 | Get boards, get posts, search across boards |
| Google Maps | 2 | Search places, get place details and reviews |
| Trustpilot | 5 | Get businesses, pull reviews, search categories |
| Job104 | 3 | Search jobs, get job details, get company profiles |
| 591 Rent | 2 | Search rental listings, get listing details |
| Web Fetch | 1 | Fetch and parse any web page |
That's 70+ operations from a single node. Why does the count matter? Because each operation you'd otherwise build as a custom HTTP Request node takes 5-10 minutes to configure and test. Multiply that by 70 and you've saved yourself weeks.
How Do You Install the ByCrawl n8n Node?
Installation takes under a minute — five steps, no terminal required:
- Open your n8n instance.
- Go to Settings > Community Nodes.
- Enter
@bycrawl/n8n-nodes-bycrawland click Install. - Go to Credentials, create a new ByCrawl API credential.
- Paste your API key from bycrawl.com and save.
Done. The ByCrawl node appears in your node palette immediately. If you don't have a ByCrawl API key yet, sign up at bycrawl.com — new accounts get free credits to start.
For n8n Cloud users: community nodes became available on n8n Cloud in May 2025 (n8n Blog, 2025), so you can install ByCrawl on both self-hosted and cloud instances.
What Workflows Can You Build With It?
The workflow automation market reached $23.77 billion in 2025 and is projected to hit $40.77 billion by 2031 (Mordor Intelligence, 2025). Here's where ByCrawl fits into that growth — real workflows you can build today.
Social Listening and Brand Monitoring
Search for your brand name across Reddit, X, Threads, and Trustpilot on a schedule. Filter for negative sentiment. Push alerts to Slack with the original post link and context. We've seen teams catch PR issues hours before they'd normally notice them.
Nodes: Schedule Trigger → ByCrawl (search across platforms) → IF (sentiment filter) → Slack
Lead Generation From LinkedIn
Search for companies in your target industry. Pull their recent posts to gauge activity. Enrich leads with employee data. Push qualified prospects directly into your CRM. This is similar to what we covered in our guide on using ByCrawl MCP for outreach emails, but fully automated through n8n.
Nodes: Schedule Trigger → ByCrawl (LinkedIn search) → ByCrawl (get company posts) → Code (qualification logic) → HubSpot/Salesforce
Competitor Content Monitoring
Track what your competitors post on Instagram, TikTok, and YouTube. Pull engagement metrics weekly. Pipe the data into Google Sheets for trend analysis. Which content formats get the most engagement? You'll know before your competitors do.
Nodes: Schedule Trigger → ByCrawl (get user posts, multiple platforms) → Google Sheets
Review Aggregation
Pull Google Maps and Trustpilot reviews for your business locations into one place. Flag new negative reviews for immediate response. One team we work with cut their average response time to negative reviews from 48 hours to under 2 hours using this exact workflow.
Nodes: Schedule Trigger → ByCrawl (Google Maps + Trustpilot reviews) → IF (rating < 3) → Email/Slack
Content Research Pipeline
Search Reddit and YouTube for trending topics in your niche. Pull YouTube transcriptions and Reddit comments for content inspiration. Feed the raw material into an AI node for summary generation. If you're using Claude's 1M context window, you can process entire video transcripts in a single pass.
Nodes: Schedule Trigger → ByCrawl (Reddit + YouTube search) → ByCrawl (get transcriptions) → OpenAI (summarize) → Notion
Real Estate Monitoring (Taiwan)
Track new rental listings on 591 Rent matching your criteria. Get notified the moment a listing appears in your target area and price range.
Nodes: Schedule Trigger → ByCrawl (591 search) → IF (price/location filter) → LINE Notify
Why Use a Dedicated Node Instead of HTTP Requests?
n8n raised $180 million in October 2025 at a $2.5 billion valuation, with participation from Nvidia's NVentures (TechCrunch, 2025). That investment signals where the market is heading — toward specialized, well-integrated nodes rather than generic HTTP workarounds.
You could hit the ByCrawl API with n8n's generic HTTP Request node. But here's what the dedicated node gives you:
- Auto-complete for every parameter — no guessing field names or checking docs mid-workflow
- Built-in credential management — API key stored securely, attached automatically
- Platform-specific operation lists — select "Get Video Comments" instead of constructing
/tiktok/video/commentsURLs manually - Structured output — response data is properly typed for downstream n8n nodes
- Automatic updates — when we add platforms or operations, the node updates through npm
The difference? About 30 seconds to set up an operation vs. 10 minutes of reading API docs and configuring headers. Over a 10-node workflow, that adds up fast.
How Does ByCrawl Compare to Building Your Own Scrapers?
The web scraping market is growing at a 14.2% CAGR, projected to reach $2 billion by 2030 (Mordor Intelligence, 2025). That growth comes from teams realizing that building and maintaining scrapers in-house is more expensive than outsourcing the data extraction layer.
We've written about why we built ByCrawl and the specific pain points that drove us. The short version: every platform has different auth flows, rate limits, anti-bot systems, and data formats. One DOM change at 3 AM breaks your pipeline. The ByCrawl n8n node eliminates that entire category of maintenance.
If you want to compare approaches, we've also published detailed comparisons against Apify and Ensemble Data. Or check out our broader guide on what works in social media scraping.
How Do You Get X (Twitter) Data Through the Node?
This is one of the most common questions we get. Since Twitter's API pricing changes, getting X data has become expensive and restrictive. The ByCrawl node's X operations — Get User, Get Post, Search Posts, Get User Posts — bypass those API limitations entirely. We've covered this in depth in our guide on getting Twitter/X data without the API.
Frequently Asked Questions
Does the ByCrawl n8n node work on n8n Cloud?
Yes. Community nodes became available on n8n Cloud in May 2025 (n8n Blog, 2025). Install @bycrawl/n8n-nodes-bycrawl through Settings > Community Nodes on either self-hosted or cloud instances.
How many API credits does each operation use?
Each ByCrawl API call consumes 1 credit. A workflow that searches Reddit, pulls the top 5 posts, and fetches comments for each would use approximately 7 credits per run. New accounts receive free credits to start.
Can I use the node for Instagram scraping?
Yes. The node supports 5 Instagram operations: Get User, Get Post, Get Post Comments, Get User Posts, and Search Tags. For a detailed walkthrough, see our guide on how to scrape Instagram posts.
What data format does the node return?
Every operation returns structured JSON with consistent field naming. Post data includes text, author, timestamps, and engagement metrics. User data includes profile information, follower counts, and bio. The JSON plugs directly into n8n's downstream nodes without additional parsing.
Is there rate limiting?
ByCrawl handles rate limiting on its end. Your n8n workflows won't hit rate limit errors from individual platforms. If you exceed your ByCrawl plan's credit allocation, the API returns a clear error that you can handle with n8n's error workflow feature.
We built this node because automation shouldn't require writing scrapers. n8n already has 230,000+ users building workflows for everything from CRM updates to AI pipelines. Now those workflows can include real-time social media data from 15 platforms — with the same drag-and-drop simplicity n8n is known for.
Install @bycrawl/n8n-nodes-bycrawl, grab an API key from bycrawl.com, and let us know what you build.
