ByCrawl API

What is ByCrawl?

ByCrawl provides a single, consistent API to fetch posts, user profiles, feeds, and search results from multiple social media platforms. Instead of dealing with each platform’s API individually, you get one unified interface. Currently supporting 15 platforms across social media (Threads, Facebook, X/Twitter, Reddit, Instagram, TikTok, YouTube, LinkedIn), forums (Dcard, PTT), business & jobs (Google Maps, Trustpilot, Job104), and more (591 Rent, Web Fetch).

Base URL


https://api.bycrawl.com

Official Python SDK

Install the official SDK for a typed, Pythonic experience with auto-pagination, retry logic, and async support:


pip install bycrawl


from bycrawl import ByCrawl
 
client = ByCrawl(api_key="sk_byc_xxx")
user = client.threads.get_user("zuck")
print(user.data.follower_count)

See the full Python SDK docs for details.

Authentication

All data endpoints require an API key passed via the x-api-key header:

cURL


curl -H "x-api-key: sk_byc_xxx" https://api.bycrawl.com/threads/users/zuck

Python (SDK)


from bycrawl import ByCrawl
 
client = ByCrawl(api_key="sk_byc_xxx")
user = client.threads.get_user("zuck")
print(user.data)

Python (requests)


import requests
 
url = "https://api.bycrawl.com/threads/users/zuck"
headers = {"x-api-key": "sk_byc_xxx"}
 
response = requests.get(url, headers=headers, timeout=30)
print(response.json())

JavaScript


const response = await fetch("https://api.bycrawl.com/threads/users/zuck", {
  headers: {
    "x-api-key": "sk_byc_xxx",
  },
});
 
const data = await response.json();
console.log(data);

Quick Example

cURL


# Get a Threads user profile
curl -H "x-api-key: sk_byc_xxx" \
  https://api.bycrawl.com/threads/users/zuck
 
# Search X/Twitter posts
curl -H "x-api-key: sk_byc_xxx" \
  "https://api.bycrawl.com/x/posts/search?q=bitcoin&count=5"
 
# Get a Reddit subreddit
curl -H "x-api-key: sk_byc_xxx" \
  https://api.bycrawl.com/reddit/subreddits/programming

Python (SDK)


from bycrawl import ByCrawl
 
client = ByCrawl(api_key="sk_byc_xxx")
 
# Get a Threads user profile
user = client.threads.get_user("zuck")
print(user.data.username, user.data.follower_count)
 
# Search X/Twitter posts
results = client.x.search_posts("bitcoin", count=5)
 
# Get a Reddit subreddit
sub = client.reddit.get_subreddit("programming")
print(sub.data.subscribers)

Python (requests)


import requests
 
headers = {"x-api-key": "sk_byc_xxx"}
 
# Get a Threads user profile
threads_res = requests.get(
    "https://api.bycrawl.com/threads/users/zuck",
    headers=headers,
    timeout=30,
)
print(threads_res.json())
 
# Search X/Twitter posts
x_res = requests.get(
    "https://api.bycrawl.com/x/posts/search?q=bitcoin&count=5",
    headers=headers,
    timeout=30,
)
print(x_res.json())
 
# Get a Reddit subreddit
reddit_res = requests.get(
    "https://api.bycrawl.com/reddit/subreddits/programming",
    headers=headers,
    timeout=30,
)
print(reddit_res.json())

JavaScript


const headers = { "x-api-key": "sk_byc_xxx" };
 
// Get a Threads user profile
const threadsRes = await fetch("https://api.bycrawl.com/threads/users/zuck", {
  headers,
});
console.log(await threadsRes.json());
 
// Search X/Twitter posts
const xRes = await fetch(
  "https://api.bycrawl.com/x/posts/search?q=bitcoin&count=5",
  { headers },
);
console.log(await xRes.json());
 
// Get a Reddit subreddit
const redditRes = await fetch(
  "https://api.bycrawl.com/reddit/subreddits/programming",
  { headers },
);
console.log(await redditRes.json());