Question 1

What is GcrawlAI?

Accepted Answer

GcrawlAI is an open-source web scraping API by Gramosoft that converts any website into structured, LLM-ready data. It provides scrape, crawl, map, screenshot, and search endpoints with JavaScript rendering, anti-bot stealth, and rotating proxies included in every request — pricing is request-based, with no credit system.

Question 2

Is GcrawlAI free to use?

Accepted Answer

Yes. Every account includes 200 free requests per month with no credit card required, with JS rendering and residential IPs included from day one. The core engine is also MIT-licensed and free to self-host from GitHub. Paid plans start at ₹1,587/month for 3,000 requests.

Question 3

Is GcrawlAI open source?

Accepted Answer

Yes. The GcrawlAI engine is published on GitHub under the MIT license. You can self-host the full scraping stack or use the managed cloud API, which shares the same API surface.

Question 4

How is GcrawlAI different from Firecrawl or ScrapingBee?

Accepted Answer

GcrawlAI uses request-based pricing with no credit system: one request counts as one request, whether it needs plain HTML or full JavaScript rendering with stealth. Competitors charge credits with multipliers — typically 1 credit for HTML and 5 or more for JS rendering. GcrawlAI also offers India/APAC data residency and DPDPA 2023 compliance, which US and EU-hosted alternatives do not.

Question 5

Who builds GcrawlAI?

Accepted Answer

GcrawlAI is built by Gramosoft Private Limited, an ISO 9001 and ISO 27001 certified deep-tech AI company headquartered in Chennai, India, with delivery presence in Singapore and Malaysia, serving enterprise clients in aviation, automotive, and insurance.

Question 6

Does GcrawlAI handle JavaScript-rendered websites?

Accepted Answer

Yes. GcrawlAI renders JavaScript-heavy pages and single-page applications in a real headless browser automatically. No flags, no extra configuration, and no extra cost — it is still one request.

Question 7

Can GcrawlAI bypass Cloudflare and other anti-bot systems?

Accepted Answer

GcrawlAI uses a three-tier stealth stack that escalates automatically from fast fingerprint-safe requests to full browser cloaking with residential proxies, handling protections such as Cloudflare, DataDome, and PerimeterX for legitimate data collection.

Question 8

What output formats does GcrawlAI support?

Accepted Answer

Clean Markdown, raw HTML, page screenshots, SEO metadata, and extracted images — selectable per request, with country-level geotargeting. Clean Markdown strips navigation, ads, and footers to minimize LLM token usage.

Question 9

Can I crawl an entire website with GcrawlAI?

Accepted Answer

Yes. The /crawl endpoint discovers and scrapes every page on a domain with depth controls, path filters, and webhook delivery for large jobs.

Question 10

Does GcrawlAI work with AI agents and MCP?

Accepted Answer

Yes. GcrawlAI integrates with Claude, GPT, and Gemini-based agents through its REST API, SDKs, and MCP server, and plugs into LangChain and LlamaIndex for RAG pipelines.

Question 11

How does GcrawlAI's request-based pricing work?

Accepted Answer

GcrawlAI counts requests, not credits. One successful request equals one request, regardless of output format, JavaScript rendering, stealth level, or proxies used. There are no multipliers, and failed requests are never counted.

Question 12

Is web scraping with GcrawlAI legal?

Accepted Answer

Scraping publicly available data is generally lawful when done responsibly. GcrawlAI provides rate controls and robots.txt awareness, and publishes an acceptable use policy; customers remain responsible for complying with target sites' terms and applicable law.

Question 13

Is GcrawlAI DPDPA and GDPR compliant?

Accepted Answer

GcrawlAI is designed for India's DPDPA 2023 with in-region data processing for Indian and APAC customers, follows GDPR-aligned practices, and is operated by an ISO 27001 certified company. DPAs are available for enterprise plans.

Question 14

What SDKs are available?

Accepted Answer

Official Python and Node.js SDKs, plus a REST API usable from any language. cURL examples are provided for every endpoint in the documentation.

GcrawlAI App - Web Scraping & Crawling Playground