New: Try the Public Octivas Playground — test search, scrape & crawl live. No sign up needed. Try it now
Use Case
AI agents & knowledge bases
Give assistants real-time access to your docs, help centers, and the public web — with clean text, links, and metadata for RAG.
Perfect for
Customer support platforms
Ingest help centers and macros so agents answer with up-to-date articles and citations.
Developer tools & docs portals
Keep API reference and changelogs in sync for in-app assistants and copilots.
Internal IT & HR assistants
Ground policies and wikis in retrieved chunks with URLs for auditability.
SaaS vendors white-labeling AI
Offer tenants scoped crawls so each customer’s knowledge stays isolated.
How it works
Crawl your corpus → scrape pages → add search where needed → keep schedules fresh.
Map and crawl your site
Use /crawl on docs and support paths, with include rules so you stay within allowed sections.
Crawl API docsNormalize to markdown
Use /scrape per URL for main content, tables, and code blocks your chunker and embedder expect.
Scrape API docsAugment with web search
Use /search when users ask about third-party integrations or fresh announcements outside your corpus.
Search API docsRefresh on every release
Schedule re-crawls after deploys so embeddings and citations never drift from production docs.
Map and crawl your site
Use /crawl on docs and support paths, with include rules so you stay within allowed sections.
Crawl API docsNormalize to markdown
Use /scrape per URL for main content, tables, and code blocks your chunker and embedder expect.
Scrape API docsAugment with web search
Use /search when users ask about third-party integrations or fresh announcements outside your corpus.
Search API docsRefresh on every release
Schedule re-crawls after deploys so embeddings and citations never drift from production docs.
Start free, scale as you grow
1,000 free API credits every month. No credit card required.
For new creators
- 1,000 API credits /month
- No credit card required
- Email support
Built for enthusiasts
- 4,000 API credits / month
- Higher rate limits
- Email support
For professionals
- 100,000 API credits / month
- More concurrent requests
- Email support
Enterprise
Power at your pace with custom solutions
- Scrape unlimited pages
- Custom concurrent requests
- Dedicated support & SLA
- Bulk discounts
Ready to power assistants with live web context?
Sign up in seconds. Your first 1,000 API credits are on us — no credit card required.