Back to Home

FireCrawler

Nov 2025—Present
View on GitHub

Technologies

  • TypeScript
  • Next.js
  • PostgreSQL
  • Redis
  • Pinecone
  • BullMQ
  • +2

About This Project

AI Platform for Automated Website Crawling, Semantic Indexing, and Embeddable Chatbots.

Key Architecture & Highlights:

  • Built end-to-end intelligent crawling pipeline for automated website parsing, semantic chunking, and vector indexing into Pinecone.
  • Integrated Gemini-powered RAG responses and voice assistant capabilities for conversational interaction over crawled content.
  • Created modular TypeScript architecture with structured error handling, retry policies, and rate-limiting queues.
  • Enabled drop-in embeddable chat widgets for third-party websites with customizable knowledge scopes.

All Technologies & Skills

  • TypeScript
  • Next.js
  • PostgreSQL
  • Redis
  • Pinecone
  • BullMQ
  • Gemini API
  • Vector Search