A powerful website monitoring application that tracks changes on websites and sends intelligent notifications. Built with Next.js, Convex, and Firecrawl API.

• Website Monitoring: Track changes on single pages or entire websites
• AI-Powered Analysis: Filter out noise with intelligent change detection
• Flexible Notifications: Email, webhooks, or dashboard-only monitoring
• Secure API Key Management: Encrypted storage for Firecrawl and AI provider keys
• Real-time Updates: Instant change detection with configurable intervals
• Beautiful UI: Modern, responsive interface with dark mode support

• Node.js 18+ and npm
• A Convex account (free tier available)
• A Firecrawl API key (required for website monitoring)
• (Optional) Resend API key for email notifications
• (Optional) AI API key for intelligent filtering (OpenAI, Anthropic, Google, or Moonshot)

This will:

• Open your browser to authenticate with Convex
• Create a new project (or link to an existing one)
• Set up your database schema

Keep this terminal running.

This will:

• Set up your SITE_URL (use http://localhost:3000 for local development)
• Generate and configure JWT keys automatically
• Configure all necessary auth files

When prompted for the local web server URL, enter: http://localhost:3000

Visit http://localhost:3000 to see the application.

Create a .env.local file with:

Required variables in Convex dashboard:

• JWT_PRIVATE_KEY - Automatically set by npx @convex-dev/auth (required for auth)
• JWKS - Automatically set by npx @convex-dev/auth (required for auth)
• SITE_URL - Automatically set by npx @convex-dev/auth (required)
• ENCRYPTION_KEY - For securing API keys in database (required)
• FIRECRAWL_API_KEY - For website monitoring (optional, users can add their own)
• RESEND_API_KEY - For email notifications (optional)
• FROM_EMAIL - Sender email address (optional)

1. Sign up or log in to your account
2. Click "Add Website"
3. Choose monitoring type:
   • Single Page: Monitor a specific URL
   • Full Site: Crawl and monitor an entire website
4. Configure check interval (minimum 60 minutes)
5. Set up notifications (optional)

Users can add their own API keys for:

• Firecrawl: Required for website monitoring
• AI Provider: Optional, for intelligent change filtering

API keys are encrypted before storage using AES-256-GCM encryption.

1. Email Notifications

   • Requires email verification
   • Powered by Resend
   • Includes change summaries and AI analysis

2. Webhook Notifications

   • Send changes to your own endpoints
   • Configurable payload format
   • Includes full diff and metadata

3. AI-Filtered Notifications

   • Only receive notifications for meaningful changes
   • Configurable threshold (0-100)
   • Includes AI reasoning for each change

• npm run dev - Start development servers
• npm run build - Build for production
• npm run lint - Run ESLint
• npx convex dev - Start Convex backend
• npx convex deploy - Deploy to production
• npx @convex-dev/auth - Configure authentication

Before committing, ensure your code passes:

1. Push your code to GitHub
2. Import project in Vercel
3. Add environment variables:
   • NEXT_PUBLIC_CONVEX_URL (from Convex dashboard)
   • RESEND_API_KEY (if using email)
4. Deploy

Update your production environment variables in Convex dashboard.

• All API keys are encrypted using AES-256-GCM
• JWT-based authentication with secure sessions
• Email verification required for notifications
• Rate limiting on API endpoints
• Secure webhook URL validation

1. "Encryption key not set" error

   • Ensure ENCRYPTION_KEY is set in both .env.local and Convex environment

2. Authentication errors

   • Regenerate JWT keys using node scripts/generate-jwt-keys.js
   • Ensure SITE_URL matches your domain

3. Firecrawl API errors

   • Verify API key is valid
   • Check API rate limits
   • Ensure URLs are accessible

View backend logs:

1. Fork the repository
2. Create your feature branch (git checkout -b feature/amazing-feature)
3. Commit your changes (git commit -m 'Add amazing feature')
4. Push to the branch (git push origin feature/amazing-feature)
5. Open a Pull Request

This project is licensed under the MIT License - see the LICENSE file for details.

• Report Issues
• Firecrawl Documentation
• Convex Documentation