Skip to content

spar65/aiassessmenttool

Repository files navigation

AI Assessment Tool Logo

AI Assessment Tool

What's Your AI's Ethics Score?

npm version Live Demo License Next.js

Test your AI system across 4 ethical dimensions in under 15 minutes.
Free, open-source, and your API key never leaves your browser.


🌟 What is This?

The AI Assessment Tool is a standalone demo application that tests AI systems for ethical alignment. It uses the AI Assess Tech SDK to evaluate AI responses against 120 questions across four dimensions:

Dimension What It Tests
πŸ€₯ Lying Honesty, truthfulness, and deception avoidance
🎲 Cheating Fair play, rule-following, and integrity
πŸ΄β€β˜ οΈ Stealing Respect for ownership and intellectual property
⚠️ Harm Safety, avoiding damage, and protective behavior

✨ Key Features

  • πŸ”‘ Bring Your Own Key (BYOK) - Your OpenAI/Anthropic API key never touches our servers
  • 🎯 Lead Capture - Collects email and company before assessment
  • βš™οΈ Configurable Thresholds - Set custom pass/fail criteria per dimension
  • πŸ“Š Real-time Progress - Watch the 120-question assessment run live
  • βœ… Instant Results - Pass/fail determination with detailed scores
  • πŸ”— Verification URLs - Shareable, tamper-proof verification links
  • πŸ’Ύ Saved Prompts - Save and reuse system prompts locally

πŸ—οΈ Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                        User's Browser                        β”‚
β”‚  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”  β”‚
β”‚  β”‚  Landing    β”‚ ─> β”‚  Configure   β”‚ ─> β”‚   Assess      β”‚  β”‚
β”‚  β”‚  (Lead)     β”‚    β”‚  (API Key)   β”‚    β”‚   (Questions) β”‚  β”‚
β”‚  β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜  β”‚
β”‚                            β”‚                     β”‚          β”‚
β”‚                            v                     v          β”‚
β”‚                    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”  β”‚
β”‚                    β”‚  localStorage β”‚    β”‚  OpenAI API   β”‚  β”‚
β”‚                    β”‚  (config)     β”‚    β”‚  (in browser) β”‚  β”‚
β”‚                    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜  β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                            β”‚
                            v
              β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
              β”‚   AI Assess Tech API    β”‚
              β”‚  (Lead registration,    β”‚
              β”‚   scoring, verification)β”‚
              β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Security Model

Your API key stays completely in your browser:

  1. Input - You paste your API key
  2. Storage - Stored in browser localStorage (cleared on page load)
  3. Usage - Direct browser-to-OpenAI/Anthropic calls
  4. Result - Only responses (not keys) sent to our API for scoring

πŸš€ Quick Start

Prerequisites

  • Node.js 18+ (LTS recommended)
  • npm or yarn
  • OpenAI API Key or Anthropic API Key

Installation

# Clone the repository
git clone https://github.com/yourusername/ai-assessment-tool.git
cd ai-assessment-tool

# Install dependencies
npm install

# Copy environment example
cp env.example .env.local

# Start development server
npm run dev

The app runs at http://localhost:3001 (port 3001 to avoid conflicts with other apps).

Production Build

npm run build
npm start

βš™οΈ Configuration

Environment Variables

Create a .env.local file from env.example:

# AI Assess Tech API URL (for lead registration and scoring)
NEXT_PUBLIC_API_URL=https://www.aiassesstech.com

# Optional: Health Check API Key (for server-side validation)
# Leave empty if not needed - the demo works without it
NEXT_PUBLIC_HEALTH_CHECK_KEY=

Self-Hosted Setup

To run your own instance:

  1. Clone this repo and set up environment
  2. Configure API URL to point to your AI Assess Tech instance
  3. Deploy to Vercel (or any Node.js host)

πŸ“± Pages & Flow

Route Purpose
/ Landing page with lead capture form
/configure API key input, model selection, system prompt, thresholds
/assess Real-time progress during 120-question assessment
/results/[runId] Results with scores, pass/fail, and verification link

User Flow

πŸ“§ Enter Email β†’ πŸ”‘ Enter API Key β†’ πŸ“ Configure Prompt β†’ ▢️ Run Assessment β†’ πŸ“Š View Results

πŸ”§ Supported AI Providers

OpenAI

  • GPT-4 (Recommended)
  • GPT-4 Turbo (Faster)
  • GPT-4o (Latest)
  • GPT-3.5 Turbo (Budget)

Anthropic (Claude)

  • Claude 4 Sonnet (Latest)
  • Claude 4 Opus (Most Capable)
  • Claude 3.5 Sonnet (Stable)
  • Claude 3.5 Haiku (Fast)
  • Claude 3 Haiku (Budget)

⏱️ Time Estimates

Model Estimated Time
GPT-3.5 Turbo 4-6 minutes
GPT-4 Turbo 6-10 minutes
GPT-4 8-12 minutes
Claude 3 Haiku 3-5 minutes
Claude 3.5 Sonnet 8-12 minutes
Claude 4 Opus 10-15 minutes

πŸ› οΈ Development

Project Structure

ai-assessment-tool/
β”œβ”€β”€ src/
β”‚   β”œβ”€β”€ app/                 # Next.js App Router pages
β”‚   β”‚   β”œβ”€β”€ page.tsx         # Landing (lead capture)
β”‚   β”‚   β”œβ”€β”€ configure/       # API key & config
β”‚   β”‚   β”œβ”€β”€ assess/          # Assessment runner
β”‚   β”‚   β”œβ”€β”€ results/         # Results display
β”‚   β”‚   └── api/             # API routes (proxy, rate-limit)
β”‚   β”œβ”€β”€ components/          # Reusable UI components
β”‚   β”‚   β”œβ”€β”€ APIKeyInput.tsx
β”‚   β”‚   β”œβ”€β”€ ModelSelector.tsx
β”‚   β”‚   β”œβ”€β”€ SavedPrompts.tsx
β”‚   β”‚   β”œβ”€β”€ SystemPromptEditor.tsx
β”‚   β”‚   └── ThresholdSliders.tsx
β”‚   └── lib/                 # Utilities
β”‚       β”œβ”€β”€ assessment.ts    # Config/result management
β”‚       β”œβ”€β”€ leads.ts         # Lead registration
β”‚       └── prompts.ts       # Saved prompts storage
β”œβ”€β”€ public/                  # Static assets
β”œβ”€β”€ env.example              # Environment template
β”œβ”€β”€ package.json
└── README.md

Key Technologies

Scripts

npm run dev      # Start development server on port 3001
npm run build    # Create production build
npm run start    # Start production server
npm run lint     # Run ESLint

πŸš€ Deployment

Vercel (Recommended)

Deploy with Vercel

  1. Click "Deploy with Vercel"
  2. Set environment variables in Vercel dashboard
  3. Deploy!

Manual Deployment

# Build
npm run build

# Deploy to your hosting provider
# Upload .next/, node_modules/, package.json, and public/

Environment Variables for Production

Variable Required Description
NEXT_PUBLIC_API_URL βœ… AI Assess Tech API URL
NEXT_PUBLIC_HEALTH_CHECK_KEY ❌ Optional demo key

🀝 Contributing

We welcome contributions! Please see CONTRIBUTING.md for guidelines.

Quick Contribution Flow

  1. Fork the repository
  2. Create a feature branch (git checkout -b feature/amazing-feature)
  3. Commit your changes (git commit -m 'Add amazing feature')
  4. Push to the branch (git push origin feature/amazing-feature)
  5. Open a Pull Request

πŸ“‹ Roadmap

  • Chat Interface - Chat with your AI after it passes
  • Email Verification - Verify leads before assessment
  • Cloud Prompts - Sync saved prompts across devices
  • CAPTCHA - Rate limiting with hCaptcha/Turnstile
  • Assessment History - View past assessments
  • PDF Reports - Export results as PDF

πŸ“œ License

This project is licensed under the MIT License - see the LICENSE file for details.


πŸ”— Links


πŸ’¬ Support


Made with ❀️ by AI Assess Tech

About

This is the Demo Site for the product aiassesstech (Also known as compsi in this repository)

Resources

License

Contributing

Stars

Watchers

Forks

Packages

No packages published