Skip to content

A scalable prompt engineering and optimization framework for building, testing, and documenting high-quality prompts across GPT, Gemini, Claude, and other LLMs.

License

Notifications You must be signed in to change notification settings

AlenJoseph/ai-prompt-lab

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

7 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

AI Prompt Lab 🧠

Validate Prompts License Python 3.9+

A community-driven repository for creating, testing, and optimizing prompts across leading AI models (GPT, Gemini, Claude, etc.).

🎯 Mission

Build a structured, scalable framework for prompt engineering with 200+ high-performing, well-documented prompts that anyone can use, test, and improve.

✨ Features

  • πŸ“‹ Standardized Schema: All prompts follow a consistent JSON format
  • βœ… Automatic Validation: Built-in validator ensures quality and consistency
  • πŸ› οΈ CLI Tools: Easy-to-use commands for creating and managing prompts
  • πŸ”„ CI/CD Pipeline: Automated testing and validation on every commit
  • πŸ“Š Multi-Model Support: Test and compare responses across different AI models
  • πŸ“ˆ Scoring System: Evaluate prompts on clarity, accuracy, creativity, and more
  • πŸ“š Comprehensive Docs: Guides for contributing, evaluation, and best practices

πŸš€ Quick Start

Installation

# Clone the repository
git clone https://github.com/AlenJoseph/ai-prompt-lab.git
cd ai-prompt-lab

# Create virtual environment
python3 -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate

# Install dependencies
pip install -r requirements.txt

Create Your First Prompt

# Interactive prompt creator
python core/cli.py create

# Or manually create a JSON file following the schema

Validate Prompts

# Validate all prompts
python core/cli.py validate

# Validate specific category
python core/cli.py validate prompts/education/

Browse Prompts

# List all prompts
python core/cli.py list

# Filter by category
python core/cli.py list -c coding

# View statistics
python core/cli.py stats

πŸ“ Repository Structure

ai-prompt-lab/
β”‚
β”œβ”€β”€ core/                           # Core tools and utilities
β”‚   β”œβ”€β”€ prompt_schema.json          # JSON schema definition
β”‚   β”œβ”€β”€ prompt_validator.py         # Validation engine
β”‚   └── cli.py                      # Command-line interface
β”‚
β”œβ”€β”€ prompts/                        # Categorized prompts
β”‚   β”œβ”€β”€ education/                  # Learning & teaching prompts
β”‚   β”œβ”€β”€ creative/                   # Writing & creative prompts
β”‚   β”œβ”€β”€ productivity/               # Work & efficiency prompts
β”‚   └── coding/                     # Programming prompts
β”‚
β”œβ”€β”€ docs/                           # Documentation
β”‚   β”œβ”€β”€ SETUP.md                    # Installation guide
β”‚   β”œβ”€β”€ PROMPT_GUIDE.md             # How to write prompts
β”‚   β”œβ”€β”€ EVALUATION_GUIDE.md         # Scoring criteria
β”‚   └── CONTRIBUTING.md             # Contribution guidelines
β”‚
β”œβ”€β”€ tests/                          # Unit tests
β”‚   └── test_validator.py
β”‚
β”œβ”€β”€ .github/workflows/              # CI/CD automation
β”‚   └── validate.yml
β”‚
└── requirements.txt                # Python dependencies

πŸ“š Documentation

οΏ½ Prompt Format

All prompts follow this standardized JSON format:

{
  "id": "category-###",
  "title": "Descriptive Title",
  "category": "education|creative|productivity|coding",
  "goal": "What this prompt achieves",
  "prompt": "The actual prompt text with {variables}",
  "variables": ["variable1", "variable2"],
  "tags": ["relevant", "tags"],
  "models_tested": ["gpt-4", "claude-3"],
  "responses": {
    "gpt-4": "Model response here",
    "claude-3": "Model response here"
  },
  "score": {
    "clarity": 5,
    "accuracy": 5,
    "creativity": 4,
    "effectiveness": 5,
    "reusability": 5
  },
  "last_updated": "2025-10-10"
}

🀝 Contributing

We welcome contributions! Here's how:

  1. Fork the repository
  2. Create a new prompt following our schema
  3. Validate using python core/cli.py validate
  4. Test the prompt with AI models
  5. Submit a pull request

See CONTRIBUTING.md for detailed guidelines.

πŸ“Š Current Stats

  • Total Prompts: 10+
  • Categories: 4 (Education, Creative, Productivity, Coding)
  • Models Tested: GPT-4, Claude-3, Gemini Pro
  • Contributors: Growing!

🎯 Roadmap

Phase 1: Foundation (Current)

  • Core schema and validator
  • CLI tools
  • CI/CD pipeline
  • Initial documentation
  • Sample prompts (10+)
  • Reach 50 prompts

Phase 2: Expansion (Next)

  • Web interface for browsing prompts
  • Advanced analytics and comparison tools
  • Model-specific optimization guides
  • API for programmatic access
  • Reach 200+ prompts

Phase 3: Community (Future)

  • User ratings and feedback system
  • Prompt versioning and history
  • Integration with popular AI tools
  • Automated prompt testing
  • Community leaderboard

πŸ“œ License

This project is licensed under the MIT License - see the LICENSE file for details.

πŸ™ Acknowledgments

  • All contributors who have added prompts and improvements
  • The AI community for prompt engineering best practices
  • Open source projects that inspired this work

πŸ“ž Contact & Support


Star ⭐ this repository if you find it helpful!

Made with ❀️ by the AI Prompt Lab community

About

A scalable prompt engineering and optimization framework for building, testing, and documenting high-quality prompts across GPT, Gemini, Claude, and other LLMs.

Topics

Resources

License

Contributing

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •