learnprompting logo
≡
Sitting astronautLearn Prompting
Prompt Engineering Guide
😃 Basics
💼 Applications
🧙‍♂️ Intermediate
🧠 Advanced
Special Topics
🌱 New Techniques
🤖 Agents
⚖️ Reliability
🖼️ Image Prompting
🔓 Prompt Hacking
🔨 Tooling
💪 Prompt Tuning
🗂️ RAG
🎲 Miscellaneous
Models
📝 Language Models
Resources
📙 Vocabulary Resource
📚 Bibliography
📦 Prompted Products
🛸 Additional Resources
🔥 Hot Topics
✨ Credits
🔨 ToolingPrompt Engineering IDEsPromptTools

PromptTools

Reading Time: 1 minute

Last updated on August 7, 2024

PromptTools is an open-source library for experimenting with, testing, and evaluating prompts, LLMs, and vector databases.

Features

PromptTools offers a playground for comparing prompts and models in three modes:

  • Instruction
  • Prompt template
  • Model comparison

In addition to the playground, PromptTools offers and SDK for writing tests and evaluation functions to experiment with and evaluate prompts at scale.

Check out this PromptTools tutorial video.

Sander Schulhoff

Sander Schulhoff is the Founder of Learn Prompting and an ML Researcher at the University of Maryland. He created the first open-source Prompt Engineering guide, reaching 3M+ people and teaching them to use tools like ChatGPT. Sander also led a team behind Prompt Report, the most comprehensive study of prompting ever done, co-authored with researchers from the University of Maryland, OpenAI, Microsoft, Google, Princeton, Stanford, and other leading institutions. This 76-page survey analyzed 1,500+ academic papers and covered 200+ prompting techniques.

Edit this page
Word count: 0

Previous

Prompt IDE

PromptSource

Next

Get AI Certified by Learn Prompting


Copyright © 2024 Learn Prompting.