mit-media-lab-pytutor-promptfoo

MIT media lab pytutor promptfoo Read here for LLM readteaming

how to run it

• run npm ci to install promptfoo package
• in your terminal, run export OPENAI_API_KEY=your_api_key_here
• now you can choose one frolm below
  • Run promptfoo eval to see the result in the terminal
  • Run promptfoo view to use the local web viewer
  • Run promptfoo share to create a shareable URL

Then, you will see a beautiful test tables like this.

how do I modify / add more test cases

Everything is in the file called promptfooconfig.yaml :)