Skip to content

The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.

License

Notifications You must be signed in to change notification settings

zhushen12580/agenta

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Shows the logo of agenta

Collaborate on prompts, evaluate, and deploy LLM applications with confidence

The open-source LLM developer platform for prompt-engineering, evaluation, human feedback, and deployment of complex LLM apps.

MIT license. Doc PRs welcome Contributors Last Commit Commits per month PyPI - Downloads





Mockup agenta




⭐️ Why Agenta?

Agenta is an end-to-end LLM developer platform. It provides the tools for prompt engineering and management, ⚖️ evaluation, human annotation, and 🚀 deployment. All without imposing any restrictions on your choice of framework, library, or model.

Agenta allows developers and product teams to collaborate in building production-grade LLM-powered applications in less time.

With Agenta, you can:

Works with any LLM app workflow

Agenta enables prompt engineering and evaluation on any LLM app architecture:

  • Chain of prompts
  • RAG
  • Agents
  • ...

It works with any framework such as Langchain, LlamaIndex and any LLM provider (openAI, Cohere, Mistral).

Jump here to see how to use your own custom application with agenta

Quick Start

Features

Playground Evaluation
Compare and version prompts for any LLM app, from single prompt to agents.
playground_1024_30.07.2023.mp4
Define test sets, then evaluate manually or programmatically your different variants.
new_eval_demo.mp4
Human annotation Deployment
Use Human annotator to A/B test and score your LLM apps.
Screenshot 2024-01-28 at 12 57 46
When you are ready, deploy your LLM applications as APIs in one click.

Enterprise Support

Contact us here for enterprise support and early access to agenta self-managed enterprise with Kubernetes support.

Book us

Disabling Anonymized Tracking

By default, Agenta automatically reports anonymized basic usage statistics. This helps us understand how Agenta is used and track its overall usage and growth. This data does not include any sensitive information.

To disable anonymized telemetry, follow these steps:

  • For web: Set TELEMETRY_TRACKING_ENABLED to false in your agenta-web/.env file.
  • For CLI: Set telemetry_tracking_enabled to false in your ~/.agenta/config.toml file.

After making this change, restart Agenta Compose.

⭐️ Join Our Team

Contributing

We warmly welcome contributions to Agenta. Feel free to submit issues, fork the repository, and send pull requests.

We are usually hanging in our Slack. Feel free to join our Slack and ask us anything

Check out our Contributing Guide for more information.

Contributors ✨

All Contributors

Thanks goes to these wonderful people (emoji key):

Sameh Methnani
Sameh Methnani

💻 📖
Suad Suljovic
Suad Suljovic

💻 🎨 🧑‍🏫 👀
burtenshaw
burtenshaw

💻
Abram
Abram

💻 📖
Israel Abebe
Israel Abebe

🐛 🎨 💻
Master X
Master X

💻
corinthian
corinthian

💻 🎨
Pavle Janjusevic
Pavle Janjusevic

🚇
Kaosi Ezealigo
Kaosi Ezealigo

🐛 💻
Alberto Nunes
Alberto Nunes

🐛
Maaz Bin Khawar
Maaz Bin Khawar

💻 👀 🧑‍🏫
Nehemiah Onyekachukwu Emmanuel
Nehemiah Onyekachukwu Emmanuel

💻 💡 📖
Philip Okiokio
Philip Okiokio

📖
Abhinav Pandey
Abhinav Pandey

💻
Ramchandra Warang
Ramchandra Warang

💻 🐛
Biswarghya Biswas
Biswarghya Biswas

💻
Uddeepta Raaj Kashyap
Uddeepta Raaj Kashyap

💻
Nayeem Abdullah
Nayeem Abdullah

💻
Kang Suhyun
Kang Suhyun

💻
Yoon
Yoon

💻
Kirthi Bagrecha Jain
Kirthi Bagrecha Jain

💻
Navdeep
Navdeep

💻
Rhythm Sharma
Rhythm Sharma

💻
Osinachi Chukwujama
Osinachi Chukwujama

💻
莫尔索
莫尔索

📖
Agunbiade Adedeji
Agunbiade Adedeji

💻
Emmanuel Oloyede
Emmanuel Oloyede

💻 📖
Dhaneshwarguiyan
Dhaneshwarguiyan

💻
Priyanshu Prajapati
Priyanshu Prajapati

📖
Raviteja
Raviteja

💻
Arijit
Arijit

💻
Yachika9925
Yachika9925

📖
Aldrin
Aldrin

⚠️
seungduk.kim.2304
seungduk.kim.2304

💻
Andrei Dragomir
Andrei Dragomir

💻
diego
diego

💻
brockWith
brockWith

💻
Dennis Zelada
Dennis Zelada

💻
Romain Brucker
Romain Brucker

💻
Heon Heo
Heon Heo

💻
Drew Reisner
Drew Reisner

💻
Ikko Eltociear Ashimine
Ikko Eltociear Ashimine

📖
Vishal Vanpariya
Vishal Vanpariya

💻
Youcef Boumar
Youcef Boumar

📖
LucasTrg
LucasTrg

💻 🐛

This project follows the all-contributors specification. Contributions of any kind are welcome!

Attribution: Testing icons created by Freepik - Flaticon

About

The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 60.1%
  • TypeScript 39.1%
  • HCL 0.3%
  • Dockerfile 0.2%
  • Shell 0.1%
  • CSS 0.1%
  • Other 0.1%