Future AGI

future-agi/future-agi

Open-source, self-hostable platform to evaluate, trace, and guard LLM applications and AI agents.

ai-gateway
observability
simulation
ai-agents
ai-evals
evaluation-framework
llm-evaluation
llm-observability

More in Python

Transformershuggingface/transformers

A deep learning library containing thousands of pre-trained models on different tasks. The goto place for anything related to Large Language Models.

Deep learningLLMsNLPSpeech

168.1k updated today

Haystackdeepset-ai/haystack

A framework for building industrial-strength applications with Transformer models and LLMs.

LLMsNLP

26.8k updated today

Opikcomet-ml/opik

Open source engineering platform to debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. (Source Code)

GeneralLLMs

22.9k updated today

CometLLMcomet-ml/comet-llm

Track, log, visualize and evaluate your LLM prompts and prompt chains.

LLMsNLP

22.9k updated today

PyODyzhao062/pyod

> Python Outlier Detection, comprehensive and scalable Python toolkit for detecting outlying objects in multivariate data. Featured for Advanced models, including Neural Networks/Deep Learning and Outlier Ensembles.

GeneralDeep learningLLMs

10.1k updated 12d ago

Hubactiveloopai/Hub

Fastest unstructured dataset management for TensorFlow/PyTorch. Stream & version-control data. Store even petabyte-scale data in a single numpy-like array on the cloud accessible on any machine. Visit activeloop.ai for more info.

GeneralDeep learningLLMsVisionMLOps

9.3k updated 5mo ago