What's Supported?

A list of the models, vector DBs and frameworks that OpenLLMetry supports out of the box.

If your favorite system is not on the list, please open an issue for us in the respective Github repo and we’ll take care of it. In the meantime, you can still use OpenLLMetry to report the LLM and vector DB calls manually.

LLM Foundation Models

Model SDK	Python	Typescript
Aleph Alpha	✅	❌
Amazon Bedrock	✅	✅
Amazon SageMaker	✅	❌
Anthropic	✅	✅
Azure OpenAI	✅	✅
Cohere	✅	✅
Google Gemini	✅	✅
Google VertexAI	✅	✅
Groq	✅	⏳
HuggingFace Transformers	✅	⏳
IBM watsonx	✅	⏳
Mistral AI	✅	⏳
Ollama	✅	⏳
OpenAI	✅	✅
Replicate	✅	⏳
together.ai	✅	⏳
WRITER	✅	✅

Vector DBs

Vector DB	Python	Typescript
Chroma DB	✅	✅
Elasticsearch	✅	✅
LanceDB	✅	⏳
Marqo	✅	❌
Milvus	✅	⏳
pgvector	✅	✅
Pinecone	✅	✅
Qdrant	✅	✅
Weaviate	✅	⏳

Frameworks

Framework	Python	Typescript
Agno	✅	❌
AWS Strands	✅	❌
Burr	✅	❌
CrewAI	✅	❌
Haystack by deepset	✅	❌
Langchain	✅	✅
LiteLLM	✅	❌
LlamaIndex	✅	✅
OpenAI Agents	✅	❌