Providers | liteLLM

📄️ OpenAI

LiteLLM supports OpenAI Chat + Text completion and embedding calls.

API Keys, Params

LiteLLM supports the following types of Huggingface models:

LiteLLM supports all models from Ollama

Pre-requisites

Pre-requisites

LiteLLM supports

LiteLLM supports Llama2 on Sagemaker

Anthropic, Amazon Titan, A121 LLMs are Supported on Bedrock

https://app.endpoints.anyscale.com/

https://www.perplexity.ai

LiteLLM supports all models on VLLM.

https://deepinfra.com/

LiteLLM supports j2-light, j2-mid and j2-ultra from AI21.

LiteLLM supports all LLMs on NLP Cloud.

LiteLLM supports all models on Replicate

API KEYS

LiteLLM supports all models on Together AI.

LiteLLM supports all models from Aleph Alpha.

LiteLLM supports any Text-Gen-Interface models on Baseten.

LiteLLM supports all the text models from OpenRouter

LiteLLM allows you to call your custom endpoint in the OpenAI ChatCompletion format

Petals//github.com/bigscience-workshop/petals