Integration

Integrating with large language models (LLMs) and embedding model providers in Epsilla allows users to tap into cutting-edge AI models for a variety of applications. Epsilla offers seamless connections to a range of providers such as OpenAI, Anthropic, and others, supporting models like GPT-4, Claude, Mistral, and embedding solutions like JinaAI, VoyageAI, etc.

Users can easily enable these integrations by entering their API keys, giving them access to the provider’s models for tasks such as text generation, embedding.

Once the API key is validated, the models are ready for immediate use across the Epsilla platform.

If the key validation fails, users can quickly update or correct their credentials, ensuring smooth and secure model access for their business needs.

By integrating your own LLM API key into Epsilla, all usage will be directly linked to your own LLM account, meaning that any costs or message usage will be handled by your LLM provider. This setup bypasses Epsilla's monthly message limits, allowing you full control and flexibility over your LLM usage and billing.

OpenAI has a sophisticated API key billing system that includes multiple tiers, model access options, and rate limits, and this can make the integration overwhelming and confusing. If you encounter any issues during the API key validation process or have questions about your integration, feel free to reach out to us for assistance.