What does LLMFly AI do?
LLMFly AI allows servers to call various AI models through a single OpenAI-compatible API, simplifying the integration process for developers.
Can I keep using the OpenAI SDK?
Yes, you can continue using the OpenAI SDK by changing the base URL, API key, and model ID to connect with LLMFly AI.
Which models can I call?
The LLMFly AI catalog provides a list of available models and their corresponding IDs, which may change over time.
How am I charged?
Each model has distinct input and output rates, and users can view their usage history to understand the costs associated with their requests.
Does LLMFly AI store prompts or responses?
Prompts and responses are processed for service delivery, with retention policies in place that comply with legal obligations and security needs.