This is a Free and Open Source microservice providing an REST API interface to the AI Horde following the Open AI API specification. This will allow you to use the LLM croudsourced compute for your projects and entertainment using software which is not otherwise integrating with the AI Horde API. If you like this service, consider joining the AI Horde yourself!
You can read our full API documentation for this service.
Please register an AI Horde account to get your own API key, or use the anonymous API key 0000000000 at the lowest priority.
This microservice has a lot of limitations over the direct AI Horde API. For one you cannot pass as many specialized parameters to your generation. You also don't have full visibility on the volunteer compute, so we have to take some assumptions to make this work without too much disruption to the end user. Significantly, your context window and your max tokens generation will be capped to the maximum available workers serving that particular model on the AI Horde.
Important Note: This microservice is a pilot and might be restricted or expanded in the future based on its popularity and impact on the AI Horde service resources. Please use it responsibly.
The standard AI Horde Terms and Conditions and Privacy policy apply to this service.