Self-hosting Julep
Learn how to configure and deploy Julep with Docker.
Julep is available as a hosted service or as a self-managed instance. This guide assumes you are running the commands from the machine you intend to host from.
Running Julep
Download the
docker-compose.yml
file along with the.env
file for configuration to run the Julep platform locally.
After all the services have started you can see them running in the background:
Environment Variables
You can use environment variables to control authentication and authorization with the platform and in between services.
For running locally:
The default
JULEP_API_URL
ishttp://0.0.0.0:8080
The default
JULEP_API_KEY
ismyauthkey
You can define your
ANTHROPIC_API_KEY
orOPENAI_API_KEY
in the.env
Restarting all services
You can restart services to pick up any configuration changes by running:
Be aware that this will result in downtime. Simply restarting the services does not apply configuration changes.
Stopping all services
You can stop Julep by running docker compose stop
in the same directory as your docker-compose.yml
file.
Uninstall and delete all data
Be careful!
This will wipe out all the conversation history and memories in the database and storage volumes
Advanced
If you want to deploy Julep to production, let's hop on a call!
We'll help you customize the platform and help you get set up with:
Multi-tenancy
Reverse proxy along with authentication and authorization
Self-hosted LLMs
& more
Last updated