Downloadable software development kits (SDK); Downloadable computer software for calling large language model (LLM) application programming interfaces (API) in specific unified API format; spend tracking for LLM requests; creating virtual keys allowing user authentication; setting budget limits, rate limits, and emitting logs for other logging destinations and/or observability providers; load balancing, fallbacks, and retries