CosmicAC Logo

Welcome

A self-hosted platform for running GPU workloads. Create GPU Container jobs and serve open-source language models on your own Kubernetes cluster.

CosmicAC is a self-hosted platform for running GPU workloads. You deploy it on your own infrastructure and connect it to your Kubernetes cluster, where it runs GPU Container jobs and serves open-source language models.

CosmicAC job types

CosmicAC runs two kinds of job. Choose the one that fits your task.

GPU Container Job

An isolated GPU machine you work on like a remote computer, with shell access.

Managed Inference

An OpenAI-compatible API that serves open-source language models.

Get started

Deploy CosmicAC, then connect the CLI to start running jobs.

Deploy CosmicAC

Deploy CosmicAC and connect it to your Kubernetes cluster.

Install the CLI

Install the CosmicAC CLI to interact with CosmicAC services from your terminal.

Once you have CosmicAC running, start here:

Create a GPU Container job

Launch your first GPU Container and open a shell into it.

Get a Managed Inference API key

Create a key and send your first chat-completion request.

Learn the concepts

Understand how CosmicAC runs jobs and serves models on your cluster.

Architecture

How CosmicAC connects to your cluster and runs each job type.

GPU Container Job

What a GPU Container Job is and when to use one.

Managed Inference

How model serving works end to end.

Guides

Hands-on guides for running jobs and operating your deployment.

GPU Container guides

Create, access, and work with GPU Container jobs.

Managed Inference guides

Connect a client to Managed Inference and send requests.

Operations

Monitor, scale, upgrade, back up, and troubleshoot your deployment.

Reference

Look up commands, configuration options, and release details.

CLI commands

Every CosmicAC CLI command, with usage and examples.

Configuration reference

Every platform and job configuration option.

Release notes

What changed in each release.

Installation

Next Page

On this page

CosmicAC job typesGet startedLearn the conceptsGuidesReference