Skip to content

Commit

Permalink
simplify get started
Browse files Browse the repository at this point in the history
  • Loading branch information
williamFalcon authored May 30, 2024
1 parent bfa751d commit 7ead6e9
Showing 1 changed file with 7 additions and 13 deletions.
20 changes: 7 additions & 13 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -79,25 +79,19 @@ Explore various examples that show different models deployed with LitServe:
| [Stable diffusion 2](https://lightning.ai/lightning-ai/studios/deploy-a-private-api-for-stable-diffusion-2) | **(Vision)** Deploy Stable diffusion 2 for tasks like image generation | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/deploy-a-private-api-for-stable-diffusion-2"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a>
| [Text-speech (XTTS V2)](https://lightning.ai/lightning-ai/studios/deploy-a-voice-clone-api-coqui-xtts-v2-model) | **(Speech)** Deploy a text to speech voice cloning API. | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/deploy-a-voice-clone-api-coqui-xtts-v2-model"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a>

&nbsp;

# Install LitServe
Install LitServe via pip:

```bash
pip install litserve
```

[Advanced install options](https://lightning.ai/docs/litserve/home/install)

&nbsp;

# Get started
LitServe has a minimal API that allows enterprise-scale, with full control.

1. Implement the LitAPI class which describes the inference process for the model(s).
2. Enable the specific optimizations (such as batching or streaming) in the LitServer.

## Install LitServe
Install LitServe via pip (or use the [advanced install](https://lightning.ai/docs/litserve/home/install) instructions):

```bash
pip install litserve
```

## Implement a server
Here's a hello world example:

Expand Down

0 comments on commit 7ead6e9

Please sign in to comment.