Changelog #010

Follow along on Twitter for detailed updates and improvements made to Banana.

New Banana Dashboard & UX

BOOM. One of our biggest product releases ever. Not only do all Banana customers have a brand new dashboard experience, but we decided to roll out a bunch of performance improvements with it.

(check out the new Banana experience here)

We ain't playing around this week, y'all. Let's dive in.

2-3x Faster Build Times (on A100 GPUs exclusively)

Build times have decreased from 1 hour to 15-20 minutes. It's probably obvious, but customers are loving this improvement.

P.S. hop into our damn Discord if you are building with AI/ML. It's worth it.

1-Click Deploy Models (Stable Diffusion)

We integrated 1-click models into the Banana product. Our first model is Stable Diffusion...because everyone wants to build with it. Using our 1-click model you can deploy stable diffusion from your Banana account in ~13 seconds (demo below).

When you deploy this route you will get a "Docs" tab inside the model settings that has a working code snippet with your model and API key auto-inserted to copy + paste into your product. Only available with 1-click models. Silky smooth.

Configurable Model Settings

Customization is life. We knew Banana customers needed configuration settings for their models - so here are two settings you can configure unique to each model.

Model Timeout

The time, in seconds, of inactivity following a call that the inference worker will wait for another call before scaling down. A longer timeout means fewer cold starts but more billable GPU time. Recommended for spiky, highly concurrent workloads.

Minimum # of Replicas Running

The quantity of inference workers to keep on at all times. A higher minimum replica setting means fewer cold starts but constantly billed GPU time. Recommended for steady, single concurrency workloads.

Banana Docs

This was long overdue...our bad. We are steadily building out the Banana Docs to help improve both the onboarding and overall user experience of the product. We appreciate your patience on this one. It's now here and accessible on our website and within the Banana Dashboard.

If you have any feature suggestions, improvements, or bug reports, send us a message or let us know in #support or #feature-requests on Discord.