Changelog #008

Follow along on Twitter for detailed updates and improvements made to Banana.

Released Stable Diffusion "Quick Deploy" Serverless Template

Let's be honest, new models are freaking fun. I think most ML nerds like us love to play around with the latest + greatest models upon release to get inspired.

The team at Stability.ai rolled out their new model, Stable Diffusion, and it has seen a surge of popularity from the ML community trying to use it and deploy to production.

We whipped up a template repository that enables you to deploy Stable Diffusion to production on serverless GPUs (Banana) in literally minutes (minus build time). Check out our demo tutorial of us setting up and deploying Stable Diffusion in 12 minutes to Banana.

Our Discord is loving the speed to deploy this model to Banana with the template and there is lots of buzz around Stable Diffusion in the community chat. Jump in!

Improved Internal Latency & Error Tracking System

This internal feature should greatly improve your customer experience. Before, when you had slowdowns or outages you would need to contact our engineering team and report it. Now, we'll be alerted of slowdowns + outages before you even see them!

We’ve added this tracing to our v3 and v4 SDKs. If you’re in production with a custom model and want to start feeding the Banana team more detailed info about your calls, updating your python/node SDKs to v4+ (or go SDK to most recent version) would give us more detail that’d help us reduce latencies, improve reliability, and debug your specific inference errors for you.

Real-time Build Updates

Right now our builds take on average 20-60 minutes to complete, and customers would trigger a build and wait but we had no progress indicator or communication of any kind until the build was fully completed.

Times have changed.

Now, you immediately see logs in your Banana dashboard and they update in realtime as build stages progress, including any errors should they come up. LFG.

Fixed Build Pipeline Bugs + Made Fast Boot more Robust

Basically, our product is getting better by the hour. Shoutout to all our early Banana users who share feedback with us in the Discord about what is working and what could be improved. We recently rolled out a few build pipeline improvements and spent time on making our fast boot optimizations more robust for customer models. More cool stuff coming too!

If you have any feature suggestions, improvements, or bug reports, send us a message or let us know in #support or #feature-requests on Discord.