Changelog #020

Follow along on Twitter for detailed updates and improvements made to Banana.

Another big time week for features and improvements. They include:

Community Templates 🎇

This may be one of the most exciting feature launches in Banana history.

banana.dev/templates

All Banana users now have access to a tab in your Banana Dashboard called "Templates". These are ML model templates created by Banana developers that are configured to run on Banana's serverless GPU infrastructure.

Simply choose what model you want to run, click "Deploy" and in 1-3 minutes it will be deployed to your account ready for you call in production. Most of the popular models like Stable Diffusion, Whisper, Flan-T5, BLOOM, etc. are here - and more models are being added daily by developers.

You can submit models too...and earn money for people using your model templates! (read on to see how)

introducing Community Templates! 🎇🍌

✅ publish ML model templates to 1000s of users
✅ earn 10% 💸 revenue on your template usage
✅ access to library of popular models that deploy on serverless GPUs in seconds (no build times)

check it out pic.twitter.com/R3Mxhn0Njm

— Banana (@BananaDev_) February 2, 2023

Publish Templates

Any Banana user can submit a model template to the Templates page. There are basic requirements you have to follow (shown in screenshot) - but otherwise you can follow this guide on sharing a model template to get started.

Revenue Share 💸

Why share a template on Banana's platform? Two major reasons.

Social Credibility

Each template prominently displays your username and analytics on how many users have deployed your template to date. We'll be adding ratings and more interesting analytics soon. There are thousands of users on Banana, so this could be a hack to get your name and brand out there in the AI community.

Plus, it feels damn good to make things people want. Mad respect to the folks that make quality model templates.

Revenue Share Program

10% of revenue generated from user's running your model templates comes back to you in Banana credits. Applies to templates with >$10 usage.

Basically, if you share quality templates and other users actively deploy them - you will start generating income in the form of Banana credits that could offset some or all of your own hosting costs.

Shareable Model Cards

All templates have a shareable Model Card that includes a README, example input and outputs, and a code snippet you can use.

Check out this model card of instruct-pix2pix made by patienceai.

Detailed Model README

Input & Output Examples

Code Snippets

1-Click Deploys (no build times)

All templates have our 1-Click Deploy feature built-in, so no additional configuration is needed from you. Simply choose your model and click "Deploy".

Open Source Templates (Access to the Github Repo)

The templates published are open-source, which we love because you can view the source code and choose to fork the template if needed.

Up to 2x Inference Speedups

Inferences are getting snappier. We improved our inference infrastructure, and as a result you should see up to 2X faster inferences.

Increased Inference Timeout Limit to 24 hours

Inference timeout was increased up to 24 hours. The default is 12 hours but can be adjusted by modifying inference timeout parameter in your model settings. This is a big deal users who want to do training.

Dynamic Pod Limiting

This is a reliability improvement - replica quotas will dynamically increase or decrease based on traffic to prevent overflows.

UX Improvements

Made some tweaks to the Banana Dashboard - we updated our model previews with a slicker design, added the ability to filter your models by name, and cleaned up some stuff.

If you have any feature suggestions, improvements, or bug reports, send us a message or let us know in #support or #feature-requests on Discord.