Banana Changelog #003

Follow along on Twitter for detailed updates and improvements made to Banana.

Canary Test

We've eliminated the primary source of outages on the platform. Customer builds were previously getting corrupted and causing a global outage.

Uptime is extremely serious for us so we set to work on fixing it.

We've added a canary stage to the build pipeline to prevent corrupted images from entering prod. The pipeline will do a deployment into a mock cluster and verify healthy test calls against a canary model before sending the build onward into the prod cluster.

4x Larger CPU Memory

Much larger models may now be loaded through Banana!

We've 4x'ed the CPU memory on-board the standard cluster machine, making it so memory-intensive loads (commonly found in Huggingface framework models) can happen without out-of-memory errors.

2x to 3x Faster Cold Boot

We've increased the boot speed of containers and Banana framework models on our platform, up to 3x faster, based on model size and architecture.

How do you get these changes?

These improvements and safety features have gone into effect immediately and no changes need to be made on your end.

If you have any feature suggestions, improvements, or bug reports, send us a message or let us know in #support or #feature-requests on Discord.