360SOFTY

Insights

Engineering Insights

Practical writing on software architecture, SaaS products, AI automation, legacy modernisation, and the business of building reliable systems.

RSS

Curated links from external sources — not 360Softy original articles.

ExternalCloud
Cloudflare Changelog

Artifacts - Artifacts now in beta: versioned filesystem with Git access

Artifacts is now in private beta. Artifacts is Git-compatible storage built for scale: create tens of millions of repos, fork from any remote, and hand off a URL to any Git client. It provides a versioned filesystem for storing and exchanging file trees across Workers, the REST API, and any Git client, running locally or within an agent. You can read the announcement blog to learn more about what Artifacts does, how it works, and how to create repositories for your agents to use. Artifacts has t

Artifacts
Cloudflare ChangelogRead original
ExternalCloud
Cloudflare Changelog

Email Service - Email Sending now in public beta

Email Sending is now in public beta. Send transactional emails directly from Workers (env.EMAIL.send()) or the REST API, with support for HTML, plain text, attachments, inline images, and custom headers. Email Sending joins Email Routing under the new Cloudflare Email Service — a single service for sending and receiving email on the Cloudflare developer platform. Send an email from a Worker in a few lines of code: JavaScript export default { async fetch(request, env) { const respon

Email Service
Cloudflare ChangelogRead original
ExternalCloud
DigitalOcean Blog

Load Balancing and Scaling LLM Serving

Load balancing for LLMs is fundamentally different from load balancing for traditional services like web servers, APIs, or databases. Prompt caching is the reason. Prompt caching typically cuts input token costs by 50-90% and can reduce Time to First Token (TTFT) latency by up to 80%, but those gains assume your request lands on the replica that already has the relevant prefix cached. Under naive round-robin load balancing across N replicas, that probability is 1/N. The cache hit rate that made

DigitalOcean BlogRead original

Work with 360Softy

Building a SaaS product, AI system, or business platform?

Book a free consultation and we will tell you honestly whether we can help.