Engineering Insights

Vercel Workflow is now twice as fast

Server-side performance for Vercel Workflow, the fully managed platform built on top of the open-source Workflow Development Kit (WDK), is now twice as fast, delivering a 54% median improvement across the board. Over the last two weeks, the median API response time has been reduced from 37ms to 17ms, with queue latency, Time to First Byte (TTFB), and per-step overhead all reduced. Workflows that coordinate multiple steps benefit the most, as lower overhead compounds across each step in a run. To

GPT 5.3 Chat is now on AI Gateway

GPT-5.3 Chat (GPT 5.3 Instant) is now available on AI Gateway. This update focuses on tone, relevance, and conversational flow for more accurate answers, better-contextualized web results, and fewer unnecessary refusals and caveats. It also reduces hallucination rates and produces smoother and more direct responses. To use this model, set model to in the AI SDK.openai/gpt-5.3-chat AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, a

Gemini 3.1 Flash Lite is now on AI Gateway

Gemini 3.1 Flash Lite from Google is now available on AI Gateway. This model outperforms 2.5 Flash Lite on overall quality, with notable improvements in translation, data extraction, and code completion. Gemini 3.1 Flash Lite is best suited for high-volume agentic tasks, data extraction, and applications where budget and latency are the primary evaluation constraints. To use this model, set to in the AI SDK. This model supports four thinking levels, , , , and .modelgoogle/gemini-3.1-flash-lite

Workflows, Workers - Workflows step limit increased to 25,000 steps per instance

Each Workflow on Workers Paid now supports 10,000 steps by default, configurable up to 25,000 steps in your wrangler.jsonc file: { "workflows": [ { "name": "my-workflow", "binding": "MY_WORKFLOW", "class_name": "MyWorkflow", "limits": { "steps": 25000 } } ] } Previously, each instance was limited to 1,024 steps. Now, Workflows can support more complex, long-running executions without the additional complexity of recursive or chi

GPT-5.3 Instant System Card

GPT-5.3 Instant: Smoother, more useful everyday conversations

How DigitalOcean’s Agentic Inference Cloud powered by NVIDIA GPUs Achieved 67% Lower Inference Costs for Workato

Workato’s AI Research Lab is focused on helping customers extend their production automation with agentic AI capabilities, systems that can reason, act, and orchestrate work across the business. At Workato’s scale, processing 1 trillion automated workloads, LLM inference efficiency is a hard requirement: every millisecond of latency and every wasted GPU cycle directly impacts cost, throughput, and reliability. To make agentic workloads production-ready, the team needed an inference stack built f

Design-First Collaboration

Rahul Garg continues his series of Patterns for Reducing Friction in AI-Assisted Development. This pattern describes a structured conversation that mirrors whiteboarding with a human pair: progressive levels of design alignment before any code, reducing cognitive load, and catching misunderstandings at the cheapest possible moment. more…