Engineering Insights

Hugging Face Text Generation Inference available for AWS Inferentia2

Patch Time Series Transformer in Hugging Face

How streaming helps build faster web applications

Streaming is the key to and web applications.fastdynamic When , you can progressively send UI from server to client, without needing to wait until all of your data has been loaded. This helps your customers see content immediately, like your main call to action to add an item to the cart.streaming Read more

Databases at scale

Building an early warning system for LLM-aided biological threat creation

We’re developing a blueprint for evaluating the risk that a large language model (LLM) could aid someone in creating a biological threat. In an evaluation involving both biology experts and students, we found that GPT-4 provides at most a mild uplift in biological threat creation accuracy. While this uplift is not large enough to be conclusive, our finding is a starting point for continued research and community deliberation.

Introducing the Enterprise Scenarios Leaderboard: a Leaderboard for Real World Use Cases

Considerations for building a database disaster recovery plan

In a perfect world, the complex systems we build would run indefinitely without the risk of downtime. Unfortunately, we don't live in that world, so understanding how to recover from failures is necessary when they inevitably happen. This article will cover some considerations and best practices to ensure you can quickly and efficiently recover your database when disaster strikes. High availability vs disaster recovery High availability (HA) and disaster recovery (DR) are two closely related con

Accelerate StarCoder with 🤗 Optimum Intel on Xeon: Q8/Q4 and Speculative Decoding