Engineering Insights

Incorporating databases into your CI/CD pipeline

Partnership with American Journalism Project to support local news

A new $5+ million partnership aims to explore ways the development of artificial intelligence (AI) can support a thriving, innovative local news field, and ensure local news organizations shape the future of this emerging technology.

Llama 2 is here - get it on Hugging Face

Building an AI WebTV

Open-Source Text Generation & LLM Ecosystem at Hugging Face

Lessons Learned Running Presto at Meta Scale

Presto is a free, open source SQL query engine. We’ve been using it at Meta for the past ten years, and learned a lot while doing so. Running anything at scale - tools, processes, services - takes problem solving to overcome unexpected challenges. Here are four things we learned while scaling up Presto to Meta scale, and some advice if you’re interested in running your own queries at scale. Scaling Presto rapidly to meet growing demands: What challenges did we face?   Deploying new Presto

Gossip Protocol Explained

You can subscribe to the system design newsletter to excel in system design interviews and software architecture. The original article was published on systemdesign.one website. What Is Gossip Protocol? The typical problems in a distributed system are the following [1], [11]: maintaining the system state (liveness of nodes) communication between nodes The potential solutions to these problems are as follows [1]: centralized state management service peer-to-pe

Fine-tuning Stable Diffusion models on Intel CPUs