Insights
Ideas for building
better software.
Engineering perspectives on architecture, product development, AI, and the everyday decisions behind useful software.
From the engineering desk
Browse practical articles or follow the latest technology updates.
Subscribe via RSS →Curated links from external sources — not 360Softy original articles.
Preparing Shopify for Black Friday and Cyber Monday
Bug Bounty Year in Review 2018
OpenAI Fellows Summer 2018: Final projects
Our first cohort of OpenAI Fellows has concluded, with each Fellow going from a machine learning beginner to core OpenAI contributor in the course of a 6-month apprenticeship.
How an Intern Released 3 Terabytes Worth of Storage Before BFCM
How AI training scales
We’ve discovered that the gradient noise scale, a simple statistical metric, predicts the parallelizability of neural network training on a wide range of tasks. Since complex tasks tend to have noisier gradients, increasingly large batch sizes are likely to become useful in the future, removing one potential limit to further growth of AI systems. More broadly, these results show that neural network training need not be considered a mysterious art, but can be rigorized and systematized.
Let’s start with a conversation
Tell us what you’re working on.
An idea, a challenge, or a system that needs to work better. We’ll help you understand the next step.
Prefer email? [email protected]