AWS And Microsoft Are Borrowing What Google Already Built

AWS partnered with Cerebras. Microsoft licensed Fireworks. Google built Ironwood. One week of announcements reveals who ...
Las Vegas Sun

AWS and Cerebras Collaboration Aims to Set a New Standard for AI Inference Speed and Performance in the Cloud

Built on the AWS Nitro System — the foundation of AWS's secure, high-performance cloud infrastructure — the new solution will ensure that Cerebras CS-3 systems and Trainium-powered instances operate ...

The team behind continuous batching says your idle GPUs should be running inference, not sitting dark

FriendliAI — founded by the researcher behind continuous batching, the technique at the core of vLLM — is launching InferenceSense, a platform that fills idle neocloud GPU capacity with paid AI ...
TheStreet.com

Inference Isn’t A Problem. To Democratize AI, We Need To Cut The Costs Of Data Access

“The rapid release cycle in the AI industry has accelerated to the point where barely a day goes past without a new LLM being announced. But the same cannot be said for the underlying data,” notes ...
Security Boulevard

Inference protection for LLMs: Keeping sensitive data out of AI workflows

Inference protection is a preventive approach to LLM privacy that stops sensitive data from ever reaching AI models. Learn how de-identification enables secure, compliant AI workflows with ...
Princeton University

Inference in Nonstandard Problems

Paper: "Robust Nonparametric Bias-Corrected Inference in the Regression Discontinuity Design", (joint work with Sebastian Calonico and Rocio Titiunik).
Electronic Design

Three Tips for Boosting CNN Inference Performance

How to improve the performance of CNN architectures for inference tasks. How to reduce computing, memory, and bandwidth requirements of next-generation inferencing applications. This article presents ...