Signal
9 articles covering "AI inference"
Cerebras will supply roughly 100 megawatts of CS-4 systems to inference-cloud startup Gimlet Labs, which pairs wafer-scale chips with GPUs and targets up to 3,000 tokens per second.
Cohere's new Encrypted Vault tier for Model Vault runs inference inside hardware that encrypts memory on both CPU and GPU, so Cohere and the cloud provider cannot read customer data.
Cerebras unveiled its CS-4 rack-scale inference system, claiming 30x faster performance than GPUs, though independent analysis finds the chip inside is an overclocked WSE-3, not a new design.
AMD is buying Toronto-based Taalas, whose chips etch model weights directly into silicon instead of storing them in memory, to strengthen its AI inference lineup.
AI inference platform Baseten closed a $1.5 billion Series F at a $13 billion valuation, lifting total funding past $2 billion and underscoring how aggressively venture capital is chasing the infrastructure that serves AI models.
Intel's data-center inference GPU scales to 480GB of LPDDR5X in a 350W air-cooled PCIe card, sidestepping the HBM shortage that constrains Nvidia and AMD accelerators.
Google Cloud Run Worker Pools hit general availability on April 14, 2026, shipping with Blackwell GPU support and CREMA, an open-source KEDA-based autoscaler for queue-driven workloads.
The two companies held a formal kick-off event in Milpitas, California, advancing HBF as a new memory tier that promises 8-16x higher capacity than HBM at comparable cost, with first samples expected in the second half of 2026 and inference devices arriving in early 2027.
South Korean fabless chip designer Rebellions has closed a $400 million pre-IPO round led by Mirae Asset and the Korea National Growth Fund, bringing total funding to $850 million as the company launches rack-scale inference platforms and prepares for a public listing.