Hardware

46 Posts

Bar chart comparing electricity use by various text-generation models: very small, small, medium-sized, large MoE, and large reasoning.
Hardware

AI Uses Energy, AI Saves Energy: The International Energy Agency examines the energy costs and potential savings of the AI boom

AI’s thirst for energy is growing, but the technology also could help produce huge energy savings over the next five to 10 years, according to a recent report.
DeepSeek computation diagram showing transformer blocks, multi-head attention, and routing, using FP8 and BF16 precision.
Hardware

How DeepSeek Did It: Researchers describe training methods and hardware choices for DeepSeek’s V3 and R1 models

DeepSeek made headlines late last year, when it built a state-of-the-art, open-weights large language model at a cost far lower than usual. The upstart developer shared new details about its method.
Diagram of FP4 training scheme showing BF16 tensor quantization and FP4 tensor core processing for efficient computation.
Hardware

4-Bit Efficiency, 16-Bit Accuracy: Microsoft researchers show that heavily quantized versions of Llama can perform as well as near-full-precision

Using an 8-bit number format like FP8 during training saves computation compared to 16- or 32-bit formats, but it can yield less-accurate results. Researchers trained models using 4-bit numbers without sacrificing accuracy.
U.S. and Saudi flags waving against a microchip background
Hardware

U.S. to Supply Middle Eastern AI Hubs: Nvidia, AMD, Amazon, and others strike deals with Saudi Arabia’s Humain and G42 in the UAE

The United States government announced sweeping agreements to sell tens of billions of dollars worth of AI technology and services to Saudi Arabia and the United Arab Emirates.
Person interacting with a humanoid robot using virtual reality headset and controllers.
Hardware

Hugging Face Rolls Out Open Robot: Hugging Face acquires Pollen Robotics, launches Reachy 2 robot for open-source research

Hugging Face has made a name by providing open AI models. Now it’s providing an open robot.
Bar chart of 2024 vs. 2025 capital expenditures for Amazon, Microsoft, Alphabet, and Meta, showing projected increases.
Hardware

Big AI Spending Continues to Rise: Tech giants increase cloud spending to meet growing infrastructure demands

Top AI companies announced plans to dramatically ramp up their spending on AI infrastructure.
Workflow for inverse design using deep learning to predict S-parameters and radiation in structures.
Hardware

Generated Chip Designs Work in Mysterious Ways: Researchers used deep learning and an evolutionary algorithm to design chips in minutes

Designing integrated circuits typically requires years of human expertise. Recent work set AI to the task with surprising results.
GIF of two humanoid robots walking, one on grass and the other on a paved surface.
Hardware

Humanoid Robot Price Break: Unitree and EngineAI showcase affordable humanoid robots

Chinese robot makers Unitree and EngineAI showed off relatively low-priced humanoid robots that could bring advanced robotics closer to everyday applications.
GB10 Superchip architecture with Blackwell GPU and Grace CPU.
Hardware

AI Supercomputer on Your Desk: Nvidia introduced Project Digits, a $3,000 home supercomputer for AI models

Nvidia’s new desktop computer is built specifically to run large AI models.
A hand holding a snow globe with skaters and a snowman.
Hardware

Smaller Is Beautiful: Compact AI models redefine efficiency, bringing advanced capabilities to everyday devices

For years, the best AI models got bigger and bigger. But in 2024, some popular large language models were small enough to run on a smartphone.
Pile of discarded green circuit boards from electronic devices.
Hardware

Garbage Out: Generative AI and GPU boom spawns growing e-waste problem

Rapid progress in generative AI comes with a hidden environmental cost: mountains of obsolete hardware.
Grounding DINO animation depicting object detection with bounding boxes on images.
Hardware

Object Detection for Small Devices: Grounding DINO 1.5, an edge device model built for faster, smarter object detection

An open source model is designed to perform sophisticated object detection on edge devices like phones, cars, medical equipment, and smart doorbells.
Robotic arms collaborating to fold a red garment on a table.
Hardware

Household Help: π0, a machine learning system for household robotics

A new generation of robots can handle some household chores with unusual skill.
Close-up of a Chinese-made server chip labeled with the logo and text ‘710’ mounted on a motherboard.
Hardware

Further Chip Restrictions on China: TSMC stops advanced chip production for China on U.S. orders

The largest manufacturer of AI chips told its Chinese customers it would stop fabricating their most advanced designs, further limiting China’s access to AI hardware.
Comparison of Minecraft terrain with and without player modifications.
Hardware

No Game Engine Required: AI creates an interactive Minecraft-like world in real time

A real-time video generator lets you explore an open-ended, interactive virtual world — a video game without a game engine.
Load More

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox