Intel Delivers ‘Real-Time AI’ in Microsoft’s New Accelerated Deep Learning Platform

Aug 26, 2017 - Artificial intelligence (AI) and deep learning (DL) promise to transform how people engage with the world and how businesses operate in order to make smarter decisions, and Intel® technology is enabling this transformation. Today, Intel is highlighting how its AI technology is being leveraged by one of the world’s largest cloud service providers to run complex deep learning models, which enable applications ranging from facial recognition and voice recognition on smartphones to autonomous driving.

MORE:  Intel FPGAs Accelerate AI with Microsoft Project Brainwave (Dan McNamara Blog) |  Artificial Intelligence (Press Kit)

Microsoft has selected Intel® Stratix® 10 FPGAs as a key hardware accelerator in its new accelerated deep learning platform – code-named Project Brainwave. This FPGA-based accelerated deep learning platform is capable of delivering “real-time AI,” which will allow cloud infrastructure to process and transmit data as fast as it comes in, with ultralow latency. In the cloud, delivering real-time AI is becoming more important as systems are required to process live data streams, including video, sensors or search queries, and rapidly deliver the data back to users.

Through a  blog issued today, Microsoft detailed how Project Brainwave, leveraging Intel FPGAs, is capable of handling extremely challenging deep learning models at “unprecedented” levels of performance and flexibility. Microsoft demonstrated its FPGA-based deep learning platform at Hot Chips 2017, a symposium that showcases the latest advancements in semiconductor technology.

 Stratix 10 FPGAs and SoC FPGAs leverage Intel’s 14nm process

Microsoft was the first major cloud service provider to deploy FPGAs in its public cloud infrastructure and the technology advancements it is demonstrating today with Intel Stratix 10 FPGAs enable the acceleration of deep neural networks (DNNs) that replicate “thinking” in a manner that is conceptually similar to that of the human brain.

AI is a rapidly evolving field that requires multiple technologies to efficiently manage various workload requirements. Intel offers a broad set of technologies to enable the market’s evolution, including Intel Xeon® processors, Intel FPGAs and Intel Nervana™ ASIC technology. Compared to dedicated deep learning hardware accelerators that are optimized to run a single workload, the flexibility of Intel FPGAs enable users to customize the hardware to meet specific workload requirements, and reconfigure the hardware rapidly as deep learning workloads and use models change. Intel Stratix 10 FPGAs combine hardened processor blocks that deliver high levels of sustained performance and efficiency, with a programmable fabric for user customization.

Many silicon AI accelerators today require grouping multiple requests together (called “batching”) to achieve high performance.  Project Brainwave, leveraging the Intel Stratix 10 technology, demonstrated over 39 Teraflops of achieved performance on a single request, setting a new standard in the cloud for real-time AI computation. Stratix 10 FPGAs sets a new level of cloud performance for real-time AI computation, with record low latency, record performance and batch-free execution of AI requests.

“We exploit the flexibility of Intel FPGAs to incorporate new innovations rapidly, while offering performance comparable to, or greater than, many ASIC-based deep learning processing units,” said Doug Burger, distinguished engineer at Microsoft Research NExT.

Microsoft is currently working to deploy Project Brainwave in the Azure cloud so that customers eventually can run complex deep learning models at record-setting performance.

Machine learning platforms powered by Intel technology help transform data into actionable business intelligence through accelerated model training, fast scoring and highly scalable infrastructure. In conjunction with the latest  Intel Xeon Scalable processors, Intel FPGAs are customizable and programmable to deliver low latency and flexible precision, with higher performance per watt for deep learning inference compared with Intel Xeon processors alone.

To learn more about Intel’s comprehensive portfolio of AI solutions, visit

Review Article Be the first to review this article

Bentley: Jump start your Infrastructure Career

Featured Video
Latest Blog Posts
Alex Carrick, Chief Economist at ConstructConnectThe AEC Lens
by Alex Carrick, Chief Economist at ConstructConnect
Latest PPI Results Show Construction Material Cost Increases Still Alarming
Senior Highway Engineer for RS&H at Jacksonville, Florida
Engineer III - Hydraulics for State of Nebraska at Lincoln, California
Regional Sales Manager (Eastern North America) for Teledyne Optech at Kiln, Mississippi
Director, Industrial Machinery Solutions- SISW PLM for Siemens AG at Livonia, Michigan
GPS and Mobile GIS Sales Development for Duncan-Parnell Inc. at Charlotte, North Carolina
GIS Manager for City of Vancouver at Vancouver, Washington
Upcoming Events
World Architecture Festival at United States - Jun 23 - 25, 2021
ProjectWise User Conference 2021 (Virtual) at 685 Stockton Drive Floor 2 Exton PA - Jul 13 - 16, 2021
ICSD 2021 : 9th International Conference on Sustainable Development, 8 - 9 September Rome, Italy at Roma Eventi, Pontifical Gregorian University Piazza della Pilotta, 4 Rome Rome Italy - Sep 8 - 9, 2021
Urban Planning & Architectural Design for Sustainable Development – 6th Edition at University of Florence Florence Italy - Sep 14 - 16, 2021
Kenesto: 30 day trial
Make A Difference
UAV Expo2021 -Register   & save - Countless CAD add-ons, plug-ins and more.

© 2021 Internet Business Systems, Inc.
670 Aberdeen Way, Milpitas, CA 95035
+1 (408) 882-6554 — Contact Us, or visit our other sites:
TechJobsCafe - Technical Jobs and Resumes EDACafe - Electronic Design Automation GISCafe - Geographical Information Services  MCADCafe - Mechanical Design and Engineering ShareCG - Share Computer Graphic (CG) Animation, 3D Art and 3D Models
  Privacy PolicyAdvertise