Heterogeneous Computing for AI and Big Data – Alibaba Cloud Computing Conference

简介: Alibaba Cloud heterogeneous platform for elastic computing aims to provide high-quality services for organizations to realize scientific and technological innovations.

The heterogeneous computing technology is evolving rapidly in the field of big data and AI in recent years. To cope with this technology revolution, Alibaba Cloud Heterogeneous Computing has made great achievements in both product type and application.

Pan Yue, a senior product expert of Alibaba Cloud, made an in-depth presentation on Alibaba Cloud Heterogeneous Computing in the era of big data and AI at the Computing Conference Shenzhen summit on the morning of March 29, 2018.

Pan Yue introduced that Alibaba Cloud provides a wide range of "heterogeneous acceleration platforms for multiple scenarios", including GA1 instance (AMD S7150) for graphic and image rendering, GN5 (Tesla P100) instance for AI training and reasoning, GN5i (Tesla P4) instance for AI reasoning and video transcoding applications, and GN6 (Tesla V100) instance for advanced computational capabilities in the fields of AI and high-performance computing, and multiple FPGA instances for image transcoding, genetic computing, and database acceleration.
fpga1
GN6 instance is specifically designed for deep learning training and high-performance computing. With Tesla V100 in the latest NVIDIA Volta architecture, GN6 instance delivers 12X higher computing performance than Tesla P100 (the previous generation), solving the outstanding problems for engineers and experts. GN6 (Tesla V100) is now available for public beta and will be coming soon.

Alibaba Cloud has been and will be always professional and precise towards issues related to heterogeneous products. Most people may choose Pascal-Based Tesla P40 as the GPU because of its higher single-precision floating-point capability, which is 12 teraFLOPS (TFLOPS) while only 10.6 TFLOPS for Tesla P100, according to the product manuals. However, Alibaba Cloud performed tests in different scenarios and methods and found that the performance of Tesla P100 is 20% higher in AI application. Here are the test results:
fpga2
In the main forum at the Computing Conference Shenzhen, Alibaba Cloud and NVIDIA reached an agreement to enhance their cooperation in the GPU ecosystem, including the setup and promotion of NVIDIA Deep Learning Institute (DLI) at Alibaba Cloud University and NGC container images, a new feature released for AI.

NGC is a deep learning ecosystem developed by NVIDIA, which allows developers to access the deep learning software stack for free and to establish a development environment suitable for deep learning. The developers can get various NGC software from the Alibaba Cloud marketplace, including Caffe, Caffe2, CNTK, MXNet, TensorFlow, Theano, and Torch.

FPGA is getting the recognition of the public and applied in the general computing field from the special computing field. Alibaba Cloud FPGA as a Service is an FPGA heterogeneous computing service that supports the mainstream FPGA platforms. It is designed as a systematic platform with uniform interfaces for computing capability output under the premise of ensuring cloud security.

It provides an integrated cloud development environment for more FPGA engineers to develop products on the cloud. Alibaba Cloud is still making use of the strengths of Alibaba and her partners to establish and improve an FPGA ecosystem with a view to serve more customers with better FPGA computing capabilities.

Currently, Alibaba Cloud FPGA as a Service can be found in image transcoding and compression, database acceleration, genetic computing, and other fields.

Alibaba Cloud heterogeneous platform for elastic computing aims to provide high-quality products and services, help organizations to realize scientific and technological innovation, and make computing and AI a true inclusive technology in a secure and stable environment.

目录
相关文章
|
29天前
|
人工智能 Java 机器人
基于Spring AI Alibaba + Spring Boot + Ollama搭建本地AI对话机器人API
Spring AI Alibaba集成Ollama,基于Java构建本地大模型应用,支持流式对话、knife4j接口可视化,实现高隐私、免API密钥的离线AI服务。
612 1
基于Spring AI Alibaba + Spring Boot + Ollama搭建本地AI对话机器人API
|
6月前
|
人工智能 Java API
MCP协议重大升级,Spring AI Alibaba联合Higress发布业界首个Streamable HTTP实现方案
本文由Spring AI Alibaba Contributor刘军、张宇撰写,探讨MCP官方引入的全新Streamable HTTP传输层对原有HTTP+SSE机制的重大改进。文章解析Streamable HTTP的设计思想与技术细节,并介绍Spring AI Alibaba开源框架提供的Java实现,包含无状态服务器模式、流式进度反馈模式等多种场景的应用示例。同时,文章还展示了Spring AI Alibaba + Higress的完整可运行示例,分析当前实现限制及未来优化方向,为开发者提供参考。
|
2月前
|
人工智能 Java 开发者
邀您参与 “直通乌镇” Spring AI Alibaba 开源竞技挑战赛!
邀您参与 “直通乌镇” Spring AI Alibaba 开源竞技挑战赛!
|
6月前
|
存储 人工智能 自然语言处理
RAG 调优指南:Spring AI Alibaba 模块化 RAG 原理与使用
通过遵循以上最佳实践,可以构建一个高效、可靠的 RAG 系统,为用户提供准确和专业的回答。这些实践涵盖了从文档处理到系统配置的各个方面,能够帮助开发者构建更好的 RAG 应用。
2916 114

热门文章

最新文章