Heterogeneous Computing for AI and Big Data – Alibaba Cloud Computing Conference

简介: Alibaba Cloud heterogeneous platform for elastic computing aims to provide high-quality services for organizations to realize scientific and technological innovations.

The heterogeneous computing technology is evolving rapidly in the field of big data and AI in recent years. To cope with this technology revolution, Alibaba Cloud Heterogeneous Computing has made great achievements in both product type and application.

Pan Yue, a senior product expert of Alibaba Cloud, made an in-depth presentation on Alibaba Cloud Heterogeneous Computing in the era of big data and AI at the Computing Conference Shenzhen summit on the morning of March 29, 2018.

Pan Yue introduced that Alibaba Cloud provides a wide range of "heterogeneous acceleration platforms for multiple scenarios", including GA1 instance (AMD S7150) for graphic and image rendering, GN5 (Tesla P100) instance for AI training and reasoning, GN5i (Tesla P4) instance for AI reasoning and video transcoding applications, and GN6 (Tesla V100) instance for advanced computational capabilities in the fields of AI and high-performance computing, and multiple FPGA instances for image transcoding, genetic computing, and database acceleration.
fpga1
GN6 instance is specifically designed for deep learning training and high-performance computing. With Tesla V100 in the latest NVIDIA Volta architecture, GN6 instance delivers 12X higher computing performance than Tesla P100 (the previous generation), solving the outstanding problems for engineers and experts. GN6 (Tesla V100) is now available for public beta and will be coming soon.

Alibaba Cloud has been and will be always professional and precise towards issues related to heterogeneous products. Most people may choose Pascal-Based Tesla P40 as the GPU because of its higher single-precision floating-point capability, which is 12 teraFLOPS (TFLOPS) while only 10.6 TFLOPS for Tesla P100, according to the product manuals. However, Alibaba Cloud performed tests in different scenarios and methods and found that the performance of Tesla P100 is 20% higher in AI application. Here are the test results:
fpga2
In the main forum at the Computing Conference Shenzhen, Alibaba Cloud and NVIDIA reached an agreement to enhance their cooperation in the GPU ecosystem, including the setup and promotion of NVIDIA Deep Learning Institute (DLI) at Alibaba Cloud University and NGC container images, a new feature released for AI.

NGC is a deep learning ecosystem developed by NVIDIA, which allows developers to access the deep learning software stack for free and to establish a development environment suitable for deep learning. The developers can get various NGC software from the Alibaba Cloud marketplace, including Caffe, Caffe2, CNTK, MXNet, TensorFlow, Theano, and Torch.

FPGA is getting the recognition of the public and applied in the general computing field from the special computing field. Alibaba Cloud FPGA as a Service is an FPGA heterogeneous computing service that supports the mainstream FPGA platforms. It is designed as a systematic platform with uniform interfaces for computing capability output under the premise of ensuring cloud security.

It provides an integrated cloud development environment for more FPGA engineers to develop products on the cloud. Alibaba Cloud is still making use of the strengths of Alibaba and her partners to establish and improve an FPGA ecosystem with a view to serve more customers with better FPGA computing capabilities.

Currently, Alibaba Cloud FPGA as a Service can be found in image transcoding and compression, database acceleration, genetic computing, and other fields.

Alibaba Cloud heterogeneous platform for elastic computing aims to provide high-quality products and services, help organizations to realize scientific and technological innovation, and make computing and AI a true inclusive technology in a secure and stable environment.

目录
相关文章
|
3天前
|
人工智能 前端开发 Java
Spring AI Alibaba + 通义千问,开发AI应用如此简单!!!
本文介绍了如何使用Spring AI Alibaba开发一个简单的AI对话应用。通过引入`spring-ai-alibaba-starter`依赖和配置API密钥,结合Spring Boot项目,只需几行代码即可实现与AI模型的交互。具体步骤包括创建Spring Boot项目、编写Controller处理对话请求以及前端页面展示对话内容。此外,文章还介绍了如何通过添加对话记忆功能,使AI能够理解上下文并进行连贯对话。最后,总结了Spring AI为Java开发者带来的便利,简化了AI应用的开发流程。
116 0
|
1月前
|
人工智能 前端开发 Java
基于开源框架Spring AI Alibaba快速构建Java应用
本文旨在帮助开发者快速掌握并应用 Spring AI Alibaba,提升基于 Java 的大模型应用开发效率和安全性。
218 12
基于开源框架Spring AI Alibaba快速构建Java应用
|
1月前
|
存储 人工智能 Java
Spring AI Alibaba 配置管理,用 Nacos 就够了
本文通过一些实操案例展示了 Spring AI Alibaba + Nacos 在解决 AI 应用中一系列复杂配置管理挑战的方案,从动态 Prompt 模板的灵活调整、模型参数的即时优化,到敏感信息的安全加密存储。Spring AI Alibaba 简化了对接阿里云通义大模型的流程,内置 Nacos 集成也为开发者提供了无缝衔接云端配置托管的捷径,整体上极大提升了 AI 应用开发的灵活性和响应速度。
229 13
|
2月前
|
人工智能 Java API
阿里云开源 AI 应用开发框架:Spring AI Alibaba
近期,阿里云重磅发布了首款面向 Java 开发者的开源 AI 应用开发框架:Spring AI Alibaba(项目 Github 仓库地址:alibaba/spring-ai-alibaba),Spring AI Alibaba 项目基于 Spring AI 构建,是阿里云通义系列模型及服务在 Java AI 应用开发领域的最佳实践,提供高层次的 AI API 抽象与云原生基础设施集成方案,帮助开发者快速构建 AI 应用。本文将详细介绍 Spring AI Alibaba 的核心特性,并通过「智能机票助手」的示例直观的展示 Spring AI Alibaba 开发 AI 应用的便利性。示例源
1406 12
|
2月前
|
人工智能 开发框架 Java
总计 30 万奖金,Spring AI Alibaba 应用框架挑战赛开赛
Spring AI Alibaba 应用框架挑战赛邀请广大开发者参与开源项目的共建,助力项目快速发展,掌握 AI 应用开发模式。大赛分为《支持 Spring AI Alibaba 应用可视化调试与追踪本地工具》和《基于 Flow 的 AI 编排机制设计与实现》两个赛道,总计 30 万奖金。
|
3月前
|
人工智能 开发框架 Java
重磅发布!AI 驱动的 Java 开发框架:Spring AI Alibaba
随着生成式 AI 的快速发展,基于 AI 开发框架构建 AI 应用的诉求迅速增长,涌现出了包括 LangChain、LlamaIndex 等开发框架,但大部分框架只提供了 Python 语言的实现。但这些开发框架对于国内习惯了 Spring 开发范式的 Java 开发者而言,并非十分友好和丝滑。因此,我们基于 Spring AI 发布并快速演进 Spring AI Alibaba,通过提供一种方便的 API 抽象,帮助 Java 开发者简化 AI 应用的开发。同时,提供了完整的开源配套,包括可观测、网关、消息队列、配置中心等。
2994 11
|
2月前
|
人工智能 Java API
阿里云开源 AI 应用开发框架:Spring AI Alibaba
阿里云开源 Spring AI Alibaba,旨在帮助 Java 开发者快速构建 AI 应用,共同构建物理新世界。
|
3月前
|
人工智能 前端开发 Java
Spring Cloud Alibaba AI,阿里AI这不得玩一下
🏀闪亮主角: 大家好,我是JavaDog程序狗。今天分享Spring Cloud Alibaba AI,基于Spring AI并提供阿里云通义大模型的Java AI应用。本狗用SpringBoot+uniapp+uview2对接Spring Cloud Alibaba AI,带你打造聊天小AI。 📘故事背景: 🎁获取源码: 关注公众号“JavaDog程序狗”,发送“alibaba-ai”即可获取源码。 🎯主要目标:
119 0
|
4月前
|
人工智能 前端开发 Java
【实操】Spring Cloud Alibaba AI,阿里AI这不得玩一下(含前后端源码)
本文介绍了如何使用 **Spring Cloud Alibaba AI** 构建基于 Spring Boot 和 uni-app 的聊天机器人应用。主要内容包括:Spring Cloud Alibaba AI 的概念与功能,使用前的准备工作(如 JDK 17+、Spring Boot 3.0+ 及通义 API-KEY),详细实操步骤(涵盖前后端开发工具、组件选择、功能分析及关键代码示例)。最终展示了如何成功实现具备基本聊天功能的 AI 应用,帮助读者快速搭建智能聊天系统并探索更多高级功能。
1603 2
【实操】Spring Cloud Alibaba AI,阿里AI这不得玩一下(含前后端源码)
|
6月前
|
人工智能 Java Spring
使用 Spring Cloud Alibaba AI 构建 RAG 应用
本文介绍了RAG(Retrieval Augmented Generation)技术,它结合了检索和生成模型以提供更准确的AI响应。示例中,数据集(包含啤酒信息)被加载到Redis矢量数据库,Spring Cloud Alibaba AI Starter用于构建一个Spring项目,演示如何在接收到用户查询时检索相关文档并生成回答。代码示例展示了数据加载到Redis以及RAG应用的工作流程,用户可以通过Web API接口进行交互。
52633 70

热门文章

最新文章