[ad_1]
With generative AI and large language models (LLMs) driving groundbreaking improvements, the computational calls for for coaching and inference are skyrocketing.
These modern-day generative AI purposes demand full-stack accelerated compute, beginning with state-of-the-art infrastructure that may deal with huge workloads with pace and accuracy. To assist meet this want, Oracle Cloud Infrastructure at present introduced common availability of NVIDIA H100 Tensor Core GPUs on OCI Compute, with NVIDIA L40S GPUs coming quickly.
NVIDIA H100 Tensor Core GPU Occasion on OCI
The OCI Compute bare-metal cases with NVIDIA H100 GPUs, powered by the NVIDIA Hopper architecture, allow an order-of-magnitude leap for large-scale AI and high-performance computing, with unprecedented efficiency, scalability and flexibility for each workload.
Organizations utilizing NVIDIA H100 GPUs get hold of as much as a 30x increase in AI inference performance and a 4x boost in AI training in contrast with tapping the NVIDIA A100 Tensor Core GPU. The H100 GPU is designed for resource-intensive computing duties, together with coaching LLMs and inference whereas operating them.
The BM.GPU.H100.8 OCI Compute form consists of eight NVIDIA H100 GPUs, every with 80GB of HBM2 GPU reminiscence. Between the eight GPUs, 3.2TB/s of bisectional bandwidth allows every GPU to speak straight with all seven different GPUs by way of NVIDIA NVSwitch and NVLink 4.0 technology. The form consists of 16 native NVMe drives with a capability of three.84TB every and in addition consists of 4th Gen Intel Xeon CPU processors with 112 cores, in addition to 2TB of system reminiscence.
In a nutshell, this form is optimized for organizations’ most difficult workloads.
Relying on timelines and sizes of workloads, OCI Supercluster permits organizations to scale their NVIDIA H100 GPU utilization from a single node to as much as tens of hundreds of H100 GPUs over a high-performance, ultra-low-latency community.
NVIDIA L40S GPU Occasion on OCI
The NVIDIA L40S GPU, primarily based on the NVIDIA Ada Lovelace architecture, is a common GPU for the info middle, delivering breakthrough multi-workload acceleration for LLM inference and coaching, visible computing and video purposes. The OCI Compute bare-metal cases with NVIDIA L40S GPUs shall be out there for early entry later this yr, with common availability coming early in 2024.
These cases will provide an alternative choice to the NVIDIA H100 and A100 GPU cases for tackling smaller- to medium-sized AI workloads, in addition to for graphics and video compute duties. The NVIDIA L40S GPU achieves as much as a 20% performance boost for generative AI workloads and as a lot as a 70% improvement in fine-tuning AI models in contrast with the NVIDIA A100.
The BM.GPU.L40S.4 OCI Compute form consists of 4 NVIDIA L40S GPUs, together with the latest-generation Intel Xeon CPU with as much as 112 cores, 1TB of system reminiscence, 15.36TB of low-latency NVMe native storage for caching information and 400GB/s of cluster community bandwidth. This occasion was created to sort out a variety of use circumstances, starting from LLM coaching, fine-tuning and inference to NVIDIA Omniverse workloads and industrial digitalization, 3D graphics and rendering, video transcoding and FP32 HPC.
NVIDIA and OCI: Enterprise AI
This collaboration between OCI and NVIDIA will allow organizations of all sizes to affix the generative AI revolution by offering them with state-of-the-art NVIDIA H100 and L40S GPU-accelerated infrastructure.
Entry to NVIDIA GPU-accelerated cases will not be sufficient, nevertheless. Unlocking the utmost potential of NVIDIA GPUs on OCI Compute means having an optimum software program layer. NVIDIA AI Enterprise streamlines the event and deployment of enterprise-grade accelerated AI software program with open-source containers and frameworks optimized for the underlying NVIDIA GPU infrastructure, all with the assistance of support services.
To be taught extra, be a part of NVIDIA at Oracle Cloud World within the AI Pavillion, attend this session on the brand new OCI cases on Wednesday, Sept. 20, and go to these net pages on Oracle Cloud Infrastructure, OCI Compute, how Oracle approaches AI and the NVIDIA AI Platform.
[ad_2]
Source link
