Amazon Web Services (AWS) and NVIDIA have announced a significant expansion of their strategic collaboration at AWS re:Invent. The collaboration aims to provide customers with state-of-the-art infrastructure, software, and services to fuel generative AI innovations.

The collaboration brings together the strengths of both companies, integrating NVIDIA’s latest multi-node systems with next-generation GPUs, CPUs, and AI software, along with AWS technologies such as Nitro System advanced virtualisation, Elastic Fabric Adapter (EFA) interconnect, and UltraCluster scalability.

Key highlights of the expanded collaboration include:

1. Introduction of NVIDIA GH200 Grace Hopper Superchips on AWS:
   • AWS becomes the first cloud provider to offer NVIDIA GH200 Grace Hopper Superchips with new multi-node NVLink technology.
   • The NVIDIA GH200 NVL32 multi-node platform enables joint customers to scale to thousands of GH200 Superchips, providing supercomputer-class performance.
2. Hosting NVIDIA DGX Cloud on AWS:
   • Collaboration to host NVIDIA DGX Cloud, an AI-training-as-a-service, on AWS, featuring GH200 NVL32 for accelerated training of generative AI and large language models.
3. Project Ceiba supercomputer:
   • Collaboration on Project Ceiba, aiming to design the world’s fastest GPU-powered AI supercomputer with 16,384 NVIDIA GH200 Superchips and processing capability of 65 exaflops.
4. Introduction of new Amazon EC2 instances:
   • AWS introduces three new Amazon EC2 instances, including P5e instances powered by NVIDIA H200 Tensor Core GPUs for large-scale generative AI and HPC workloads.
5. Software innovations:
   • NVIDIA introduces software on AWS, such as NeMo Retriever microservice for chatbots and summarisation tools, and BioNeMo to speed up drug discovery for pharmaceutical companies.

This collaboration signifies a joint commitment to advancing the field of generative AI, offering customers access to cutting-edge technologies and resources.

Internally, Amazon robotics and fulfilment teams already employ NVIDIA’s Omniverse platform to optimise warehouses in virtual environments first before real-world deployment.

The integration of NVIDIA and AWS technologies will accelerate the development, training, and inference of large language models and generative AI applications across various industries.

(Photo by ANIRUDH on Unsplash)

See also: Inflection-2 beats Google’s PaLM 2 across common benchmarks

Want to learn more about AI and big data from industry leaders? Check out AI & Big Data Expo taking place in Amsterdam, California, and London. The comprehensive event is co-located with Cyber Security & Cloud Expo and Digital Transformation Week.

Explore other upcoming enterprise technology events and webinars powered by TechForge here.

The post AWS and NVIDIA expand partnership to advance generative AI appeared first on AI News.

Amazon Web Services (AWS) and NVIDIA are expanding their strategic collaboration to deliver advanced infrastructure, software, and services for generative artificial intelligence (AI) innovations. AWS will be the first cloud provider to bring NVIDIA GH200 Grace Hopper Superchips to the cloud, which will be available on Amazon Elastic Compute Cloud (EC2) instances.

Inflection, an AI startup aiming to create “personal AI for everyone”, has announced a new large language model dubbed Inflection-2 that beats Google’s PaLM 2.

Inflection-2 was trained on over 5,000 NVIDIA GPUs to reach 1.025 quadrillion floating point operations (FLOPs), putting it in the same league as PaLM 2 Large. However, early benchmarks show Inflection-2 outperforming Google’s model on tests of reasoning ability, factual knowledge, and stylistic prowess.

On a range of common academic AI benchmarks, Inflection-2 achieved higher scores than PaLM 2 on most. This included outscoring the search giant’s flagship on the diverse Multi-task Middle-school Language Understanding (MMLU) tests, as well as TriviaQA, HellaSwag, and the Grade School Math (GSM8k) benchmarks:

The startup’s new model will soon power its personal assistant app Pi to enable more natural conversations and useful features.

Thrilled to announce that Inflection-2 is now the 2nd best LLM in the world! 💚✨🎉

It will be powering https://t.co/1RWFB5RHtF very soon. And available to select API partners in time. Tech report linked…

Come run with us!https://t.co/8DZwP1Qnqo

— Mustafa Suleyman (@mustafasuleyman) November 22, 2023

Inflection said its transition from NVIDIA A100 to H100 GPUs for inference – combined with optimisation work – will increase serving speed and reduce costs despite Inflection-2 being much larger than its predecessor.  

An Inflection spokesperson said this latest model brings them “a big milestone closer” towards fulfilling the mission of providing AI assistants for all. They added the team is “already looking forward” to training even larger models on their 22,000 GPU supercluster.

Safety is said to be a top priority for the researchers, with Inflection being one of the first signatories to the White House’s July 2023 voluntary AI commitments. The company said its safety team continues working to ensure models are rigorously evaluated and rely on best practices for alignment.

With impressive benchmarks and plans to scale further, Inflection’s latest effort poses a serious challenge to tech giants like Google and Microsoft who have so far dominated the field of large language models. The race is on to deliver the next generation of AI.

(Photo by Johann Walter Bantz on Unsplash)

See also: Anthropic upsizes Claude 2.1 to 200K tokens, nearly doubling GPT-4

Want to learn more about AI and big data from industry leaders? Check out AI & Big Data Expo taking place in Amsterdam, California, and London. The comprehensive event is co-located with Digital Transformation Week.

Explore other upcoming enterprise technology events and webinars powered by TechForge here.

The post Inflection-2 beats Google’s PaLM 2 across common benchmarks appeared first on AI News.

Insider Brief

• Classiq unveiled a new industry initiative, the Quantum Computing for Life Sciences & Healthcare Center.
• The collaboration includes NVIDIA and the Tel Aviv Sourasky Medical Center.
• Critical Quote: “The opportunities for quantum computing and especially the software that drives it are growing very quickly. The new Quantum Computing for Life Sciences & Healthcare Center aspires to bridge the gap between quantum theory and practice with tangible benefits in life sciences, healthcare and beyond.” — Classiq CEO Nir Minerbi

PRESS RELEASE — Quantum software pioneer Classiq unveiled a new industry initiative, the Quantum Computing for Life Sciences & Healthcare Center, formed in collaboration with NVIDIA and the Tel Aviv Sourasky Medical Center. The initiative will champion the development and implementation of quantum algorithms and applications, targeting their transformative potential on life sciences and healthcare.

Quantum computing, with the potential to process multifaceted data at unparalleled speeds, may play a pivotal role in reinventing domains like drug discovery, molecular analysis and bespoke medical treatment strategies. Beyond these domains, quantum computing may also be leveraged to address the challenges within supply chain and treatment coordination. By optimizing pharmaceutical supply chains, quantum may ensure the timely and efficient delivery of critical medications. For example, by aiding in treatment coordination, it could streamline patient care, ensuring optimized and personalized therapeutic journeys based on individual medical histories and real-time health data.

Classiq CEO Nir Minerbi said, “The opportunities for quantum computing and especially the software that drives it are growing very quickly. The new Quantum Computing for Life Sciences & Healthcare Center aspires to bridge the gap between quantum theory and practice with tangible benefits in life sciences, healthcare and beyond.”

In collaboration with NVIDIA, Classiq will establish a multifaceted research landscape. Leveraging NVIDIAH100 Tensor Core GPU capabilities, along with the integration between the NVIDIA CUDA Quantum programming platform and Classiq’s software infrastructure, the center is set to offer a robust environment for quantum-centric innovations and training non-quantum experts.

“Integrated quantum-classical computing holds great potential for powering breakthroughs in life sciences and healthcare, but many challenges to realizing that potential remain yet to be addressed,” said Tim Costa, Director of High-Performance Computing and Quantum at NVIDIA. “The Classiq Quantum Computing for Life Sciences & Healthcare Center, built on NVIDIA CUDA Quantum, aims to help researchers tackle these challenges and push the boundaries in applying quantum computing to problems in this critical area.”

Initiating the center’s collaborative approach is the renowned Tel Aviv Sourasky Medical Center (Ichilov Hospital). Celebrated for its progressive technological adoptions and pioneering AI integrations since 2014, this institution embodies the future-ready ethos of the healthcare sector.

Prof. Roni Gamzu of the Tel Aviv Sourasky Medical Center said, “Clinical and operational activities are typically managed at Ichilov Hospital through smart, data-driven computing systems. We are proud of our achievements but at the same time very much aware that currently available tools are not efficient enough to provide solutions to the steadily growing complexity of our systems. For this exact reason, we are delighted to announce the opening of the first quantum computing lab here at Ichilov. Together with Classiq and NVIDIA, we will break the boundaries of data science for the benefit of medicine and patients. I am convinced that this unique initiative will pave the way for a radically novel approach to data management in health organizations to the benefit of our patients and society at large.”

With the Quantum Computing for Life Sciences & Healthcare Center, Classiq and its collaborators are poised to tap into quantum capabilities to propel life sciences and healthcare into a future with potential for greater precision, efficiency and innovation.

Insider Brief

• SandboxAQ announced a collaboration with NVIDIA to predict chemical reactions for drug discovery, battery design, green energy, among other use cases.
• SandboxAQ will leverage NVIDIA quantum platforms to directly simulate the quantum mechanics.
• Critical Quote: “Simulation is one of the most promising future technological applications, and it’s already leaving its mark today. Thanks to rapid advances in GPU hardware and quantum information science, we’re finally able to harness AI for more specialized applications that will have a profound impact on our world.” — Eric Schmidt, Chairman of SandboxAQ

PRESS RELEASE — SandboxAQ announced a collaboration with NVIDIA to predict chemical reactions for drug discovery, battery design, green energy, and more. SandboxAQ will leverage NVIDIA quantum platforms to directly simulate the quantum mechanics underpinning modern chemistry, biology and material science using tensor networks.

“Simulation is one of the most promising future technological applications, and it’s already leaving its mark today. Thanks to rapid advances in GPU hardware and quantum information science, we’re finally able to harness AI for more specialized applications that will have a profound impact on our world,” said Eric Schmidt, Chairman of SandboxAQ. “SandboxAQ’s AI simulation capabilities, augmented with NVIDIA accelerated computing and quantum platforms, will help enable the creation of new materials and chemical compounds that will transform industries and address some of the world’s biggest challenges.”

“Simulation will drive a new wave of GPU use, powering previously unattainable insights about our physical world that go beyond what extractive or generative AI are capable of unlocking. Combining Simulation with advanced AI yields solutions to problems in some of the biggest addressable markets in the world, far beyond what generative AI is capable of doing alone,” said Jack D. Hidary, CEO of SandboxAQ. “This collaboration will have a significant impact on a broad range of industries such as healthcare, energy, construction, financial services and more.”

“Advances in quantum chemistry and molecular modeling require powerful accelerated computing platforms to predict complex chemical interactions that can present countless benefits to society,” said Tim Costa, director of high performance computing and quantum at NVIDIA. “NVIDIA’s collaboration with SandboxAQ will help equip scientists to make the next generation of breakthroughs in material science.”

As part of the collaboration, SandboxAQ will be providing technical recommendations on relevant NVIDIA offerings including cuTENSOR, cuTensorNet, Quantum Computing and CUDA libraries. Tensor networks are a scalable way of representing high-dimensional data and are drawing growing interest across numerous domains: machine learning and data science, financial modeling, fluid dynamics, quantum chemistry and more. SandboxAQ will use highly GPU-optimized tensor network methods run on up to 32 NVIDIA H100 Tensor Core GPUs to solve challenging problems in science and industries. SandboxAQ also plans to leverage NVIDIA cuTENSOR and NVIDIA cuQuantum software.

This work on tensor networks will complement and supercharge SandboxAQ’s existing efforts to leverage AI and Simulation towards impact in pharmaceutical development, materials science, and beyond. Specific applications of SandboxAQ AI and Simulation include protein-ligand binding computations for large-scale undruggable targets in neurodegenerative disease, novel solutions for pose and toxicity prediction, and new AI methods to predict lifecycles for next-generation batteries composed of novel materials.

Nov. 20, 2024 — NVIDIA today announced that Dell Technologies, Hewlett Packard Enterprise and Lenovo will be the first to integrate NVIDIA Spectrum-X Ethernet networking technologies for AI into their server lineups to help enterprise customers speed up generative AI workloads. Purpose-built for generative AI, Spectrum-X offers enterprises a new class of Ethernet networking that can achieve 1.6x […]

The post NVIDIA Announces Ethernet Platform for AI from Dell, HPE, Lenovo appeared first on High-Performance Computing News Analysis | insideHPC.

In this edition of the HPC News Bytes podcast, Shahin takes us on a rapid (5:04) tour of SC23, analyzing the key developments and new technologies that highlighted last week’s conference in Denver: Conference attendance expands to 14,000; exascale update and future; raft of new chips, many focused on AI; Quantum Village at SC23; UCIe, PCIe and Ultra Ethernet

The post HPC News Bytes 20231120: SC23 Overview – Exascale Update, New AI Chips, Quantum Village, UCIe-PCIe-Ultra Ethernet appeared first on High-Performance Computing News Analysis | insideHPC.

💾

Quantum software company Classiq, in collaboration with NVIDIA and the Tel Aviv Sourasky Medical Center, has launched the Quantum Computing for Life Sciences & Healthcare Center. The initiative aims to develop quantum algorithms and applications to revolutionise life sciences and healthcare, including drug discovery, molecular analysis, and personalised medical treatments. The centre will also address challenges in supply chain and treatment coordination. Classiq CEO Nir Minerbi believes the software driving quantum computing is growing rapidly. The centre will utilise NVIDIAH100 Tensor Core GPU capabilities and NVIDIA CUDA Quantum programming platform. The Tel Aviv Sourasky Medical Center will initiate the centre's collaborative approach.

Amdocs has partnered with NVIDIA and Microsoft Azure to build custom Large Language Models (LLMs) for the $1.7 trillion global telecoms industry.

Leveraging the power of NVIDIA’s AI foundry service on Microsoft Azure, Amdocs aims to meet the escalating demand for data processing and analysis in the telecoms sector.

The telecoms industry processes hundreds of petabytes of data daily. With the anticipation of global data transactions surpassing 180 zettabytes by 2025, telcos are turning to generative AI to enhance efficiency and productivity.

NVIDIA’s AI foundry service – comprising the NVIDIA AI Foundation Models, NeMo framework, and DGX Cloud AI supercomputing – provides an end-to-end solution for creating and optimising custom generative AI models.

Amdocs will utilise the AI foundry service to develop enterprise-grade LLMs tailored for the telco and media industries, facilitating the deployment of generative AI use cases across various business domains.

This collaboration builds on the existing Amdocs-Microsoft partnership, ensuring the adoption of applications in secure, trusted environments, both on-premises and in the cloud.

Enterprises are increasingly focusing on developing custom models to perform industry-specific tasks. Amdocs serves over 350 of the world’s leading telecom and media companies across 90 countries. This partnership with NVIDIA opens avenues for exploring generative AI use cases, with initial applications focusing on customer care and network operations.

In customer care, the collaboration aims to accelerate the resolution of inquiries by leveraging information from across company data. In network operations, the companies are exploring solutions to address configuration, coverage, or performance issues in real-time.

This move by Amdocs positions the company at the forefront of ushering in a new era for the telecoms industry by harnessing the capabilities of custom generative AI models.

(Photo by Danist Soh on Unsplash)

See also: Wolfram Research: Injecting reliability into generative AI

Want to learn more about AI and big data from industry leaders? Check out AI & Big Data Expo taking place in Amsterdam, California, and London. The comprehensive event is co-located with Digital Transformation Week.

Explore other upcoming enterprise technology events and webinars powered by TechForge here.

The post Amdocs, NVIDIA and Microsoft Azure build custom LLMs for telcos appeared first on AI News.

TEL AVIV, November 13, 2023 — Quantum software pioneer Classiq today unveiled a new industry initiative, the Quantum Computing for Life Sciences & Healthcare Center, formed in collaboration with NVIDIA and the Tel Aviv Sourasky Medical Center. The initiative will champion the development and implementation of quantum algorithms and applications, targeting their transformative potential on life sciences and healthcare. Quantum […]

The post Classiq Announces Quantum Center for Life Sciences with NVIDIA appeared first on High-Performance Computing News Analysis | insideHPC.

NVIDIA has announced that its RAPIDS cuDF software can now accelerate the processing speed of the popular data analysis library, pandas, without requiring users to change their code. This update is aimed at helping data scientists who use pandas, which can struggle with processing speed as dataset sizes grow. RAPIDS is an open-source suite of GPU-accelerated Python libraries designed to improve data science and analytics pipelines. The latest release of RAPIDS v23.10 brings accelerated computing to pandas workflows through a unified CPU/GPU user experience. This feature is currently available in open beta and will be supported in NVIDIA AI Enterprise soon.

When HPC and AI converge remarkable things can result, and one of them is on display on the floor of the SC23 conference here in Denver at the Dell Technologies booth (#625). We encountered it ourselves, it’s an immersive VR....

The post At SC23: Immersive Virtual Reality on Display at Dell Technologies Booth 625, Come and Experience It appeared first on High-Performance Computing News Analysis | insideHPC.

NVIDIA and Microsoft Azure are collaborating to provide advanced AI infrastructure and software to companies. NVIDIA will display its AI solutions with Microsoft Azure at Microsoft Ignite in Seattle. NVIDIA DGX Cloud, available on Microsoft Azure, enables businesses to train models for generative AI. Microsoft Azure will host NVIDIA Omniverse Cloud, a service that aids businesses in digitalising their operations. NVIDIA GPU-accelerated virtual machines on Azure, powered by NVIDIA H100 Tensor Core GPUs and NVIDIA Quantum-2 InfiniBand networking, offer improved performance for AI workloads.

[SPONSORED GUEST ARTICLE BY HPE AND NVIDIA] With the transformation of medicine from analog to digital, plus the rise of new data-generating devices for health tracking and genomic information, we can look forward to a new world in which virtually every aspect of a patient's....

The post Life is Fleeting, But Data is Forever – Meet your Digital Twin appeared first on High-Performance Computing News Analysis | insideHPC.

MLCommons said the results highlight performance gains of up to 2.8X compared to 5 months ago and 49X over the first results five years ago, "reflecting the tremendous rate of innovation in systems for machine learning," the organizations said. 

The post MLPerf Training and HPC Benchmark Show 49X Performance Gains in 5 Years appeared first on High-Performance Computing News Analysis | insideHPC.

Few people can talk in such an engaging way about the chips driving the AI revolution as Karl Freund, founder and principal analyst at Cambrian-AI Research. He joins us to discuss the, well, "Cambrian explosion" we're witnessing in AI chips, the general state of the AI semiconductor....

The post @HPCpodcast: Industry Analyst Karl Freund Compares and Contrasts the Chips Driving the AI Revolution appeared first on High-Performance Computing News Analysis | insideHPC.

💾

Here’s a dash (5:24) through the latest in HPC-AI, including: new AI UK supercomputers, the White House Executive Order on AI and its national security implications, Pete Ungaro's appearance on the @HPCpodcast, interesting findings in Intersect360 Research's HPC-AI new market update.

The post HPC News Bytes 20231106: UK AI HPC Push, White House EO on AI, Ungaro Speaks, Market Update on HPC-AI appeared first on High-Performance Computing News Analysis | insideHPC.

💾

HPE will build an NVIDIA-powered £225 million supercomputer at the University of Bristol in the UK that is expected to deliver "well over" 200 petaFLOP/s using the Top500's LINPACK benchmark, and more than 21 ExaFLOP/s of AI performance, according to the university. The system, called Isambard-AI, will be built on HPE Cray EX supercomputer architecte and will consist of 5,448 NVIDIA....

The post HPE to Build NVIDIA-Powered 21 ExaFLOPS AI Supercomputer in UK appeared first on High-Performance Computing News Analysis | insideHPC.

In this sponsored article, Crispin Keable PhD., senior solution architect developing HPC, AI and quantum systems for Eviden (an Atos business), discusses how his philosophy is and always has been to help customers achieve their scientific, technical, and engineering goals by using the best technology now and tomorrow in the most effective and efficient way. Today, that means the design and deployment of Exascale systems. While Exascale systems are in some senses one-off’s, we can expect the technology and methods used to become widespread across the industry.

The post Taming the Exascale Beast: Challenges and Solutions in Architecting JUPITER appeared first on High-Performance Computing News Analysis | insideHPC.