Nima Badiey

🚀 Exciting news! #Cohesity adopts NVIDIA NIM to supercharge retrieval augmented generation apps for enterprises. 🚀 This collaboration enhances #AI capabilities: 1️⃣ Faster deployment of generative AI models 2️⃣ Streamlined development with prebuilt microservices 3️⃣ Accelerated AI innovation for your enterprise

1

As recent as today I, along with my colleague Dr. Reena Gollapudy-Vajjhala were engaged in strategic client discussion on providing a strong business case in leveraging unified data knowledge perhaps with #datamesh #datafabric concepts in order to extract more value and faster time to market within the drug discovery chain. We discussed the LLM landscape injecting HCLTech #aiforce #aifoundry and I was able to outline some of the challenges that we need to address outside of cost/value statements. I introduced opensource concepts, RAG, Vector Databases as well as NVIDIA AI and their new NVLM. Possible ways to leverage llama.cpp with Ollama built in. We need to move from PoC approach to #genai and into a structured and transparent approach to #genai adoption. #iamai

26

Get a deeper look into the results submitted by NVIDIA in #MLPerf Inference v4.1, highlighted by the first ever submission using the NVIDIA Blackwell architecture, increased performance using the NVIDIA H200 Tensor Core GPU, and more.

1

Explore the latest NVIDIA NIM performance boosts using new TensorRT-LLM optimizations⚡️that take advantage of Hopper Transformer Engine and FP8 precision. ➡️ https://lnkd.in/gw8UHCq3 With NVIDIA Cloud Functions shifting to a multi-region control plane to reduce network delays, users across the globe can experience outstanding inference performance.

9

Happy to share a set of announcements relating to Gemini and VertexAI. -- Model Updates: * New versions of Gemini 1.5 Pro and Flash with improved math, long context understanding, and vision. * Gemini 1.5 Flash is nearly 2.5x faster than GPT-4o mini. * Gemini 1.5 Pro's 2M context window is now generally available. -- Pricing: * Gemini 1.5 Pro pricing reduced by 50%. -- Imagen 3: * Generally available for Vertex AI customers on the allowlist. * Improved prompt understanding, instruction-following, photorealistic quality, and control over text within images. -- Open AI Ecosystem: * Support for new models from Meta, Mistral AI, and AI21 Labs. -- Vertex AI Platform Enhancements: * Controlled Generation for fine-grained control over AI outputs. * Batch API for faster developer workflows. * Supervised fine tuning for Gemini 1.5 Flash and Pro. * Distillation techniques for smaller, specialized models. * Prompt Optimizer for automatic prompt optimization. * Prompt Management SDK for versioning, restoring, and generating prompt suggestions. * Grounding with Google Search and dynamic retrieval. * Multimodal function calling. * Gen AI Evaluation Service for defining custom evaluation criteria. * Expanded data residency commitments.

236

4 Comments

Easily implement Llama3, SDXL, and other models on Qualcomm Cloud AI 100 using Qualcomm-TensorOpera APIs with dedicated endpoints. Get started here: https://lnkd.in/g2SRDpqs #machinelearning #ai #generativeai

49

OpenAI and Broadcom in talks about developing new AI chip OpenAI is in talks with Broadcom and other industry leaders to develop a new chip tailored for AI applications, potentially reducing reliance on NVIDIA #GPUs. Sam Altman has been instrumental in spearheading efforts to secure partnerships with #chipmakers, tech giants like Microsoft, and government bodies to enhance #compute capacity essential for #AI #innovation. This move underscores OpenAI's commitment to advancing artificial general intelligence (#AGI), aiming to push the boundaries of AI capabilities beyond current standards. Despite the formidable challenges and substantial financial requirements, including Microsoft's substantial investment, OpenAI remains focused on expanding access to AI benefits through strategic partnerships. For more information: https://lnkd.in/dYHej2Kc #AI #ArtificialIntelligence #OpenAI #TechInnovation #Semiconductors #Broadcom #Microsoft #AGI #AIHardware #TechPartnerships

4

1 Comment

Want to learn how to build and deploy a compound AI application that can run on-prem and in the cloud? See how NVIDIA NIM is powering Haystack and deepset Cloud to enable you to build and scale AI applications. Join the webinar on September 4. Register now > https://lnkd.in/eTyx7GTW deepset

12

#AI Is Tech’s ‘Greatest Contribution to Social Elevation,’ NVIDIA #CEO Tells Oregon State University Students Amid a flurry of investments in higher education, NVIDIA #founder Jensen Huang highlights potential for #AI to serve as a “collaborator” as alma mater breaks ground on $213 million research complex. From the article, in part: “I believe that #artificialintelligence is the technology industry’s single greatest contribution to social elevation, to lift all of the people that have historically been left behind,” Huang told more than 2,000 faculty, students and staff gathered for his conversation with Murthy. The talk was the highlight of a forum marking the groundbreaking for a new research building that will be named for Huang and his wife, Lori, both Oregon State alumni. Huang’s appearance in Corvallis, Oregon, capped off a week of announcements underscoring NVIDIA’s commitment to preparing the future workforce with advanced #AI, #datascience and high performance computing training. On Tuesday, NVIDIA announced that it would participate in a $110 million partnership between Japan and the United States, which would include funding for university research. University of Washington and the University of Tsukuba. On Wednesday, Georgia Institute of Technology announced a new NVIDIA-powered #supercomputer that will help prepare undergraduate students to solve complex challenges with #AI and #HPC. And later this month, NVIDIA founder Chris Malachowsky will be inducted into the Hall of Fame for the University of Florida’s Department of Electrical & Computer Engineering, following the November inauguration of the university’s $150 million Malachowsky Hall for Data Science & Information Technology. “We’re at the beginning of a new industrial revolution, and the reason why I say that is because an industrial revolution produces something new that was impossible to produce in the past,” Huang said. “And in this new world, you can apply electricity, and what’s going to come out of it is a whole bunch of floating-point numbers. We call them tokens, and those tokens are essentially artificial intelligence,” Huang said. “And so this industrial revolution is going to be manufacturing intelligence at a very large scale,” Huang said. Jayathi Murthy | Brian Wall | Scott Ashford | Edward Feser | Tom Dietterich | Lanell (Blatner) Nolf | Shawn L. Scoville | Pat Egan

68

1 Comment

This is a must see - 5mins of clear articulation of how and why Google Cloud differentiates in #GenAI with an unique approach and strategy relative to competitive #hyperscalers https://lnkd.in/gywMw7Dp

419

8 Comments

🌟 Rise of the AI Integrators: Roadmap to Business Impact with Generative AI 🌟 In this blog we discuss how can #SystemsIntegrators partner with Google Cloud as they help their customers realize higher levels of business value with GenAI Beyond the rather commoditized tasks for summarization, content generation etc., 🔹 Generative U/X: Revolutionizing user experiences with AI-driven creativity. 🔹 Hyper-Personalization: Tailoring experiences to individual preferences using AI. 🔹 AI Amalgamation of Data: Integrating diverse data sources for powerful insights. 🔹 Agentic AI Business Process Automation: Streamlining operations with intelligent automation. 🔹 Next Best Actions: Generating strategic recommendations for impactful decisions. 🚀 Key Takeaway: Google provides solution completeness for all AI integrators at ask stages of their AI and Data journey 🚀 in depth discussion of differentiating capabilities that are essential to AI Integrators for leveraging generative AI to drive business success for themselves and their clients #AI #GenerativeAI #BusinessImpact #Automation #Innovation Cc: Kevin Ichhpurani Victor Morales

52

3 Comments

Big ideas are currently circulating around the complementary capabilities of high-performance supercomputers (fast), advanced AI models (powerful) and the first generation of reliable quantum computers (revolutionary). This discussion next week promises to be a pivotal moment in the public understanding of what’s coming next

18

And with lowest power - uses only 16 RDU chips to achieve this performance!

58

1 Comment

Philipp Kampshoff from McKinsey & Company is hosting Interesting discussion on supply chain for automotive industry at GSA US executive forum Maher S Matta from Infineon Technologies : "just on time" in automotive does not sync well with semiconductor, that is the hard lesson we learned from pandemic. Karn Budhiraj from Tesla : the problem was not with major semi supplier But those black boxes from tier1, tier 2 that had less direct information when supply shortage hit. Mohit Singh from QuantumScape : battery components are mainly from China, but lithuim is not the issues, refining process is. China is efficient in enabling manufacture supply chain One big thing coming from Tesla : RoboTaxi!!

52

1 Comment

Blackwell 26,596 times more powerful than our 8 Intel MOSIPS? At Computex 2024, Jensen Huang unveiled the roadmap for Blackwell, promising a future of accelerated computing architectures that redefine our expectations. These advancements are set to elevate AI capabilities to unprecedented levels. Our A7Technology MOSIPS system, powered by 8 Intel NUC computers, delivers 752 GFLOPS, with each system offering 94 GFLOPS. This impressive setup, however, pales in comparison to the capabilities of the new Blackwell B200 GPU. The B200 not only doubles the transistor count of the current H100 but also delivers an astounding 20 petaflops of AI performance from a single GPU, compared to the H100's 4 petaflops. The B200's 192GB of HBM3e memory and 8 TB/s bandwidth are equally impressive, showcasing how scaling is driving AI capabilities to new heights. This leap in performance is a significant phase shift, surpassing the limits of Moore's law and pushing the boundaries of what we thought possible with CPU architectures. To put this in perspective, a single Blackwell B200 GPU's 20 petaflops make it approximately 26,596 times more powerful than our current system's 752 GFLOPS, which uses eight of the latest Intel CPUs. These breakthroughs in parallel architectures are not just incremental improvements; they represent a monumental leap in AI capability and power, setting the stage for the next era of technological advancement.

1