This week is the OCP Global Summit – and we are there to discuss latest advancements in LLM inference acceleration! Current demonstrations reveal >2X performance improvement over standard vLLM as well as: 1. 80-90% higher efficiency 2. 50% TCO improvements 3. 50% on DC cooling costs 4. CO2 emissions in ½ If you’re at OCP this week, let us know if you’d like to set a time to meet. Drop us a note at [email protected]. #OCPGlobalSummit #OCPSummit2024 #LLMInference
Pliops
Semiconductor Manufacturing
Ramat Gan, Israel 4,707 followers
Pliops accelerates and amplifies the performance and scalability of global GenAI infrastructure.
About us
Pliops accelerates and amplifies the performance and scalability of global GenAI infrastructure, driving unparalleled efficiency and innovation. Pliops was founded in 2017 by storage industry veterans from Samsung, M-Systems, and XtremIO. Pliops is pioneering a new category of product that enables cloud and enterprise data centers to access data up to 50 times faster with one-tenth of the computational load and power consumption. Its technology consolidates multiple inefficient layers into one ultra-fast device based on a groundbreaking approach. Pliops’ solution addresses the scalability challenges posed by the cloud data explosion and the increasing data demands of AI and ML applications.
- Website
-
http://www.pliops.com
External link for Pliops
- Industry
- Semiconductor Manufacturing
- Company size
- 51-200 employees
- Headquarters
- Ramat Gan, Israel
- Type
- Privately Held
- Founded
- 2017
- Specialties
- Storage, databases, database architect, storage architect, infrastructure, acceleration, flash storage, SSD, GenAI, LLM Inferencing, Vector databases, and RAG
Locations
-
Primary
Abba Hillel 12
Ramat Gan, Israel 5250606, IL
-
2550 N 1st St
Suite 400
San Jose, California 95131, US
Employees at Pliops
Updates
-
Our CEO Ido Bukspan recently caught up with renowned storage reporter Chris Mellor to take a deep dive into our new XDP LightningAI solution. The article covers the technology behind LightningAI, target use cases, performance gains, and more. Check out the in-depth article here: https://bit.ly/47U3jR6 #AI #AIInference #InferenceAcceleration #LLMs #TechInnovation
-
We are excited to announce Pliops’ latest advancements in LLM inference acceleration. Our current demonstrations reveal an impressive >2X performance improvement over standard vLLM, and this is just the beginning. Stay tuned for more details on our solution in the coming weeks and join us for the public demo at SC24. For more information about the demo, please contact us at [email protected]. #TechInnovation #AI #MachineLearning #LLM #InferenceAcceleration #PerformanceBoost #TechNews #SC24 #DemoDay #FutureOfTech
-
At the recent AI Hardware & Edge AI Summit, it was eye-opening to hear about the challenges companies face around power in data centers. Our own Tony Afshary shared how Pliops is uniquely positioned to address these issues head-on. Watch Tony’s key takeaways from the event in this quick video: https://bit.ly/3TAUBRK #AI #EdgeAI #DataCenter #TechInnovation
-
Looking for game changing efficiency for LLM inference? Look no further than our XDP LightningAI! A Key-Value distributed smart storage node for GPU Compute Domain, XDP LightningAI makes inference for LLMs 80-90% more efficient, delivers over 50% TCO improvements, reduces CO2 emissions by 50%, and saves 50% on DC cooling costs. Check out our new solution brief for more: https://bit.ly/3zmW0Va #LLMInference #KeyValue #GenAI #SmartStorage
-
We’re still buzzing from the excitement of FMS! In addition to many insightful meetings and engaging conversations with partners, customers, and prospects, the Pliops team delivered several informative presentations that revolved around GenAI, vector databases and RAG. Here's to innovation and the incredible connections we've made! #FMS2024 #FutureofMemoryandStorage #GenAI #VectorDatabases #RAG
-
Pliops is pleased to announce that our XDP LightningAI has received a “Best of Show” Award from FMS in the LLM Inference Acceleration Category! Additionally, the newest iteration of our Extreme Data Processor, the XDP PRO, is our first ASIC-based chip. For more details, check out our announcement: https://bit.ly/3LVftyD #FMS2024 #FutureofMemoryandStorage #BestofShow #LLMInference #GenAI
-
Exciting Update from Our CEO, Ido Bukspan — Ido has just shared an inspiring message about the current state of affairs at Pliops and the amazing progress we’ve made, especially with our new GenAI solution. A major highlight of the FMS show, the new XDP LightningAI—a Key-Value distributed smart storage node for the GPU Compute Domain—will be previewed at this week’s conference. If you’ll be at FMS this week, swing by and say hello to Ido and all of us at Pliops and take a look at the future with LightningAI! Read more about what Ido has to share here: https://bit.ly/3ypwVIE #FMS2024 #FutureofMemoryandStorage #LLMInference #GenAI #KeyValue
-
Join us next week at FMS to see how we’re empowering organizations to navigate challenges around storing, processing and making sense of vast amounts of data for Gen AI Applications. Hint: it has to do with a preview look at our upcoming product, XDP LightningAI, which enhances AI LLM inference efficiency by 80-90%! Contact us at [email protected] to schedule a time or just stop by our booth 1045. See you there! #FMS2024 #FutureofMemoryandStorage #LLMInference