PyTorch’s Post

View organization page for PyTorch, graphic

271,050 followers

3mo

Introducing torchchat 🔥 A lightweight library to run LLMs locally across mobile, desktop and laptops powered by PyTorch. Learn more: https://hubs.la/Q02JpLWQ0 #llms #mobilellms #localai #pytorchllm #edge #ondeviceai

34 Comments

Ludwig Stumpp

AI Engineer @appliedAI | Building the largest EU AI ecosystem Heilbronn @IPAI | Creator of the mlstarterkit.com | Previously @AUDI and @TUM

3mo

Awesome. I think it is quite important to note that, if I understood it correctly, that torchcat is not a competitor to LLM Inference engines such as HF TGI, vllm, Nvidia Triton, ... where one (single) deployment serves many users, but rather plays in the field of e.g. Ollama where each user deploys there own model locally for their own usage.

5 Reactions

Ayush Tiwari

Ex-@Microsoft | ML & Blockchain Developer | Google Summer of Code @AOSSIE | IIT Mandi

3mo

Much needed! Maybe will be able to see Diffusion models too for mobile devices , something like MobileDiffusion of google.

1 Reaction

Sushil K S.

3mo

This is a much needed one!! thanks,

3 Reactions

IA_AUT_ECO

3mo

Hello, don't you think that it is high time to do a redesign to simplify this mess that is Pytorch? Take inspiration from TensorFlow on this point!

1 Reaction

BotGPT

3mo

Much needed! Exciting development with the launch of **torchchat**! 🔥 This lightweight library makes it easier than ever to run LLMs locally on mobile devices, desktops, and laptops using PyTorch. This opens up new possibilities for on-device AI, ensuring privacy and faster processing. Curious about how local AI can transform your projects? Start exploring torchchat today and unlock the full potential of LLMs on your own devices! Ready to take your AI to the next level? Create your custom ChatGPT tailored to your data in just minutes! 📈 👉 https://bot.wordgptpro.com #LLMs #MobileLLMs #LocalAI #PyTorchLLM #EdgeComputing #OnDeviceAI #AI #MachineLearning #Innovation

1 Reaction

Faycal Raghibi

Looking for a PFA Internship | Machine Learning Enthusiast | Computer Science Student at AIAC | Passionate About AI & Intelligent Systems

3mo

This is exciting! Torchchat looks like a game-changer for running LLMs locally. Can't wait to see the performance improvements and the flexibility it brings to mobile and desktop applications. Great work, PyTorch team

2 Reactions

Sonam Pankaj

3mo

Pytorch is in the game 🔥

2 Reactions

Byamasu Patrick Paul

Founder | AI and ML Engineer

3mo

Look forward to trying this for Llama 3.1 8B Parameters model

2 Reactions

Senad Beadini

3mo

Awesome 😍

2 Reactions

Gerhard H.

Head of DevOps @ [at] Alexander Thamm GmbH

3mo

At first glance I read torchat. Which was a messenger service that used the Tor onion network 🤣

See more comments

To view or add a comment, sign in

More Relevant Posts

Yann LeCun Yann LeCun is an Influencer
3mo
Report this post
Awesome tool to run PyTorch LLMs natively on devices without requiring Python.
PyTorch

271,050 followers
3mo

Introducing torchchat 🔥 A lightweight library to run LLMs locally across mobile, desktop and laptops powered by PyTorch. Learn more: https://hubs.la/Q02JpLWQ0 #llms #mobilellms #localai #pytorchllm #edge #ondeviceai
22 Comments
Like Comment
To view or add a comment, sign in
Subhayan Roy

Associate @ Anantara Solutions Pvt Ltd | Analytics, Data Science, AI
3mo
Report this post
For Edge devices my goto Framework was Tensorflow Lite up until now. Although I use Pytorch and especially Pytorch Lightning for most of my codes for the wider applications. I think with torchchat now, I can maintain that uniformity in all my applications especially to Edge AI applications. Have to try this out, this weekend. #Pytorch #torchchat #EdgeML #EdgeDevices #LlMs #GenAI
PyTorch

271,050 followers
3mo

Introducing torchchat 🔥 A lightweight library to run LLMs locally across mobile, desktop and laptops powered by PyTorch. Learn more: https://hubs.la/Q02JpLWQ0 #llms #mobilellms #localai #pytorchllm #edge #ondeviceai
Like Comment
To view or add a comment, sign in
Gonzalo GARCIA 🟦

Data Scientist @Minsait | Insurance | Banking | Retail | @EDHEC
3mo
Report this post
every other week we will see improvements regarding hardware requirements of this current one-task-at-a-time highly-inefficient technology. other next steps will be expanding the performance frontier at each task, though the real challenge is what approach (an autogenerated plan of tasks, chaining as many specific models to tackle all steps......) will be pragmatic and efficient enough so that we can input an intention so that the algorithm is able to fulfil whatever is that you had in mind (obviously, you do not want to integrate with every existing software, this ought to be part of the algorithm inherent knowledge/ability)
PyTorch

271,050 followers
3mo

Introducing torchchat 🔥 A lightweight library to run LLMs locally across mobile, desktop and laptops powered by PyTorch. Learn more: https://hubs.la/Q02JpLWQ0 #llms #mobilellms #localai #pytorchllm #edge #ondeviceai
Like Comment
To view or add a comment, sign in
Karine Boucher

Delivering Human-Centered, Data-Driven Solutions & Strategy through Expertise in AI Governance, Data Science & Machine Learning | Product Management | Marketing | Cybersecurity | Business Development | AI For Good
3mo
Report this post
Much needed news ! PyTorch just launched its for local large language model (LLM) inference tool : #TorchChat that helps to run LLMs locally on mobile devices, desktops, and laptops using PyTorch. Apart from opening up new possibilities for on-device AI, ensuring privacy and faster processing, it also is : • Ease of Use: TorchChat is designed to be user-friendly, making LLM implementation straightforward. • Flexibility: Ideal for developers looking to leverage LLMs without the need for cloud services. • Practical Applications: Learn how TorchChat can be integrated into your projects to enhance performance and efficiency. #TorchChat #PyTorch #LLM #LocalInference #MachineLearning #AI #ArtificialIntelligence #DataScience #CloudComputing #TechInnovation
PyTorch

271,050 followers
3mo

Introducing torchchat 🔥 A lightweight library to run LLMs locally across mobile, desktop and laptops powered by PyTorch. Learn more: https://hubs.la/Q02JpLWQ0 #llms #mobilellms #localai #pytorchllm #edge #ondeviceai
Like Comment
To view or add a comment, sign in
VIRTUAL OFFICE SOLUTIONS: Leading IT & Cybersecurity Provider with a Personal Touch since 2009!

1,055 followers
1mo
Report this post
Work efficiently and enjoy doing it. How is this possible? Introducing Windows AI Copilot+ PCs powered by #Snapdragon X Series processors. A 54% faster CPU and AI-powered apps like Recall and Paint Cocreator will change the way you work. View the infographic to learn more. 👇

Change the Way You Work

vos365.lll-ll.com
Like Comment
To view or add a comment, sign in
AnandTech

4,224 followers
4mo
Report this post
CUDIMM Standard Set to Make Desktop Memory a Bit Smarter and a Lot More Robust https://trib.al/jRmkW1r

CUDIMM Standard Set to Make Desktop Memory a Bit Smarter and a Lot More Robust

anandtech.com
Like Comment
To view or add a comment, sign in
Abrahams Consulting LLC

260 followers
1mo
Report this post
Work efficiently and enjoy doing it. How is this possible? Introducing Windows AI Copilot+ PCs powered by #Snapdragon X Series processors. A 54% faster CPU and AI-powered apps like Recall and Paint Cocreator will change the way you work. View the infographic to learn more. 👇

Change the Way You Work

abrahams73.lll-ll.com
Like Comment
To view or add a comment, sign in
CDW

277,936 followers
1mo
Report this post
From 3D rendering to optimizing #AI workloads and driving sophisticated #DataAnalytics tasks, the HP Z6 G5 A Workstation Desktop PC can do it all. 🖥️ How would you unleash its potential for your organization? https://cdw.social/47UoOBj #GenAI #DigitalWorkspace

Take Your Productivity to a New Level with HP Workstations and CDW

1 Comment
Like Comment
To view or add a comment, sign in
Angela Gibson, ITIL
1mo
Report this post
Work efficiently and enjoy doing it. How is this possible? Introducing Windows AI Copilot+ PCs powered by #Snapdragon X Series processors. A 54% faster CPU and AI-powered apps like Recall and Paint Cocreator will change the way you work. View the infographic to learn more. 👇

Change the Way You Work

abrahamsconsulting.lll-ll.com
Like Comment
To view or add a comment, sign in

271,050 followers

View Profile Follow

PyTorch’s Post

More Relevant Posts

Take Your Productivity to a New Level with HP Workstations and CDW

Explore topics