Chanel G.

Someone asked me how secure this approach really is, running an LLM in a laptop. I asked a very knowledgeable colleague (thanks Howard O'Toole !) and thought this might be interesting for anyone else with the same question: Topline from a security perspective, three key areas: 1. LLM security - it's fine as the model is running on your laptop. 2. Data privacy - all normal rules apply about Personally Identifiable Information (some data needs to stay where it is, shouldn't be transferred onto your laptop). There is less concern about confidential business data than using an LLM in a browser, as in this case the LLM is on your laptop, so nothing is transferred to the cloud. 3. LLM 'existential legal issues' - if there are successful cases prosecuting LLMs like OpenAI (eg from media companies) then theoretically the plaintiffs could come after big corporations making extensive use of those LLMs. This is unlikely to affect individual users doing things on their laptops, especially in smaller companies. But technically the whole topic of LLMs is still in a legal grey area, so something to be aware of. Here's some further detail about the solution that’s suggested by the OP (LM Studio), in comparison with another popular approach (Ollama). This gives you a view into how it works. https://lnkd.in/e5pusEcw #llm #opensource #genAI #security #privacy

3

🚀 Digital modernization is the key to future viability! 🚀 Now is the time to check proven backend applications for future viability and unleash their potential. Talk to Herbert JAKOB and find out how legacy applications can be made fit for the digital future. 📅 When? Sept. 5th, 2024 ❓ Where? Dresden, Germany 📌 Register here: https://lnkd.in/eYHVcMZ4

1

He's damn right!!! But the old-established companies living in the past can carry on doing everything as before - it's always been done that way, hasn't it? So it must be the perfect way 😄 #modernslavery Translated post: Forcing employees to be in the office on time every morning is completely outdated. The rigid nine-to-five model is simply outdated. Instead, employees should be as flexible as possible and work from wherever they want - if possible. This is the only way to achieve good results, innovative ideas and creative solutions. The only thing that counts? Clearly: further training and good technical equipment. 💻📱 Therefore, a good laptop, a powerful smartphone, a stable internet connection, and a cloud system are a must. And with noise-canceling headphones, you can stay focused even in noisy environments. The fact is: if the conditions are right, it works from anywhere. And this not only makes work more efficient but also much, much more enjoyable. What do you think? Are rigid office hours and attendance really still in keeping with the times, or should employees be able to organize their work flexibly?

6

This is a brilliant presentation about the impact and progress of AI. https://lnkd.in/e64BvZtH My conclusion is... the only reliable way I can benefit from AI is by buying a global index fund.

1

1 comentario