Souvik Ghosh

Join us 𝐧𝐞𝐱𝐭 𝐓𝐡𝐮𝐫𝐬𝐝𝐚𝐲, 𝐌𝐚𝐲 23 𝐚𝐭 12-1 𝐩𝐦 𝐄𝐓 to dive deep into the world of ⚡𝐋𝐋𝐌 𝐀𝐥𝐢𝐠𝐧𝐦𝐞𝐧𝐭⚡ with Andrew Jardine, Head of GTM at Adaptive ML, and Julien Launay, Co-founder and CEO at Adaptive ML! 🤖 🔁 👦 📚  Agenda: - Understanding the importance of preference alignment for LLMs - Exploring the differences between RL and other techniques - Practical guidance on how to implement these techniques yourself Register for this and our future Transferred Learning sessions here 👉https://lnkd.in/g3c6aJkd 📝 #genAI #LLMalignment #RHLF #AdaptiveML #AI #ML

30

1 Comment

“Open-source models are getting really close to the best-closed models. Meanwhile, the best-closed models haven’t gotten that much better,” said Databricks's co-founder and CTO, Matei Zaharia. The company is already big on its open-source route, announcing a suite of DBRX models in various sizes and adding tools to facilitate AI adoption. It wants to lead the enterprise AI space, helping them build and scale cost-effective, fast, and secure domain-specific AI applications after its strategic acquisition of Databricks Mosaic Research, Arcion Labs (Acquired by Databricks) and Tabular (now part of Databricks) recently. I had the incredible opportunity to speak with the CTO against the backdrop of Databricks' exciting new announcements at the Data + AI Summit aimed at empowering enterprises and easing their adoption of AI. Zaharia underscored the significance of fine-tuning foundation models on organisations’ own data with Mosaic AI Model Training. He cited the example of FactSet, a financial data vendor that initially built an application using GPT-4, which was, at best, 55% accurate and took 10 seconds per user query. By switching to a multi-step AI system with Databricks, FactSet achieved 87% accuracy, reduced query time to three seconds, and lowered costs by approximately five times compared to GPT-4 calls. Mosaic AI Training is an optimised software stack that makes training LLMs cost-effective. Through system-level optimisations, tuned parallelism strategies, and model training science, it can reduce training costs by up to 10x. Being one of the pioneers of Spark, AI, and Databricks, Matei has a keen vision to help enterprises build high-quality AI for their use cases. Apart from all the new offerings, such as Mosaic AI Model Training, Mosaic AI for RAG, and Mosaic AI Gateway, in addition to open-sourcing their Unity Catalog, Matei spoke highly of their open-source approach. While acknowledging the rapid advancements in closed-source models, Zaharia noted that the performance gap between closed-source and open-source models is rapidly narrowing. This is evidenced by recent open-source models like DBRX, Mistral 8×22 billion, and Llama 3 approaching the quality of the best closed-source models. Read the complete article at: PS: Matei Zaharia, Naveen Rao, Ali Ghodsi, Thanks to Jacintha Ng and Suhani Lalwani for enabling the conversation.

19

📖 Weekend Reading 📖 This week we had profiles on two highly influential figures in tech: Palantir Technologies CEO Alex Karp, and Anduril Industries founder Palmer Luckey. They are in some ways very different individuals, but in others they are radically aligned. 1️⃣ The first piece, on Karp, comes courtesy of Maureen Dowd in The New York Times. Karp appears to have an odd background to be leading a defense-oriented technology company. But what allows the German philosophy doctor to steer Palantir is an extremely principled and unapologetic geopolitical stance: “we have a consistently pro-Western view that the West has a superior way of living and organizing itself.” An interesting observation: “I think we’re in an age when nuclear deterrent is actually less effective because the West is very unlikely to use anything like a nuclear bomb, whereas our adversaries might…Where you have technological parity but moral disparity, the actual disparity is much greater than people think.” Interestingly, while Karp is vocal in his criticisms of some of the Democrats’ policies, he is firmly in the Biden / Harris camp (as a voter and donor) and often butts heads against Palantir’s chairman Peter Thiel when it comes to politics. https://lnkd.in/dMz7BWiV 2️⃣ Next up, Jeremy Stern (Tablet Magazine) profiles Palmer Luckey, another eccentric, highly principled, endlessly fascinating individual. Luckey, who created the Oculus Rift at 19 in a camper trailer, favors anime and collecting decommissioned nuclear missile bases over Karp’s tai chi. But like Karp, he is steadfast in his belief that the West must continue to out-innovate its geopolitical foes (Iran, Russia, China). He also has similar views on rebuilding deterrence, an idea that is core to the company’s mission: “Anduril was founded on the idea the US government had to be reformed so that it could buy deterrence again—and that the only way to deter wars is to be so clearly capable of winning them that no rival power tries to harm core US interests through the use of force.” Anduril is also backed by Peter Thiel, and here, while pursuing what appears like the same objective, Luckey finds himself on the opposite end of the political spectrum as Karp, having famously supported Donald Trump since his first real electoral bid in 2016. I'd recommend this article even just to get a more holistic view of what happened during that time, when Luckey was ousted from Facebook. https://lnkd.in/dpRpnGRF #palantir #ai #llm #defensetech #americandynamism #ukraine #anduril #peterthiel #vr #oculus #fintech #payments #upi

8

2 Comments