User talk:Jimbo Wales

wikipedia style platform to crowd source feedback for open source LLM

yann lecun suggests, not sure how to set a permanent link to this:

Human feedback for open source LLMs needs to be crowd-sourced, Wikipedia style.

It is the only way for LLMs to become the repository of all human knowledge and cultures.

Who wants to build the platform for this?

if it is wikipedia style, should wikipedia build it? host it? ThurnerRupert (talk) 05:16, 16 October 2023 (UTC)

I suspect LeCun might be responding to the surprising results this past week with Zephyr 7B, a free LLM (on Huggingface) which can work quickly on 2018-era mobile phones, and outperforms Meta's Llama-2 70B, an order of magnitude larger model, and does so solely by removing Llama's alignment conditioning (safety censorship) which has come as quite a shock to many, and is not great news for those who consider alignment-oriented fine tuning important. (I personally am skeptical because while heavily aligned models will refuse to discuss some sensitive topics, they are usually very willing to discuss subsurface details like how to use and acquire the specific equipment for weaponizing anthrax spores, for one particularly egregious and confusing example.)

As to your question, all of the commercial LLM chatbots crowdsource human feedback (the thumbs down/up buttons) but there are no open source LLMs which have integrated this technique yet as far as I know. There are some commercial companies offering it as a paid service and having open sourced the code behind it, but the administration overhead for reintegrating such feedback into the models is far more costly than the code. LeCun on the surface is suggesting the open source LLM community find a way to crowdsouce the reintegration overhead too, which I'm sure is doable, but might not attract volunteers. Sandizer (talk) 10:08, 16 October 2023 (UTC)

P.S., some interesting discussion in the replies to LeCun's tweet on the topic. Sandizer (talk) 00:50, 17 October 2023 (UTC)

Happy October, Jimbo! :)

Babysharkboss2 has given you a Hershey Bar! Hershey bars promote WikiLove through chocolately goodness and hopefully this one has made your day better. Hershey bars are wonderfully delicious! Spread the WikiLove by giving someone else a Hershey bar, whether it be someone you have had disagreements with in the past or a good friend.

Spread the goodness of Hershey bars by adding {{subst:Hershey Bar}} to someone's talk page with a friendly message!

Babysharkboss2 was here!! 15:51, 17 October 2023 (UTC)

Hell broke loose today

Elon musk is calling Wikipedia woke u replied Then they start talking about your connection with newsguard is this true I'm still kinda confused about the woke claim when most of us work to be neutral If you would like to clarify your position in newguard I would like to know Elon musk also is a asshat •Cyberwolf• 01:40, 20 October 2023 (UTC)

Useful reading: Punctuation. AndyTheGrump (talk) 02:06, 20 October 2023 (UTC)

huh. hell broke loose today? i thought it did that every day. ltbdl (talk) 02:24, 20 October 2023 (UTC)

NewsGuard? Not exactly hell. Johnuniq (talk) 02:56, 20 October 2023 (UTC)

Yeah, Elon going on a rant isn't really my definition of "hell". It's more my definition of any random day. I am an advisor to Newsguard, yes. I don't think that's in any way problematic. People who may think that I'm somehow in favor of censorship are... just making things up I'm afraid. What I am in favor of is products and services that are well designed to help people evaluate and access high quality information. At least some of the trolls who hate such things hate them because of reasons that should be obvious: Newsguard would tend to rate various crackpot propaganda sites rather less highly than trusted news organizations with standards of fact checking, running corrections, etc. Their nine critera strike me sa being fairly straightforward.--Jimbo Wales (talk) 06:05, 20 October 2023 (UTC)

Elon Musk has just posted: the following: "Have you ever wondered why the Wikimedia Foundation wants so much money?

It certainly isn’t needed to operate Wikipedia. You can literally fit a copy of the entire text on your phone!

So, what’s the money for? Inquiring minds want to know …" Count Iblis (talk) 09:07, 23 October 2023 (UTC)

The Signpost: 23 October 2023

• News and notes: Where have all the administrators gone?

• In the media: Thirst traps, the fastest loading sites on the web, and the original collaborative writing

• Gallery: Before and After: Why you don't need to know how to restore images to make massive improvements

• Featured content: Yo, ho! Blow the man down!

• Traffic report: The calm and the storm

• News from Diff: Sawtpedia: Giving a Voice to Wikipedia Using QR Codes

• Humour: New citation template introduced for divine revelations, drug use, and really thinking about it

* Read this Signpost in full * Single-page * Unsubscribe * MediaWiki message delivery (talk) 07:01, 23 October 2023 (UTC)