We gratefully acknowledge support from
the Simons Foundation and member institutions.

Stephen Casper, Rachel Freedman, David Lindner... are qualified to endorse.

Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback

Stephen Casper: Is registered as an author of this paper.
Can endorse for cs.AI, cs.CL, cs.CR, cs.CV, cs.CY, cs.LG, cs.NE. (why?)
Rachel Freedman: Is registered as an author of this paper.
Can endorse for cs.AI, cs.CL, cs.CY, cs.GT, cs.HC, cs.LG. (why?)
David Lindner: Is registered as an author of this paper.
Can endorse for cs.LG. (why?)
Samuel Marks: Is registered as an author of this paper.
Can endorse for cs.AI, cs.LG. (why?)
Micah Carroll: Is registered as an author of this paper.
Can endorse for cs.AI, cs.CL, cs.CY, cs.HC, cs.IR, cs.LG, cs.MA. (why?)
Usman Anwar Mr.: Is registered as an author of this paper.
Can endorse for cs.LG. (why?)
Dmitrii Krasheninnikov: Is registered as an author of this paper.
Can endorse for cs.LG. (why?)
Erdem Bıyık: Is registered as an author of this paper.
Can endorse for cs.AI, cs.CL, cs.GT, cs.HC, cs.IR, cs.IT, cs.LG, cs.MA, cs.RO, cs.SI, cs.SY, eess.SY, math.IT, stat.ML. (why?)
Dylan Hadfield-Menell: Is registered as an author of this paper.
Can endorse for cs.AI, cs.CL, cs.CR, cs.CY, cs.LG. (why?)

Xander Davies, Claudia Shi, Thomas Krendl Gilbert, Jérémy Scheurer, Javier Rando, Tomasz Korbak, Pedro Freire, Tony Wang, Charbel-Raphaël Segerie, Andi Peng, Phillip Christoffersen, Mehul Damani, Stewart Slocum, Anand Siththaranjan, Max Nadeau, Eric J. Michaud, Jacob Pfau, Xin Chen, Lauro Langosco, Peter Hase, Anca Dragan, David Krueger and Dorsa Sadigh are not registered as owners of this paper. (why?)