Top related persons:
Top related locs:
Top related orgs:

Search resuls for: "Superalignment"


5 mentions found


OpenAI wants to lure Google researchers with $10 million pay packets, The Information reported. OpenAI is in talks for another employee share sale this year that could value it at $86 billion. OpenAI is exploring options for an employee share sale that values the company at $86 billion , Bloomberg reported last month. If its recruiters are successful in enticing top Google AI researchers, they could benefit from compensation packages of between $5 million and $10 million after the latest share sale, according to The Information. Five former Google researchers were listed in the acknowledgments section of OpenAI's blog post announcing the launch of ChatGPT last November.
Persons: OpenAI, , ChatGPT, OpenAI's, Jan Leike, Leiki, OpenAI didn't Organizations: Google, Service, Bloomberg, Meta
But he told MIT Technology Review that he wasn't sure whether he would choose to become "part AI." Elon Musk has said Neuralink will help people merge with AI — but it is unclear if it's possible. AdvertisementAdvertisementOpenAI's chief scientist has said that people may choose to become "part AI" in the future to compete with superintelligent machines. AdvertisementAdvertisementSutskever is currently working on OpenAI's "superalignment" project , which aims to build fail-safes that will prevent superintelligent AI from going rogue. Despite this, Sutskever told MIT Tech Review that he was unsure whether he would ever choose to merge with AI, should it become possible.
Persons: Ilya Sutskever, Elon Musk, , he's, , Sutskever, OpenAI Organizations: MIT Technology, Service, MIT Tech Review Locations:
He is looking for research engineers, scientists, and managers. Working closely with research engineers, research scientists are responsible for advancing OpenAI's alignment research agenda. The research manager position oversees the research engineers and research scientists. An ideal candidate for the leadership role, Leike said, would have a combination of management experience and machine learning skills. OpenAI isn't just hiring for its superalignment team.
Persons: Jan Leike, , we'll, Leike, OpenAI's, OpenAI Organizations: OpenAI, Research Locations: OpenAI
OpenAI fears that superintelligent AI could lead to human extinction. It is putting together a team to ensure that superintelligent AI aligns with human interests. The new team — called Superalignment — plans to develop AI with human-level intelligence that can supervise superintelligent AI within the next four years. OpenAI CEO Sam Altman has long been calling for regulators to address AI risk as a global priority. To be sure, not everyone shares OpenAI's concerns about future problems posed by superintelligent AI.
Persons: OpenAI, Ilya Sutskever, Jan Leike, Sam Altman, Altman, Elon Musk Organizations: superintelligent, Research
"Currently, we don't have a solution for steering or controlling a potentially superintelligent AI, and preventing it from going rogue." Superintelligent AI - systems more intelligent than humans - could arrive this decade, the blog post's authors predicted. The team's goal is to create a "human-level" AI alignment researcher, and then scale it through vast amounts of compute power. OpenAI says that means they will train AI systems using human feedback, train AI systems to assistant human evaluation, and then finally train AI systems to actually do the alignment research. AI safety advocate Connor Leahy said the plan was fundamentally flawed because the initial human-level AI could run amok and wreak havoc before it could be compelled to solve AI safety problems.
Persons: OpenAI, Ilya Sutskever, Jan Leike, Connor Leahy, Anna Tong, Kenneth Li, Rosalba O'Brien Organizations: Microsoft, Reuters, Thomson Locations: San Francisco
Total: 5