Top related persons:
Top related locs:
Top related orgs:

Search resuls for: "Leike"


25 mentions found


Jan Leike, one of the lead safety researchers at OpenAI who resigned from the artificial intelligence company earlier this month, said on Tuesday that he's joined rival AI startup Anthropic. Leike announced his resignation from OpenAI on May 15, days before the company dissolved the superalignment group that he co-led. "I'm excited to join @AnthropicAI to continue the superalignment mission," Leike wrote on X. AI safety has gained rapid importance across the tech sector since OpenAI introduced ChatGPT in late 2022, ushering in a boom in generative AI products and investments. The committee will recommend "safety and security decisions for OpenAI projects and operations" to the company's board.
Persons: Jan Leike, he's, Leike, OpenAI, Ilya Sutskever, @AnthropicAI, Sam Altman, Dario Amodei, Daniela Amodei, Claude Organizations: OpenAI, Amazon, Microsoft, Google Locations: OpenAI
OpenAI announces new safety board after employee revolt
  + stars: | 2024-05-28 | by ( Brian Fung | ) edition.cnn.com   time to read: +2 min
Washington CNN —OpenAI said Tuesday it has established a new committee to make recommendations to the company’s board about safety and security, weeks after dissolving a team focused on AI safety. In a blog post, OpenAI said the new committee would be led by CEO Sam Altman as well as Bret Taylor, the company’s board chair, and board member Nicole Seligman. The announcement follows the high-profile exit this month of an OpenAI executive focused on safety, Jan Leike. “At the conclusion of the 90 days, the Safety and Security Committee will share their recommendations with the full Board. Following the full Board’s review, OpenAI will publicly share an update on adopted recommendations in a manner that is consistent with safety and security.”
Persons: Washington CNN — OpenAI, OpenAI, Sam Altman, Bret Taylor, Nicole Seligman, Jan Leike, Leike, OpenAI’s, , Ilya Sutskever, Sutskever, Altman’s, Organizations: Washington CNN, CNN, Safety, Security
OpenAI on Tuesday said it created a Safety and Security Committee led by senior executives, after disbanding its previous oversight board in mid-May. The formation of a new oversight team comes after OpenAI dissolved a previous team that was focused on the long-term risks of AI. AI safety has been at the forefront of a larger debate, as the huge models that underpin applications like ChatGPT get more advanced. Bret Taylor, Adam D'Angelo, Nicole Seligman, who are all on OpenAI's board of directors, now sit on the new safety committee alongside Altman. Leike this month wrote that OpenAI's "safety culture and processes have taken a backseat to shiny products."
Persons: Sam Altman, OpenAI, Ilya Sutskever, Jan Leike, AGI, Bret Taylor, Adam D'Angelo, Nicole Seligman, Altman, CNBC's Hayden Field Organizations: Microsoft, Security Locations: Redmond , Washington
Ex-OpenAI exec Jan Leike joined rival AI company Anthropic days after he quit over safety concerns. Leike, who co-led OpenAI's Superalignment team, left less than two weeks ago. AdvertisementOpenAI's former executive Jan Leike announced he's joining its competitor Anthropic. Leike co-led OpenAI's Superalignment team alongside cofounder Ilya Sutskever, who also resigned. The team was tasked with ensuring superintelligence doesn't go rogue and has since been dissolved, with remaining staffers joining the core research team.
Persons: Jan Leike, OpenAI's, OpenAI, , he's, Leike, Ilya Sutskever, superintelligence, @AnthropicAI Organizations: Service, Amazon, Business
download the appSign up to get the inside scoop on today’s biggest stories in markets, tech, and business — delivered daily. Read previewAI's golden boy, Sam Altman, may be starting to lose his luster. The company has also been dealing with comments from former executives that its commitment to AI safety leaves much to be desired. This story is available exclusively to Business Insider subscribers. ScaJo scandalThe criticism around AI safety is the latest blow for Altman, who is fighting battles on multiple fronts.
Persons: , Sam Altman, Gretchen Krueger, Jan Leike, Ilya Sutskever, Altman, Stuart Russell, Russell, Scarlett Johansson, Paul Morigi, OpenAI Organizations: Service, Business, Wednesday, UC Berkeley, Microsoft Locations: OpenAI, Russian
OpenAI faces more turmoil as another employee announces she quit over safety concerns. It comes after the resignations of high-profile executives Ilya Sutskever and Jan Leike, who ran its now-dissolved safety research team Superalignment. Krueger wrote, "I resigned a few hours before hearing the news about @ilyasut and @janleike, and I made my decision independently. I resigned a few hours before hearing the news about @ilyasut and @janleike, and I made my decision independently. Kokotajlo said he left after "losing confidence that it [OpenAI] would behave responsibly around the time of AGI."
Persons: Ilya Sutskever, Jan Leike, Gretchen Krueger, Krueger, — Gretchen Krueger, Leike, OpenAI, Daniel Kokotajlo, William Saunders, Kokotajlo, OpenAI didn't Organizations: Business
Back in September, Scarlett Johansson, who played the hauntingly complex AI assistant in the 2013 Spike Jonze film “Her,” got a request from OpenAI’s CEO, Sam Altman. He wanted to hire Johansson to voice his company’s newest ChatGPT model, “Sky.” She said no. Johansson quickly lawyered up, saying Monday she was “shocked, angered and in disbelief” that Altman would use a voice “so eerily similar” to her own. OpenAI was forced to confront some of those concerns late last week, after two prominent employees left the company. “Being friends with AI will be so much easier than forging bonds with human beings,” wrote Wired editor Brian Barrett in a recent essay about the movie.
Persons: CNN Business ’, you’ve, Scarlett Johansson, Spike Jonze, , Sam Altman, Johansson, OpenAI, Altman, Altman —, Jan Leike, OpenAI’s, Ilya Sutskever, ” Altman, , that’s, Joaquin, Brian Barrett, — CNN’s Clare Duffy, Brian Fung Organizations: CNN Business, New York CNN, Google Locations: New York, Silicon
download the appSign up to get the inside scoop on today’s biggest stories in markets, tech, and business — delivered daily. Read previewElon Musk has waded into the dispute between Sam Altman and Scarlett Johansson. Musk has also started his own AI company, xAI, and launched a ChatGPT rival named Grok. AdvertisementAltman played into the speculation by posting the word "her" on X, but OpenAI executives denied the likeness was intentional. In a statement shared with Business Insider, Altman apologized to Johansson for not communicating better but reiterated that the Sky voice wasn't intended to mimic hers.
Persons: , Elon, Sam Altman, Scarlett Johansson, Musk, Johansson's, OpenAI, she'd, Altman, Scarlett Johansson's, chatbot, Johansson, Jan Leike, OpenAI didn't Organizations: Service, Business
Read previewThe age of AGI is coming and could be just a few years away, according to OpenAI cofounder John Schulman. Speaking on a podcast with Dwarkesh Patel, Schulman predicted that artificial general intelligence could be achieved in "two or three years." A spokesperson for OpenAI told The Information that the remaining staffers were now part of its core research team. Schulman's comments come amid protest movements calling for a pause on training AI models. Groups such as Pause AI fear that if firms like OpenAI create superintelligent AI models, they could pose existential risks to humanity.
Persons: , John Schulman, Dwarkesh Patel, Schulman, AGI, Elon Musk, OpenAI, Kayla Wood, Jan Leike, Ilya Sutskever Organizations: Service, Business, Tech, Washington Post
download the appSign up to get the inside scoop on today’s biggest stories in markets, tech, and business — delivered daily. Read previewElon Musk has waded into the dispute between Sam Altman and Scarlett Johansson. Musk has also started his own AI company, xAI, and launched a ChatGPT rival called Grok. AdvertisementSam Altman played into the speculation by posting the word "Her" on X, but OpenAI executives denied the likeness was intentional. However, on Monday, the company abruptly announced that "Sky," the voice used in the GPT-4o demo, would be temporarily removed.
Persons: , Elon, Sam Altman, Scarlett Johansson, Musk, Johansson's, OpenAI, Sam Altman's, Altman, Scarlett Johansson's, chatbot, Johansson, Jan Leike Organizations: Service, Business, BI
A Safety Check for OpenAI
  + stars: | 2024-05-20 | by ( Andrew Ross Sorkin | Ravi Mattu | Bernhard Warner | ) www.nytimes.com   time to read: +1 min
OpenAI’s fear factorThe tech world’s collective eyebrows rose last week when Ilya Sutskever, the OpenAI co-founder who briefly led a rebellion against Sam Altman, resigned as chief scientist. “Safety culture and processes have taken a backseat to shiny products,” Jan Leike, who resigned from OpenAI last week, wrote on the social network X. Along with Sutskever, Leike oversaw the company’s so-called superalignment team, which was tasked with making sure products didn’t become a threat to humanity. Sutskever said in his departing note that he was confident OpenAI would build artificial general intelligence — A.I. Leike spoke for many safety-first OpenAI employees, according to Vox.
Persons: Ilya Sutskever, Sam Altman, hadn’t, ” Jan Leike, Sutskever, Leike, , Vox, Daniel Kokotajlo, Altman Organizations: OpenAI, C.E.O
New York CNN —OpenAI says it’s hitting the pause button on a synthetic voice released with an update to ChatGPT that prompted comparisons with a fictional voice assistant portrayed in the quasi-dystopian film “Her” by actor Scarlett Johansson. “We’ve heard questions about how we chose the voices in ChatGPT, especially Sky,” OpenAI said in a post on X Monday. A spokesperson for the company said that structure would help OpenAI better achieve its safety objectives. OpenAI President Greg Brockman responded in a longer post on Saturday, which was signed with both his name and Altman’s, laying out the company’s approach to long-term AI safety. “We have raised awareness of the risks and opportunities of AGI so that the world can better prepare for it,” Brockman said.
Persons: New York CNN — OpenAI, Scarlett Johansson, OpenAI, “ We’ve, ” OpenAI, , Desi Lydic, , ” Lydic, Joaquin Phoenix, Everett, Sam Altman, Johansson, Jan Leike, Ilya Sutskever, Altman, Leike, Greg Brockman, ” Brockman Organizations: New, New York CNN, Daily, Warner Bros ., White, CNN Locations: New York, ChatGPT, OpenAI
AdvertisementIt's a rare admission from Altman, who has worked hard to cultivate an image of being relatively calm amid OpenAI's ongoing chaos. Safety team implosionOpenAI has been in full damage control mode following the exit of key employees working on AI safety. He said the safety team was left "struggling for compute, and it was getting harder and harder to get this crucial research done." Silenced employeesThe implosion of the safety team is a blow for Altman, who has been keen to show he's safety-conscious when it comes to developing super-intelligent AI. The usually reserved Altman even appeared to shade Google, which demoed new AI products the following day.
Persons: , Jan Leike, Ilya Sutskever, Sam Altman, Altman, Leike, Leopold Aschenbrenner, Pavel Izmailov, Daniel Kokotajlo, William Saunders, Cullen O'Keefe, Kokotajlo, Vox, OpenAI, Joe Rogan's, Neel Nanda, i've, Scarlett Johansson, OpenAI didn't Organizations: Service, Business, AGI
OpenAI's exit agreements had nondisparagement clauses threatening vested equity, Vox reported. Sam Altman said on X that the company never enforced it, and that he was unaware of the provision. Sign up to get the inside scoop on today’s biggest stories in markets, tech, and business — delivered daily. download the app Email address Sign up By clicking “Sign Up”, you accept our Terms of Service and Privacy Policy . AdvertisementOpenAI employees who left the company without signing a non-disparagement agreement could have lost vested equity if they did not comply — but the policy was never used, CEO Sam Altman said on Saturday.
Persons: Vox, Sam Altman, , Superalignment, Jan Leike, Ilya Sutskever Organizations: Service, Vox News, Business
OpenAI's Ilya Sutskever and Jan Leike, who led a team focused on AI safety, resigned. Founders Sam Altman and Greg Brockman are now scrambling to reassure everyone. download the app Email address Sign up By clicking “Sign Up”, you accept our Terms of Service and Privacy Policy . AdvertisementTwo of OpenAI's founders, CEO Sam Altman and President Greg Brockman, are on the defensive after a shake-up in the company's safety department this week. Sutskever and Leike led OpenAI's super alignment team, which was focused on developing AI systems compatible with human interests.
Persons: OpenAI's Ilya Sutskever, Jan Leike, Sam Altman, Greg Brockman, , Ilya Sutskever, Leike Organizations: Service, Business
New York CNN —A departing OpenAI executive focused on safety is raising concerns about the company on his way out the door. His resignation followed an announcement by OpenAI Co-Founder and Chief Scientist Ilya Sutskever, who also helped lead the superalignment team, on Tuesday that he would leave the company. The technology will make ChatGPT more like a digital personal assistant, capable of real-time spoken conversations. “i’m super appreciative of @janleike’s contributions to openai’s alignment research and safety culture, and very sad to see him leave,” Altman said. i’ll have a longer post in the next couple of days.”–CNN’s Samantha Delouya contributed to this report.
Persons: Jan Leike, superalignment, OpenAI, , Leike, , Ilya Sutskever, Sutskever, Sam Altman, Altman, Kara Swisher, ” Leike, ” Altman, ” –, Samantha Delouya Organizations: New, New York CNN, OpenAI, CNN Locations: New York, ChatGPT
A top OpenAI executive researching safety quit on Tuesday. Adding that Sam Altman's company was prioritizing "shiny products" over safety. AdvertisementA former top safety executive at OpenAI is laying it all out. "Over the past years, safety culture and processes have taken a backseat to shiny products," Leike wrote in a lengthy thread on X on Friday. This story is available exclusively to Business Insider subscribers.
Persons: Jan Leike, Sam Altman's, , Leike, OpenAI Organizations: Service, Business
The news comes days after both team leaders, OpenAI co-founder Ilya Sutskever and Jan Leike, announced their departures from the Microsoft-backed startup. OpenAI's Superalignment team, announced last year, has focused on "scientific and technical breakthroughs to steer and control AI systems much smarter than us." "I joined because I thought OpenAI would be the best place in the world to do this research," Leike wrote on X. Leike wrote that he believes much more of the company's bandwidth should be focused on security, monitoring, preparedness, safety and societal impact. The update brings the GPT-4 model to everyone, including OpenAI's free users, technology chief Mira Murati said Monday in a livestreamed event.
Persons: Sam Altman, OpenAI, Ilya Sutskever, Jan Leike, OpenAI's, Leike, Altman, Sutskever, Helen Toner, Tasha McCauley, Adam D'Angelo, Ilya, Jakub Pachocki, Mira Murati, Murati Organizations: OpenAI, Hope, CNBC, Microsoft, Wired, Tuesday, Wall Street Locations: Atlanta, Leike, OpenAI
OpenAI's Superalignment team was formed in July 2023 to mitigate AI risks, like "rogue" behavior. OpenAI has reportedly disbanded its Superalignment team after its co-leaders resigned. AdvertisementIn the same week that OpenAI launched GPT-4o, its most human-like AI yet, the company dissolved its Superalignment team, Wired first reported. OpenAI created its Superalignment team in July 2023, co-led by Ilya Sutskever and Jan Leike. The team was dedicated to mitigating AI risks, such as the possibility of it "going rogue."
Persons: OpenAI's, OpenAI, , Ilya Sutskever, Jan Leike, Sutskever Organizations: Service, Wired, Business
Jan Leike, the co-lead of OpenAI's superalignment group, announced his resignation on Tuesday. Leike's exit follows the departure of Ilya Sutskever, OpenAI cofounder and chief scientist. Leike co-led OpenAi's superalignment group, a team that focuses on making its artificial intelligence systems align with human interests. Leike announced his departure hours after Ilya Sutskever, the other superalignment leader, said he was exiting. In a post on X, OpenAI cofounder Sam Altman said, "Ilya and OpenAI are going to part ways.
Persons: Jan Leike, OpenAI's, Ilya Sutskever, , shakeup, Leike, OpenAi's, OpenAI, Sutskever, Sutskever's, Sam Altman, Ilya, Altman, Diane Yoon, Chris Clark, Yoon, Clark, Leopold Aschenbrenner, Pavel Izmailov, Daniel Kokotajlo, William Saunders Organizations: Service, Business Locations: OpenAI
And the fact that there aren't such controls in place yet is a problem OpenAI recognized, per its July 2023 post. Our current techniques for aligning AI, such as reinforcement learning from human feedback , rely on humans' ability to supervise AI," read OpenAI's post. "But humans won't be able to reliably supervise AI systems much smarter than us, and so our current alignment techniques will not scale to superintelligence. AdvertisementLeike — who worked at Google's DeepMind before his gig at OpenAI — had big aspirations for keeping humans safe from the superintelligence we've created. "Maybe a once-and-for-all solution to the alignment problem is located in the space of problems humans can solve.
Persons: , Sam Altman, Ilya Sutskever, Altman, Sutskever, he's, Jan Leike, Leike, OpenAI, superalignment, we're, Google's DeepMind, OpenAI — Organizations: Service, Business, OpenAI Locations: OpenAI
Read previewTwo OpenAI employees who worked on safety and governance recently resigned from the company behind ChatGPT. Daniel Kokotajlo left last month and William Saunders departed OpenAI in February. Kokotajlo, who worked on the governance team, is listed as an adversarial tester of GPT-4, which was launched in March last year. OpenAI also parted ways with researchers Leopold Aschenbrenner and Pavel Izmailov, according to another report by The Information last month. OpenAI, Kokotajlo, and Saunders did not respond to requests for comment from Business Insider.
Persons: , Daniel Kokotajlo, William Saunders, Saunders, Kokotajlo, overton, Ilya Sutskever, Jan Leike, AGI, It's, Sam Altman, Diane Yoon, Chris Clark, Yoon, Clark, OpenAI, Leopold Aschenbrenner, Pavel Izmailov Organizations: Service, Business, Alignment Locations: OpenAI
As Open AI employees celebrated the return of CEO Sam Altman with a five-alarm office party , OpenAI software engineer Steven Heidel was busy publicly rebuffing overtures from Salesforce CEO Marc Benioff. Heidel was one of more than 700 OpenAI employees who's threatened exodus halted a would-be mutiny at one of Silicon Valley's most important AI companies. He was previously a scientist at Facebook AI Research and worked as a member of Google Brain under supervision of Prof. Geoffrey Hinton and Ilya Sutskever. Alec Radford: Radford was hired in 2016 from a small AI company he founded in his dorm room. Tao Xu : technical staff, worked on GPT4 and WhisperChristine McLeavey : technical staff, with contributions to music-related productsChristina Kim : technical staffChristopher Hesse : technical staffHeewoo Jun : technical staff, researchAlex Nichol : technical staff, researchWilliam Fedus: technical staff, researchIlge Akkaya: technical staff, researchVineet Kosaraju : technical staff, researchHenrique Ponde de Oliveira Pinto : technical staffAditya Ramesh : technical staff, developed DALL-E and DALL-E 2Prafulla Dhariwal : research scientistHunter Lightman : technical staffHarrison Edwards : research scientistYura Burda : machine language researcherTyna Eloundou : technical staff, researchPamela Mishkin : researcherCasey Chu : researcherDavid Dohan : technical staff, researchAidan Clark : researcherRaul Puri : research scientistLeo Gao : technical staff, researchYang Song : technical staff, researchGiambattista ParascandoloTodor Markov : Machine learning researcherNick Ryder : technical staff
Persons: Sam Altman, Steven Heidel, Marc Benioff, Heidel, Altman, Mira Murati, Murati, Brad Lightcap, Lightcap, Jason Kwon, Kwon, Wojciech Zaremba, Geoffrey Hinton, Ilya Sutskever, Alec Radford, Radford, OpenAI, Peter Welinder, He's, Github Copilot, Anna Makanju, Andrej Karpathy, OpenAI's, Michael Petrov, Petrov, Greg [ Brockman, Miles Brundage, Brundage, John Schulman OpenAI, Srinivas Narayanan, Scott Grey, Grey, Bob McGrew, Research Che Chang, Lillian Weng, Safety Systems Mark Chen, Frontiers Research Barret Zoph, Peter Deng, Jan Leike Evan Morikawa Steven Heidel Jong Wook Kim, Tao Xu, Christine McLeavey, Christina Kim, Christopher Hesse, Heewoo, Alex Nichol, William Fedus, Henrique Ponde de Oliveira Pinto, Aditya Ramesh, Hunter Lightman, Harrison Edwards, Yura, Tyna, Pamela Mishkin, Casey Chu, David Dohan, Aidan Clark, Raul Puri, Leo Gao, Yang, Giambattista Parascandolo Todor Markov, Nick Ryder Organizations: Business, BI, OpenAI, Khosla Ventures, Facebook, Research, Google, Tesla, U.S . Department of Energy, Oxford University, Safety Systems, Frontiers Research Locations: Albania, Canada, OpenAI
OpenAI employees are having a tough time after Sam Altman was suddenly ousted from the company. Here's what OpenAI employees are saying about the chaotic transition. Since Friday the company has cycled through three CEOs: cofounder Sam Altman, former CTO Mira Murati, and current CEO Emmett Shear, who cofounded Twitch. AdvertisementMore OpenAI staffers have threatened to join them unless Altman is reinstated and the board resigns. Throughout the night on Sunday, more OpenAI staffers spoke out, sharing the repeated message: "OpenAI is nothing without its people."
Persons: Sam Altman, Altman, , Mira Murati, Emmett Shear, Greg Brockman, Aleksander Madry, Employees haven't, cofounders Brockman, Will Depue, Sam, Greg, Ilya Sutskever, Shengjia Zhao, Ilya, Jan Leike, Andrej Karpathy Organizations: Service, Microsoft, Employees, Business, Sutskever, OpenAI
At least two-thirds of OpenAI staff have threatened to quit and join Sam Altman at Microsoft. It follows days of chaos at OpenAI after CEO Sam Altman was fired in a shock move. AdvertisementNearly 500 OpenAI staff have threatened to quit unless all current board members resign and ex-CEO Sam Altman is reappointed. Late on Sunday, Microsoft CEO Satya Nadella announced that Altman and former OpenAI president Greg Brockman would be joining a new AI team at Microsoft, after efforts by investors and current employees to bring him back as OpenAI CEO fell apart. OpenAI and Microsoft did not immediately respond to a request for comment from Business Insider, made outside normal working hours.
Persons: Sam Altman, , Mira Murati, Brad Lightcap, Altman, Kara Swisher, Ilya Sutskever, Jan Leike, Murati, Satya Nadella, Greg Brockman, OpenAI, Emmett Shear, Twitch Organizations: Microsoft, Service, Wired, Sutskever, Business
Total: 25