Sam Altman: OpenAI's best model "can't responsibly be open-sourced" until the world builds better cyberdefense and bio-security

Wait 5 sec.

OpenAI co-founder and CEO Sam Altman recently sat down for an in-depth conversation at Stanford Graduate School of Business's "View from the Top" series, covering AI's development trajectory, safety challenges, organizational transformation, and personal growth. Altman admitted that OpenAI originally envisioned itself as a pure research lab, with the team naively believing that once superintelligence was developed, commercialization and productization would somehow resolve themselves. But the technology's actual development path diverged sharply from expectations, forcing the company to pivot around 2020—and the explosive growth following ChatGPT's launch pushed OpenAI into becoming a massive company virtually overnight. Addressing tensions between open-weight models and safety, Altman stated that open-weight models hold significant societal value, but OpenAI's current most advanced internal model "cannot responsibly be open-sourced" until global cyberdefense systems and biosecurity safeguards are sufficiently strengthened. Responding to a question about what he got wrong back in 2020, Altman admitted he had underestimated the difficulty of the AI alignment problem. While current models have shown better-than-expected alignment, he warned against assuming this trend will simply continue. "The rapid progress of the past six months has tested the strength of my convictions, he said, noting that in narrow domains like mathematical reasoning, we already have superintelligence now, and it happened faster than I expected. He cautioned that without adjustments to current global governance frameworks, maintaining the present pace of development won't be sustainable,"and called for serious industry-wide discussion on pacing AI progress. Source: https://www.youtube.com/watch?v=anAmTGcewX8 - open weight models are very important for society to have up to some fairly high level of capability. [42:25] - banning all open-source models would be an extremely high cost to innovation and liberty in society, and we shouldn’t do it. [38:23] - there’s going to be some stuff that you wish someone hadn’t done [38:51] - above which the models can do sufficient harm that we don’t give people the liberty to use them however they want. [39:22] - I don’t think it means we shouldn’t get to run neural networks on our computers. [40:20] - I don’t think we could responsibly open source our current best internal model. Anytime soon. [43:26]   submitted by   /u/External_Mood4719 [link]   [comments]