Safe SuperIntelligence Inc: A New AI Venture by Ilya Sutskever
In a dramatic and unexpected turn in the world of artificial intelligence, Ilya Sutskever, the renowned Co-Founder of OpenAI, has launched a new venture: Safe Superintelligence Inc. (SSI). This announcement comes just a month after Ilya’s high-profile departure from OpenAI, followed by a tumultuous period within the company, marked by an unsuccessful coup against CEOSam Altman. The establishment of SSI signifies a renewed and focused effort to ensure the safety of superintelligent AI, reflecting growing concerns within the tech community about the future of artificial intelligence.
Ilya’s new company, Safe Superintelligence Inc., is dedicated to developing “safe superintelligence,” a type of AI that surpasses human cognitive abilities and prioritises safety and ethical considerations. As outlined in a statement published on X, SSI is poised to be “the world’s first straight-shot SSI lab, with one goal and one product: a safe superintelligence.” This mission sets SSI apart from other AI firms, which often juggle multiple products and objectives.
Daniel Levy, a Former OpenAI Engineer, and Daniel Gross, an AI Investor and Entrepreneur with notable stakes in companies like GitHub and Instacart, are Co-Founding SSI with Ilya’s involvement, underscoring the venture’s strong technical expertise and strategic investment foundation. The company’s operations will be based in Palo Alto and Tel Aviv, reflecting a global perspective in its approach to AI development.
A Singular Focus Amidst a Turbulent Backdrop
We will pursue safe superintelligence in a straight shot, with one focus, one goal, and one product. We will do it through revolutionary breakthroughs produced by a small cracked team. Join us: https://t.co/oYL0EcVED2
SSI’s inception follows a significant upheaval period at OpenAI, where Ilya played a crucial role. In November, OpenAI’s board, which included Ilya, decided to oust Sam Altman from his position as CEO. This move sent shockwaves through the industry, leading to Altman’s quick reinstatement and Ilya’s subsequent departure in May. During his resignation, Ilya expressed enthusiasm for his next endeavour, which was now revealed as SSI.
Ilya’s departure was not an isolated incident. Around the same time, Jan Leike, who co-led OpenAI’s Superalignment team with Ilya, also left the company. Leike has since joined Anthropic, an AI startup focused on safety funded by Amazon and other venture capitalists. The dissolution of OpenAI’s Superalignment team, which aimed to control AI systems smarter than humans, highlights the internal conflicts regarding the company’s direction and priorities.
Safety as the Core Principle
SSI’s mission is clear: to pursue safe superintelligence without the distractions of commercial pressures or management overhead. “Our singular focus means no distraction by management overhead or product cycles, and our business model means safety, security, and progress are all insulated from short-term commercial pressures,” the founders stated. This emphasis on safety over profitability marks a significant departure from the typical business model of tech startups, which often balance innovation with investor demands.
The founders of SSI, particularly Ilya, bring a wealth of experience and a deep understanding of the challenges and risks associated with advanced AI. At OpenAI, Ilya pioneered generative AI technologies and started the company’s early advancements. His expertise will be invaluable as SSI navigates the complex landscape of AI safety.
The Broader Context of AI Safety Concerns
Ilya and his team at SSI are not alone in their concerns about AI safety. The broader tech community has increasingly voiced apprehensions about the rapid development of artificial general intelligence (AGI) and its potential risks. EthereumFounder Vitalik Buterin has described AGI as “risky,” noting that while these models pose significant dangers, they are potentially less harmful than corporate or military misuse. This sentiment is echoed by TeslaCEO Elon Musk and AppleCo-FounderSteve Wozniak, who, along with over 2,600 tech leaders and researchers, called for a six-month pause in AI system training to address the “profound risk” they represent.
The departure of key figures like Ilya and Leike from OpenAI and the establishment of SSI reflects a growing divide in the AI community between those prioritising rapid advancement and those advocating for stringent safety measures. This divide underscores the urgent need for a balanced approach that harnesses AI’s potential while mitigating risks.
Conclusion: A New Chapter in AI Development
The launch of Safe Superintelligence Inc. marks a pivotal moment in the AI industry. Ilya’s new venture is not just another AI startup; it represents a critical shift towards prioritising superintelligent AI’s safety and ethical considerations. By focusing solely on developing safe superintelligence, SSI aims to set new standards in the field, ensuring that the powerful technologies of tomorrow are developed responsibly.
As AI continues to evolve, companies like SSI will be crucial in guiding the industry towards a future where advanced AI systems enhance human life without compromising safety or ethical values. SSI’s journey has just begun, but its impact on the landscape of AI safety will likely be profound and far-reaching.
