Ethereum co-founder Vitalik Buterin has released an extensive vision for a new epoch of “decentralized and democratic differential defensive acceleration,” cautioning that highly intelligent AI could present existential risks unless humanity embraces a meticulously balanced strategy of advancing protective technologies, encouraging transparency, and establishing robust liability and regulatory frameworks.
Creator Conflicts Over AI Catastrophe
“It’s uncertain that the default outcome is inherently beneficial,” he states in his most recent blog entry, underscoring that in a reality where artificial superintelligence might emerge in a mere five years, the margin for mistakes diminishes substantially. “If we wish to avoid the annihilation of our world or landing in an irreversible predicament, we cannot solely fast-track the positive; we must also mitigate the negative, and this necessitates enacting powerful regulations that could agitate influential individuals.”
Buterin’s initiative emphasizes achieving a balance between swift technological progress and readiness. He urges individuals to “develop technology that ensures our safety without presuming that ‘the good actors (or good AIs) are in charge,’” cautioning that an unrestrained arms race in AI development or biotech could equally empower military forces or malevolent entities.
In a compelling illustration, he envisions a near-future situation where “a disease that simulations indicate might have been five times more severe than Covid two decades ago is revealed to be a non-issue now,” due to decentralized, community-led defenses like open-source air monitoring and instant vaccine code updates. “Individuals working on these technologies over the years are increasingly recognizing each other’s contributions,” he observes, adding that “the same principles that inspired Ethereum and crypto can be applied on a broader scale.”
The core of the Ethereum co-founder’s defense strategy rests on expanding and enhancing what he terms “d/acc,” a scheme to prioritize tools that empower individuals instead of governments or corporations in determining who gains access to essential resources. “If we aim to establish a more favorable alternative to domination, deceleration, and destruction, we require this kind of expansive coalition building,” he asserts, noting that the decentralized nature of his framework would prevent “a period of warfare among all” and avert an environment where only the strongest prevail.
He particularly points to the perils of centralized entities managing AI. “We witnessed this in Covid, where gain-of-function research backed by several major global governments may have sparked the pandemic,” he remarks, emphasizing that oppressive central control often leads to catastrophic breakdowns rather than reliable security.
The Defense Framework
He dedicates a substantial portion of his post to two legal and regulatory proposals for tackling the potential runaway hazards of advanced AI. One is accountability: “Imposing liability on users generates a strong incentive to implement AI in what I perceive as the appropriate manner,” he states, asserting that individuals who directly engage with AI systems should bear responsibility if those systems cause harm.
He recognizes the complexities that arise when handling open-source models or formidable militaries but insists that liability remains “a very adaptable strategy that avoids being overfit.” He also notes that holding deployers and developers responsible makes sense, provided it doesn’t stifle open innovation with excessive legal burdens. “Even if some users are too insignificant to be held accountable, the average customer of an AI developer is not,” he suggests, viewing this as a pressure that could naturally steer hazardous AI research toward safer routes and more transparent governance.
His second regulatory approach is more ambitious. “If I were convinced that we require something more ‘assertive’ than liability regulations,” he elaborates, “this is what I would advocate for: a global ‘soft pause’ button on industrial-scale hardware.” He envisions a scenario in which specialized chips within the most potent computing machinery, used to train or operate near-superintelligent AI models, would necessitate a collection of signatures every week from various international entities.
“This seems to satisfy the criteria for maximizing benefits while minimizing risks,” he states, illustrating how shutting down or restricting the total computing capacity globally by 90–99% for a year or two could grant humanity the opportunity to respond if a nascent AI threat began to spiral uncontrollably.
He observes that such an all-or-nothing halt on hardware would be challenging to circumvent, as “there would be no viable means to authorize one device to continue functioning without allowing all other devices to do the same.” Nonetheless, he concedes the significant challenge of convincing the international community to embrace such a strategy, asserting it will require “the hard work of actively attempting to cooperate” rather than relying on one dominant power to control everyone else.
Buterin links his reflections on AI risks to the broader principles of Ethereum, open-source development, and decentralized governance, asserting that “the same values that prompted Ethereum and crypto can be applied on a larger scale.” He mentions that collaborative tools like prediction markets, which are already thriving on Ethereum and other blockchain platforms, could serve as formidable defenses against misinformation and fear when paired with privacy features such as ZK-SNARKs.
He also regards “formal validation, sandboxing, secure hardware modules, and other technologies” as foundational for constructing a robust cyber-defense framework capable of thwarting an AI attempting to commandeer systems. “It hacks our computers, concocts a super-plague, convinces us to distrust each other—these represent the potential methods through which an AI takeover could occur,” he warns, presenting bio-defense, cyber-defense, and ‘info-defense’ as vital components of the protective infrastructure that the Ethereum community can assist in establishing.
He further explores the issue of how these decentralized, security-oriented initiatives might secure funding, reaffirming his confidence in “strong decentralized public goods funding” to guarantee that open-source vaccines, biotech, and encryption tools do not languish for lack of profit. “Quadratic funding and similar mechanisms were specifically designed to finance public goods in a manner that is as credibly impartial and decentralized as possible,” he explains, though he acknowledges that older systems can swiftly devolve into popularity contests that favor more glamorous projects.
His latest tactic, “deep funding,” aims to let AI models aggregate human assessments regarding which projects warrant financial backing, utilizing a “dependency graph” so that contributors can visualize how each venture builds upon the efforts of others. “By leveraging an open competition of AIs, we mitigate the bias from any singular AI training and management process,” he remarks, celebrating crypto’s capacity to galvanize communities around such initiatives.
His blog post frequently revisits the notion that concentrating solely on defensive or centralized strategies constitutes a blueprint for disaster. “The difficulty with efforts to slow technological advancement, or economic degeneration, is twofold,” he asserts, highlighting that attempting to halt research outright would impose monumental costs on humanity and fail to prevent rogue actors.
He also cautions against strategies that place excessive reliance on “the center,” citing the World Health Organization’s early denial of airborne Covid transmission as an example of how large organizations can make severely erroneous assessments. “A decentralized approach would more effectively tackle risks emerging from the center itself,” he maintains.
The Ethereum co-founder concludes by urging supporters to recognize that technology can serve as both a menace and a means for empowerment, contingent on how it is managed. “We, humans, remain the brightest star,” he proclaims, asserting that global collaboration, open-source participation, and defense-oriented acceleration are essential to navigating a century that could usher in superintelligent AI, innovative vaccines, and a new generation of security technologies.
“Access to tools signifies that we can adapt and enhance our biologies and environments, and the ‘defense’ aspect of d/acc signifies that we can do so without encroaching on others’ liberties,” the Ethereum co-founder writes. “The challenge that lies ahead, of constructing an even brighter 21st century that preserves human survival, freedom, and agency as we journey toward the stars, is a formidable one. Yet, I am assured that we are capable of meeting it.”
At the time of publication, Ethereum was priced at $3,639.
Featured image from YouTube, chart from TradingView.com