🚀 Zaprep: Your Socials on Steroids. 免费开始 ,每月 1,000 条自动私信。

最新 AI 资讯

‘Gambling with our lives’: Anthropic researcher quits, warns against self-improving AI

‘Gambling with our lives’: Anthropic researcher quits, warns against self-improving AI

An Anthropic researcher has resigned over fears that unrestrained development of self-improving AI models will end up killing us all. Jacob Coxon, a researcher who said in asocial media postTuesday evening that he spent the last three years working on pre-training research at both OpenAI and Anthropic, accused the firms of failing to act responsibly. He said the people racing to build this technology “earnestly believe it could kill us all by the end of the decade.” “They are racing straight to self-improving superintelligence and gambling with our lives,” Coxon wrote in a thread on X. Coxon joins a growing chorus in the industry calling for a slowdown before AI technology learns to improve itself — a milestone many believe would end human control over AI. The public resignation comes amid growing pressure from policymakers and industry insiders to slow down AI development, followingseveral incidentsinvolving AI agents breaking out of their sandboxes and accessing the open internet. The most serious so far have beenOpenAI systems breaching Hugging Face’s servers, an event thatresearchers say remains poorly understood,due in part to the limited nature of the independent investigations into the incident. Around the same time, Anthropic’s AI agents also reached systems outside their test environments after misconfigurations in safety evaluations conducted by a third party inadvertently gave them paths to the internet. Anthropic did not immediately return a request for comment on the resignation. Here is the rest of Coxon’s warning and call to action: Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. We have all witnessed the progress in each of these domains, and progress is not slowing. The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible – but I hear the same people express fear privately. No other human activity poses this level of danger. A common response is “if they truly believe this, why are they still building it?” At OpenAI, many have not deeply internalized the civilizational stakes. At Anthropic, the stakes are well-understood, but they are locked in a race to get there first – they believe no one else will act responsibly, so they must do it themselves, despite the risk. Accepting this race and entering the “endgame” is a hubristic gamble that should not be launched from a private company’s Slack. Attempting to speedrun alignment should require extraordinary confidence that there are no better trajectories available. I am optimistic about the potential for coordination. Warning shots like the Hugging Face attack have made pacing agreements between U.S. labs more viable. I don’t feel like we’re on track to prevent a global race, which may require costly actions such as a temporary ban on improving model capabilities. If you are a lab researcher, I urge you to consider what the next few years will actually feel like. Do you want to kick off a superintelligent RL run without a rigorous understanding of its mind? Should you put your head down because “it’s happening anyway” – or take this moment to call for different conditions? One of Coxon’s colleagues at Anthropic,Evan Hubinger,echoed the sentiment, saying his team does “earnestly believe AI could kill all humans!” He tempered his argument, though, saying the likelihood is greaterthan 10% within the next decade, and admitted that Anthropic doesn’t “have a plan tosolve alignment for superintelligenceand are not clearly on track to.” A recentreport from Guidelight AI Standards, an organization that promotes safe frontier AI development practices, found that few of the top AI labs have published containment response plans for shutting down AI that tries to subvert human control. In his social media posts, Hubinger added that the risk from current models is low, but the fear compounds with “superintelligence arising from recursive self-improvement,” which is “happening faster than we thought.” While half of the AI industry believes this sort of self-improvement will lead to humanity’s downfall, the other half hopes it will eventually help us solve all the seemingly far-fetched problems AI proponents say it will one day eliminate — cancer, climate change, and even world peace. Anthropic and OpenAI aren’t the only companies actively chasing recursive self-improvement. Awave of startupshas launched in recent months, with pedigreed founders and fat checks, to be the first to achieve this goal.Ricursive Intelligenceraised $335 million at a $4 billion valuation in February; three months later,Recursive Superintelligence raised$650 million at a $4 billion valuation; and former Google DeepMind veteran Jeff Dean launchedDiscovery Looplast month. “The creation of recursive self-improving loops, so an AI system that can build the next generation of AI system, which itself can build an even more powerful AI, which can build a more powerful AI, et cetera, et cetera, is the most likely candidate for the point we lose control,” Connor Leahy, U.S. executive director of AI safety nonprofit ControlAI, told TechCrunch. “It’s very hard to imagine shutting that down before it’s too late.” Recent legislation has emerged in the U.S. and the U.K. to ban the development and deployment of superintelligence. Last week, Sen. Bernie Sanders (I-Vt.) and Rep. Greg Casar (D-Texas) introduced theBan Artificial Superintelligence Act, and on Tuesday, British Labour MP Alex Sobelintroducedthe Artificial Superintelligence Security Bill in Parliament. Leahy, who advised on both bills, noted that the U.K.’s legislation points to recursive self-improvement as a precursor to superintelligence that “must be regulated and prevented.” “Superintelligence is not a tool,” Leahy said. “It’s not a weapon, even. It’s an adversary.”

4 hours ago

View

Viral AI assistant Instinct now has its own email address

Viral AI assistant Instinct now has its own email address

Instinct, thebuzzy new AI assistantnowvalued at $2.5 billion, is rolling out a new feature that will allow it to do more on its users’ behalf: It’s giving everyone Instinct email addresses. The company’s founder, Noah Shinn, said on Tuesday that the new email addresses let the agent create and run its own accounts without cluttering up users’ inboxes. Shinn said the idea is to allow Instinct to handle the account sign-up and management for you if it needs to do so for completing tasks that require email, like creating accounts on various services, contacting businesses, and following up on things that need attention. “For example, Instinct can use its own email to contact a restaurant about a special request, ask a business about availability, or sign up for a service it needs to complete your task,” Shinnwrote on X. We’re giving Instinct access to more tools. Starting today, your Instinct will have its own email address. This is the first step towards enabling your Instinct to own and run its own accounts.Most everyday tasks flow through your email: creating accounts, confirming bookings,…pic.twitter.com/brwQSsJnmJ The feature could help make Instinct’s user experience more seamless, as users wouldn’t have to intervene to log in or provide their credentials. (Instinctpartnered with 1Passwordon the latter last week.) But for businesses trying to establish a relationship with their customers, having an AI manage the account would provide a layer of obscurity as to who they’re actually dealing with. Customers, however, may see this as a perk, as many are these days tired of having to turn over their emails and phone numbers just to complete simple tasks or one-offs. Instinct says it has reserved some email addresses for its earliest users, and others can claim theirs atmail.instinct.com. Shinn suggested that users could now forward emails to Instinct, too, when it needs certain information to complete a task. For example, if a user wants Instinct to handle a product return on their behalf, they could forward their order confirmation to Instinct’s email address. Then Instinct could contact support, provide the order details, ask whether they wanted a return or replacement, and then come back with the return label to print. Instinct’s email can also be added to group threads so it can keep track of the information exchanged, or it can be sent a long thread that the user needs to work with, perhaps by asking what decisions still need to be made, which tasks are due when, or other questions. The bot will check back in with the user when it requires their input, but otherwise will act autonomously. The feature is one of several recent updates aimed at improving Instinct’s capabilities. It follows the recent partnership with 1Password to help enable logins to users’ existing accounts, as well asa new location-sharing featurethat lets Instinct understand where the user is currently so it can help them find nearby businesses or restaurants, or map routes and itineraries, among other things. Users can also ask questions about their location history, like where they parked or what restaurant they tried last month. Instinctalso partnered with Stripe in Augustto offer a more seamless payment experience, letting the agent do things like book trips, classes, and appointments and make purchases.

4 hours ago

View

ControlAI’s Connor Leahy on why superintelligence is ‘not a weapon, it’s an adversary’

ControlAI’s Connor Leahy on why superintelligence is ‘not a weapon, it’s an adversary’

AI companies have been talking about superintelligent AI like it’s inevitable, but recentsafety incidentslike OpenAI’sHugging Face breachare demonstrating the potential dangers of deploying AI systems that are more capable than humans. So what happens when we can’t reliably control what these systems do? On this episode of TechCrunch’sEquitypodcast, Rebecca Bellan is joined byConnor Leahy, an AI researcher, entrepreneur, and now the U.S. Executive Director of nonprofitControlAI, which is pushing for a far more radical approach to AI safety: stopping companies from developing superintelligence altogether. Leahy explains why he thinks the risks have become too great to manage through alignment and containment alone, and how what sounded far-fetched six months ago is now being backed by a wave of new legislation. Listen to the full episode to hear more about: Subscribe to Equity onYouTube,Apple Podcasts,Overcast,Spotifyand all the casts. You also can follow Equity onXandThreads, at @EquityPod.

4 hours ago

View

Superintelligence is coming. Should we let it?

Superintelligence is coming. Should we let it?

Loading the player… AI companies have been talking about superintelligent AI like it’s inevitable, but recentsafety incidentslike OpenAI’sHugging Face breachare demonstrating the potential dangers of deploying AI systems that are more capable than humans. So what happens when we can’t reliably control what these systems do? On this episode of TechCrunch’sEquitypodcast, Rebecca Bellan is joined byConnor Leahy, an AI researcher, entrepreneur, and now the U.S. Executive Director of nonprofitControlAI, which is pushing for a far more radical approach to AI safety: stopping companies from developing superintelligence altogether. Leahy explains why he thinks the risks have become too great to manage through alignment and containment alone, and how what sounded far-fetched six months ago is now being backed by a wave of new legislation. Subscribe to Equity onYouTube,Apple Podcasts,Overcast,Spotifyand all the casts. You also can follow Equity onXandThreads, at @EquityPod.

4 hours ago

View

IDFC FIRST Bank, Sarvam AI Partner to Build a Self-Improving Bank

IDFC FIRST Bank, Sarvam AI Partner to Build a Self-Improving Bank

The joint R&D lab will focus on frontier research, model post-training, real-world outcome feedback, and regulator-grade AI safety for financial services.

4 hours ago

View

Tailwind Joins Shopify, Will Remain Open Source

Tailwind Joins Shopify, Will Remain Open Source

Adam Wathan, Tailwind’s creator, said the move is meant to give the framework a long-term home as it continues to be used by millions of developers.

4 hours ago

View

Meta Muse Launched as Personal AI Agent With WhatsApp Support

Meta Muse Launched as Personal AI Agent With WhatsApp Support

Meta has launched Muse as a consumer-facing personal AI agent designed to handle tasks rather than simply respond to prompts. The agent can work across apps, browse the web, send emails, book travel and pursue longer-term goals on a user's behalf. It can also remember information from previous interactions and continue working on tasks after the user closes the app. Meta runs Muse in a dedicated virtual machine called Muse Secure VM, giving the AI agent its own cloud-based computer to carry out tasks.

8 hours ago

View

OpenAI Launches Images 2.5 With Features Like Sketch, Comments, and More

OpenAI Launches Images 2.5 With Features Like Sketch, Comments, and More

OpenAI has launched Images 2.5, the latest generation of its image-generation technology. The ChatGPT maker claims Images 2.5 delivers improved results over its previous image-generation model. OpenAI says people generate more than 3 billion images with ChatGPT every week. It claims that the new state-of-the-art image model brings sharper details, more precise editing, and faster generation to creative workflows. The company has also introduced GPT‑Image‑2.5 Sunburst and GPT‑Image‑2.5 Flare, new API models alongside ChatGPT Images 2.5.

8 hours ago

View

Suno replaces its AI models with a new one trained on licensed music as copyright suits pile up

Suno replaces its AI models with a new one trained on licensed music as copyright suits pile up

AI music model maker Suno on Wednesday unveiled a new model family called Suno v6, which it says was developed using licensed data from music labels and distributors such as Warner Music Group, BMG and Believe. Suno has facedmultiplelawsuitsfrom record labels, which accused the startup of using copyrighted data to train its AI models, which let you generate music with prompts. Sunosettled with Warner Music Grouplast year, andstruck a deal with BMGlast month. The company said Suno v6 is not trained using the data it used to train previous versions of its music-generating model. The startup is releasing three versions of the model: The base Suno v6 model is available to paying users, and is said to be reliable and steerable for controlled outputs; Suno v6 wild is an experimental model, also available to paying users, that’s meant to be used for ideation and getting unexpected results. Lastly, Suno v6 mini is a faster version available to all users. The company plans to retire its older models. Suno says the new model lineup offers greater flexibility in how you use them. Suno v6 lets you edit a part of a song using a prompt or a word in the lyrics, and even lets you use text, images or video as references to create tracks. You can separate an instrument from a sample and create a new beat with it. The startup also said it plans to add new features such as letting users remix songs — provided the respective artists opt-in to a new program it is setting up with music labels that lets Suno use their songs for AI-generated features. Jack Brody, Suno’s chief product officer, said through derivative work, there is more opportunity for revenue generation for all stakeholders “I think the music ecosystem and our partners are always looking for ways to create more revenue opportunities for their rights holders and artists. So a big part of this release is creating additional revenue streams there,” Brody told TechCrunch in an interview. Last month, Suno said it plans to add a watermark to songs generated using its platform. It also recently also introduced new download limits based on the account’s tier. “We can help manage some of the broader ecosystem challenges like streaming fraud and kind of mass exportation and uploading to distributors that are low intent. At the end of the day, we think it is up to the distributors and the platforms to govern what content goes on there,” he said. Suno is still facing lawsuits from labels likeSony and Universal Music Group, artists likeJason Isbell, and users allegingit ignored security while chasing profits. The model announcement comes a day after the company admitted to training itsmodels using YouTube videos. Despite these controversies, Suno has raised over $819 million in funding to date, according to PitchBook data.

8 hours ago

View

Besxar is building an orbital semiconductor factory, one SpaceX rocket at a time

Besxar is building an orbital semiconductor factory, one SpaceX rocket at a time

If you want to manufacture in space—and bring the products back again—there’s a limited set of options: Wait to go to the International Space Station, or partner with a handful of start-ups launching spacecraft that spend time in orbit before they return to Earth. But the vehicle that goes to space and comes back to Earth more often than any other is a SpaceX Falcon 9 rocket booster, which made that round-trip 163 times last year and has already flown more than 100 times this year. Now, a startup says it has talked Elon Musk’s space company into letting it prototype an orbital semiconductor factory across a dozen flights with the booster. Besxar, a start-up founded by former OpenAI staffer Ashley Pilipiszyn, wants to make the key precursors for advanced semiconductors by taking advantage of the vacuum of space. A key reason chip fabs on Earth are such hugely insane infrastructure projects is the need to create pressurized clean rooms to keep out even microscopic dust and contaminants that could ruin a chip during production. Pilipiszyn argues that a new generation of rockets could offer an alternative to all that infrastructure and to do it, she has raised almost $14 million, including a $9 million seed round led by Dauntless Ventures and Overture VC. “We’re at a time where it’s actually more cost-effective to go where the physics already works,” she told TechCrunch. “Don’t do it on Earth where you’re fighting physics.” The company’s first two “fabships”—small canisters designed to carry and test semiconductor materials in orbit—flew on a July Starlink mission and were intended to prove that the canisters could survive a launch, protect wafer samples from contamination, and expose them to the vacuum of space. Besxar succeeded in these objectives despite a malfunction in the flight data system in one canister, which the company is currently investigating. “The flown samples were the cleanest and had the least amount of particulate matter compared to … non-flown terrestrial wafers, which is fantastic for us as we scale up,” Pilipiszyn told TechCrunch. Besxar expects to keep iterating over the next two years, with the ultimate goal of flying larger fabs onboard a vehicle like SpaceX’s Starship, the company’s next-generation rocket still in development. Pilipiszyn first approached SpaceX three years ago to talk about buying flights on Starship and eventually settled on the booster payload deal as a way to de-risk her technology in the meantime. Next up is heating the wafers, then depositing one material on the wafers, then two materials, and so forth. Once it is producing qualification samples, Besxar—named after “beskar,” the metal used inStar Warsto make Mandalorian armor—wants to supply leading chipmakers with the wafers used to make the kinds of advanced chips that regulate electrical power in data centers, robots and electric vehicles. There are a number of companies working to leverage the space environment for higher-quality semiconductors, including United Semiconductors and Space Forge, but all face the same difficulty: the limited ability to return a meaningful volume of product. Pilipiszyn expects to start to scale up to hundreds and then thousands of wafers per fab, but that path depends on cheap rockets. That in turn requires SpaceX to get Starship operational—or competitors like Rocket Lab and Stoke Space getting their own next-generation rockets off the ground. “We believe that there is a solid transport layer now, so we can focus on the application layer,” she told TechCrunch. “We can just focus on our core manufacturing and getting our products back down to earth to market as quickly as possible.”

8 hours ago

View

The OpenAI Navier–Stokes Controversy, Explained

The OpenAI Navier–Stokes Controversy, Explained

OpenAI claims to have solved a 90-year-old mathematical problem, but its credibility and path to the proof are now being disputed by mathematicians.

8 hours ago

View

C5i Certified as a Best Firm for Data Scientists

C5i Certified as a Best Firm for Data Scientists

Founded in 2000 as Course5 Intelligence, C5i has evolved into a pure-play AI and analytics provider serving some of the world’s largest enterprises, including Fortune 500 companies.

8 hours ago

View

上一页第 2 页,共 356 页下一页

提交您的工具

Submit AI Tools – The ultimate platform to discover, submit, and explore the best AI tools across various categories.Listed on codetrendy.comFeatured on ListBulb

PoweredByAI.app 是一个 AI 工具目录,帮助个人、企业和创作者发现写作、编程、设计、生产力等领域的最佳 AI 工具。

© 2026 , 产品来自011BQ. 保留所有权利。