1. Energy and money are the ultimate limits on recursive self‑improvement
- “Recursive self‑improvement will ultimately be a problem of money. It's a very big bill and AI companies need to start thinking in terms of how they will accumulate cheap and free energy, because merely paying for compute will no longer be enough.” – deadbabe
- “I think the real constraint is actually physics, nominally energy, which is what a big chunk of the operational cost comes down to.” – jaggederest
- “Data centers is a service that itself consumes many goods.” – resonious
2. Physical infrastructure and multiple shutdown points keep AI under human control
- “There are many points of shutdown that would need to be controlled, not just one. The electrical feed, the cooling, the network, the physical integrity of the computer hardware. All with independent management.” – SoftTalker
- “Ultimately, any recursively self improving intelligence would be limited by the power cord, and as such, the idea that it would permanently escape human control seems somewhat silly.” – jaggederest
- “If humans decided this wasn't acceptable and tried to shut it down, the AI could epstein their way into controlling those who hold the reigns, either through bribes or blackmail.” – colordrops
3. There is disagreement over what counts as genuine self‑improvement and whether today’s models truly exhibit it
- “Can someone define “improvement” in this context? This concept feels like a buzz word otherwise.” – killbot5000
- “Models that are strong enough to improve themselves without a human (I.e. ai researcher) in the loop.” – letitgo12345
- “Improvement means being able to do more complicated things more reliably… learn to do new things with fewer and fewer examples.” – deepwoods
- “We are already there. Current AI is definitely capable of collecting new data and start training on that data to get a better model.” – charcircuit
- “From what I'm experiencing, we have recursive self improvement that can find local maxima, I'm not seeing really strong evidence of unguided RSI that finds the true optimal.” – bretpiatt