TL;DR
Europe runs its AI inference on hardware it does not control. It holds about 5% of the world’s measured AI computing power, the best accelerators are subject to US export rules, and the memory they depend on became about four times more expensive in 2026. China shows how quickly access can become a political bargaining chip, and Europe has already received two warnings of its own.
There are two roads out. The industrial road, European chips designed and eventually built in Europe, is essential and already under way in the Netherlands, France, Spain, Germany and the UK, but it will take 10 to 20 years and tens of billions of euros. We must take it anyway.
The second road can start this month, as an experiment worth funding. Every year, a new wave of datacenter GPUs reaches the end of its first life, and many of these cards end up shredded instead of being reused. They are not as efficient as brand-new GPUs, but refurbished cards already sell memory bandwidth, the resource that limits much of AI inference, for a fraction of the price of new hardware. My hypothesis: with an open-source software stack built for them, a server costing about 18,000 euros could serve real professional workloads on hardware that needs nobody’s permission to run, and, on low-carbon electricity, with a smaller carbon footprint than new hardware. This article explains the idea and how to test it. I will publish the results, good or bad.
Continue reading “AI Inference Without Asking Permission: Two Roads for Europe”
