Urban Innovation Labs: Testing Solutions Without Endless Pilots

Why pilots stall and what a lab changes

Almost every city official recognises the pattern: a startup arrives with a solution, the city lends a street, a demonstration is filmed, the grant runs out, and the project quietly disappears. Margot Roose, a former deputy mayor of Tallinn who spent years on pilot evaluation committees, calls the result an 'innovation show' — pilots used to signal progress to voters while only a fraction ever reach procurement and conclusions stay unclear. In her view the most dangerous phrase in the municipal vocabulary is not 'no' but 'let's pilot', when no one has defined how the trial ends.

An innovation lab is an attempt to replace that chaos with discipline. Nesta, which has studied such units around the world, distils their work into four moves: scanning for and identifying key issues, developing ideas, testing and prototyping, and creating routes toward systems change and greater impact. Labs differ in method (design, data, behavioural economics), field, and whether they sit inside government or at arm's length. The essential point is that a lab is not a room but a durable organisational capability to learn from practice and turn that learning into decisions.

A useful self-audit for any city: where do entrepreneurs' proposals land today? Is there one formal path from idea to pilot to procurement, or does every project negotiate its own route? If the answer is 'a fresh path every time', the system does not exist yet.

An operating model in five steps

First, turn the problem into a testable hypothesis with a 'before' baseline. Without a starting number you cannot judge effect: a 'smart' waste bin is only justified when you know what collection cost before it existed. Next, source solutions openly — through calls, crowdsourcing, and problem-based procurement, which the Bloomberg Center for Public Innovation highlights as a way to pull a wider set of actors into the work than city hall alone can reach.

At the selection stage the lab acts as a gateway. Barcelona's Urban Lab, running since 2008 inside the 22@Barcelona district, is a reference: companies submit a proposal to a board of district staff and city officials; if chosen, the lab picks a test location and pairs the team with the municipal officer who manages that site. That linking person — a site owner rather than an outside observer — is what turns a trial into a governed process. The loop closes with the staged method the Başakşehir Living Lab in Istanbul describes: idea verification, stakeholder workshops, a prototype, and finally structured real-environment testing with agreed feedback collection and defined timeframes.

Write the exit conditions before the first sensor is installed

The most important decision is made before the test, not after it: how will the experiment end, and who decides? Practitioners from Tallinn advise answering these questions up front. Who owns the data generated during the trial? How will the solution integrate with the city's legacy systems, and who pays for that work? What specific metrics define success, and which one will trigger a move to procurement? Are the real decision-makers in the room, or is the project living in the middle tier of management?

A second block covers what the city contributes. If there is no budget, that is acceptable — but then the city must give real equivalent value: access, data, political cover, and, at the end, a verified case study the company can take to its next investor. A thank-you letter is not a deliverable, and an honest 'no' at the start beats a drawn-out 'maybe'. The model also pre-sets the exit clause: if the metrics are not met, the pilot is removed, with the removal date and responsible officer known in advance. That keeps a project out of what Roose calls 'maybe land' — the worst outcome for both the city and the entrepreneur.

Choosing problems worth testing and sourcing ideas

Current guidance on city innovation converges on one point: a narrow target yields a string of small fixes, while an ambitious mission can unite the whole city. The Bloomberg Center for Public Innovation describes Ambitious Impactful Missions, such as Reykjavik's decision to align its education and welfare departments around 'a better city for children'. The individual interventions matter less than the fact that the mission outlived a mayoral transition and kept expanding.

Idea pipelines grow stronger when they draw on people with lived experience of the problem. In Orlando, hiring people who had experienced homelessness produced a stream of new solutions and helped secure millions in federal funding. A similar logic shaped the innovation lab in Nizhny Novgorod, which accepts proposals from any IT specialist and routes them through experts, city administration, development institutes, and universities; a project for an accessibility map mobilised over two hundred volunteers to assess the urban environment. In short, the idea channel lives at the intersection of city hall, residents, and industry rather than inside one department.

Expect failure and plan the scale path honestly

Resilient models do not promise that most pilots will succeed. Ömer Onur, managing director of Başakşehir Living Lab, is direct: of more than 150 supported projects since 2014, only ten to fifteen became genuinely successful businesses, meaning the large majority failed. The leading cause, he says, is not technology but marketing and commercialisation — labs excel at generating ideas and validating prototypes in real environments, but without a partner to take a product to market, startups fade. In Tallinn, the Test in Tallinn programme has attracted dozens of companies, yet fewer than ten percent of trialled solutions end up used by the city long-term. That number should sober rather than discourage.

Several rules follow. A failed pilot is not a failed lab if a lesson was captured and the company received a validated case. A success is not a polished demonstration but a move into procurement or replication across districts. Barcelona offers a useful contrast: its economic development office estimated that about ninety percent of projects tested on the streets went on to build a business — a difference explained by a mature startup ecosystem and the city's role as a potential first customer. The implication is that every model needs a named next step after the test: who becomes the investor or buyer of the scaled solution.

Lean governance and public trust

A common misconception is that a lab needs large budgets. According to the Centre for Public Impact, Barcelona's Urban Lab cost just under £185,000 a year, enough for a staff of three or four, because the real resources were city assets and the companies themselves, who paid for their own trials in exchange for a potential first customer and investor evidence. Stuttgart built its City Innovation Lab differently but just as lightly: launched in June 2022 with more than sixty city-centre businesses and administration stakeholders around three themes — a hybrid, creative, and sustainable city centre.

Finally, the model rests on trust that cannot be bought. The Inter-American Development Bank, reviewing urban laboratories in Latin America, recommends not only limiting the scale of pilots and diversifying them to widen the margin of success and failure, but also systematically showing results, however small. Visible outcomes, measured indicators (number of pilots, resident satisfaction, cost-effectiveness analysis), and clear communication to citizens turn experimentation from an internal game into a public good and give the work a lifespan longer than one electoral cycle.