How to Measure AI Performance Beyond Accuracy
The quarterly AI review opened with a slide showing 94.2% model accuracy. The CFO asked what that meant in terms of
Read MoreThe quarterly AI review opened with a slide showing 94.2% model accuracy. The CFO asked what that meant in terms of
Read MoreThe AI customer service system had a 94% accuracy rate on the test dataset. Live, in the first month, it handled
Read MoreShe found out that two members of her team had been using a public AI tool to summarise client contracts for
Read MoreThe vendor used the word ‘agent’ fourteen times in the pitch. Each time, it meant something slightly different. By the end
Read MoreTwo people in the same team using the same AI tool are getting very different results. One routinely produces outputs she
Read MoreThe initial budget proposal was thorough. Development cost, itemised by sprint. Vendor licence fees, monthly. Infrastructure, estimated by compute tier. The
Read MoreThe AI project was approved in January. Budget confirmed, vendor selected, kick-off meeting scheduled. The first discovery session revealed that the
Read MoreThe meeting opened with a list of seventeen AI ideas. Over three hours, the team debated each one – the technical
Read MoreHe approved the budget for an off-the-shelf AI platform because it looked like exactly what the business needed. The demos were
Read MoreThe hardest conversation in AI consulting is not ‘your project is going to take longer than planned.’ It is ‘your project
Read More