How to measure whether machine learning development services is working
Measure at four levels: model quality on a held-out set, system behaviour in production, the business decision the model changed, and the cost of running it. A project reporting only the first level is reporting a laboratory result, not a working system.