When at first my supervisor told me that he wanted no job run times to be under-predicted, the task seemed daunting, almost impossible. How could I make sure that my algorithm never erred in such a way? In this post I explain how I tackled this problem and how the classical accuracy metric can be misleading and even futile in certain machine learning environments.