After I have done some thinking about the problem, I'd say, that Mean Absolute Error (MAE) would be the best model decision criterion for robust data problems, that are miles away from normal distributetd or rather do not follow a theoretic distribution at all.