P.S., This concept would fall under bias/variance trade off. Less variables means more potential bias and more variables (given finite sample) means greater standard errors.
If you have a loss function or value you are trying to optimize (e.g., MSE or accuracy) -- having a random holdout set...