There is a specific test for lack of fit which uses the oposite logic. If your model is linear and the lack of fit is significant then obviously we have a nonlinearity. If the model has interaction terms for instance then the lack of fit means "more nonlinear" then what the interaction implies.

regards