In the case of functions that are defined on a close interval [a,b] and continuous on (a,b) where a<x<b, yes. Otherwise, this advise leads to false statements fast.
Simple example of this advice failing: compute the limit as x approaches 0 of f(x) = 1/x, where x is any negative real number.