Is unbiasing estimators always justified ?

It is argued that systematically unbiassing estimators is not always justified and can be counter-productive. On the contrary, a general rule is given to build a (slightly) biased but consistent estimator which is always closer to the value being estimated than the unbiased estimator from which one has started.