Penalized least squares approximation methods and their applications to stochastic processes

We construct an objective function that consists of a quadratic approximation term and a penalty term. Thanks to the quadratic approximation, we can deal with various kinds of loss functions into a unified way, and by taking advantage of the penalty term, we can simultaneously execute variable selection and parameter estimation. In this article, we show that our estimator has oracle properties, and even better property. We also treat an stochastic processes as applications.