In this paper, we propose three new predictive models: the multi-step nonparametric predictive regression model and the multi-step additive predictive regression model, in which the predictive variables are locally stationary time series; and the multi-step time-varying coefficient predictive regression model, in which the predictive variables are stochastically nonstationary. We also establish the estimation theory and asymptotic properties for these models in the short horizon and long horizon case. To evaluate the effectiveness of these models, we investigate their capability of stock return prediction. The empirical results show that all of these models can substantially outperform the traditional linear predictive regression model in terms of both in-sample and out-of-sample performance. In addition, we find that these models can always beat the historical mean model in terms of in-sample fitting, and also for some cases in terms of the out-of-sample forecasting.