To read this content please select one of the options below:

Model selection in time series analysis: using information criteria as an alternative to hypothesis testing

R. Scott Hacker (Jonkoping International Business School, Jönköping University, Jönköping, Sweden)
Abdulnasser Hatemi-J (College of Business and Economics, UAE University, Al Ain, United Arab Emirates)

Journal of Economic Studies

ISSN: 0144-3585

Article publication date: 20 September 2021

Issue publication date: 24 August 2022

220

Abstract

Purpose

The issue of model selection in applied research is of vital importance. Since the true model in such research is not known, which model should be used from among various potential ones is an empirical question. There might exist several competitive models. A typical approach to dealing with this is classic hypothesis testing using an arbitrarily chosen significance level based on the underlying assumption that a true null hypothesis exists. In this paper, the authors investigate how successful the traditional hypothesis testing approach is in determining the correct model for different data generating processes using time series data. An alternative approach based on more formal model selection techniques using an information criterion or cross-validation is also investigated.

Design/methodology/approach

Monte Carlo simulation experiments on various generating processes are used to look at the response surfaces resulting from hypothesis testing and response surfaces resulting from model selection based on minimizing an information criterion or the leave-one-out cross-validation prediction error.

Findings

The authors find that the minimization of an information criterion can work well for model selection in a time series environment, often performing better than hypothesis-testing strategies. In such an environment, the use of an information criterion can help reduce the number of models for consideration, but the authors recommend the use of other methods also, including hypothesis testing, to determine the appropriateness of a model.

Originality/value

This paper provides an alternative approach for selecting the best potential model among many for time series data. It demonstrates how minimizing an information criterion can be useful for model selection in a time-series environment in comparison to some standard hypothesis testing strategies.

Keywords

Acknowledgements

Conflict of interest: There are no conflict of interests in publishing this paper.Previous versions of this paper were presented at the Queensland University of Technology, Deakin University, the UAE University and the Econometric Society Meeting of 2019 in Rabat. The authors thank the participants at these presentations for their comments. The usual disclaimer applies however.

Citation

Hacker, R.S. and Hatemi-J, A. (2022), "Model selection in time series analysis: using information criteria as an alternative to hypothesis testing", Journal of Economic Studies, Vol. 49 No. 6, pp. 1055-1075. https://doi.org/10.1108/JES-09-2020-0469

Publisher

:

Emerald Publishing Limited

Copyright © 2021, Emerald Publishing Limited

Related articles