Stochastic Models in Probability and Statistics

Stochastic Models in Probability and Statistics

Quasi-identifiability of multipath change-point models with general link functions

Document Type : Original Article

Author
Department of Statistics, Faculty of Mathematical Sciences, Shahid Beheshti University, Tehran, Iran
Abstract
The non-singularity of the Fisher information matrix is a fundamental requirement for standard asymptotic inference. The framework developed by Asgharian (2014) shows that, for identifiable and smooth models, the set of singular parameter values is negligible. This result was previously established for multipath change-point (MCP) models in which the change hazard is specified through a proportional odds ratio structure. In this work, we substantially broaden that setting by proving the quasi-identifiability of MCP models under a general class of strictly monotone link functions, encompassing the probit, logit, and complementary log-log models as special cases. Our main result demonstrates that, for this broad family of models, the injectivity of the link function is sufficient to guarantee quasi- identifiability under standard regularity conditions. Consequently, the general singularity theory applies directly, implying that the Fisher information matrix is nonsingular for almost all parameter values. This, in turn, justifies standard likelihood-based inference for a considerably wider and more flexible class of models
Keywords

  1. Asgharian, M. (2014). On the singularities of the information matrix and multipath change-point problems. Theory of Probability and Its Applications, 58, 546–561.
  2. Asgharian, M. and Wolfson, D. B. (2001). Covariates in multipath change-point problems: Modelling and consistency of the MLE. Canadian Journal of Statistics, 29, 515–528.
  3. Chen, J. (1995). Optimal rate of convergence for finite mixture models. The Annals of Statistics, 23, 221–233.
  4. Joseph, L., Vandal, A. C., and Wolfson, D. B. (1996). Estimation in the multipath change point problem for correlated data. The Canadian Journal of Statistics, 24, 37–53.
  5. Joseph, L. and Wolfson, D. B. (1992). Estimation in multi-path change-point problems. Communications in Statistics-Theory and Methods, 21, 897–913.
  6. Joseph, L. and Wolfson, D. B. (1993). Maximum likelihood estimation in the multi-path change-point problem. Annals of the Institute of Statistical Mathematics, 45, 511–530.
  7. Kim, D. and Lindsay, B. G. (2015). Empirical identifiability in finite mixture models. Annals of the Institute of Statistical Mathematics, 67, 745–772.
  8. Lindsay, B. G. (1995). Mixture Models: Theory, Geometry, and Applications. NSF-CBMS Regional Conference Series in Probability and Statistics. Institute of Mathematical Statistics; Penn. State University.
  9. Manole, T. and Ho, N. (2020). Uniform convergence rates for maximum likelihood estimation under two-component Gaussian mixture models. arXiv preprint arXiv:2006.00704.
  10. McLachlan, G. J., Lee, S. X., and Rathnayake, S. I. (2019). Finite mixture models. Annual Review of Statistics and Its Application, 6(, 355–378.
  11. Shohoudi, A., Khalili, A., Wolfson, D. B., and Asgharian, M. (2016). Simultaneous variable selection and de-coarsening in multi-path change-point models. Journal of Multivariate Analysis, 143, 15–429.
  12. Teicher, H. (1963). Identifiability of finite mixtures. The Annals of Mathematical Statistics, 34, 1265–1269.
  13. Titterington, D. M., Smith, A. F., and Makov, U. E. (1985). Statistical Analysis of Finite Mixture
    Distributions. John Wiley & Sons, New York.
  14. Wang, X. (1993). Non-singularity of fisher information for autoregressive moying-average processes. Journal of Time Series Analysis, 14, 547–548
Send comment about this article
Enter Name.
Enter a valid email address.
Enter a vaid affiliation.
Enter comments (At leaset 10 words)
CAPTCHA Image
Enter Security Code Correctly.