Akaike information criterion (ACI) is the most useful indicator to select variables in multivariate analysis. It’s assumed that N is free parameter number, ACI is calculated as below;<\/p>\n

$\\displaystyle AIC = -2(Maximum\\ Log\\ Likelihood)+2N$ <\/p>\n<\/p>\n

Free parameter number of model is dimension of the space that parameter value could take in expected models. AIC is an evaluation criterion when expected model is estimated with maximum likelihood method and it indicates that log likelihood bias approximates to free parameter number included in model. <\/p>\n

How to find maximum log likelihood? Let’s define log likelihood function as following equation; <\/p>\n

$\\displaystyle l(\\theta) = \\sum_{\\alpha=1}^{n}\\log f(x_{\\alpha}|\\theta)$ <\/p>\n<\/p>\n

$\\hat\\theta$ , that is maximum likelihood estimator, maximizes l<\/em>(θ<\/em>) and this is called as maximum-likelihood method. $l(\\hat\\theta) = \\Sigma_{\\alpha=1}^{n}\\log f(x_\\alpha |\\hat\\theta)$ is called as maximum log-likelihood. <\/p>\n

If log likelihood function (l<\/em>(θ<\/em>)) could be differentiable, maximum likelihood estimator ( $\\hat\\theta$ ) would be given by solving differentiated likelihood equation. <\/p>\n

$\\displaystyle \\frac{\\partial l(\\theta)}{\\partial \\theta} = 0$ <\/p>\n<\/p>\n

References:
\nProbability density function, expected value and variance of each probability distribution<\/a><\/p>\n<\/div>","protected":false},"excerpt":{"rendered":"

Akaike information criterion (ACI) is the most useful indicator to select variables in multivariate analysis. … “How to calculate Akaike information criterion with probability distribution function?” \u306e<\/span>\u7d9a\u304d\u3092\u8aad\u3080<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[7],"tags":[],"class_list":["post-3798","post","type-post","status-publish","format-standard","hentry","category-statistics"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t