How to calculate Akaike information criterion with probability distribution function?

Akaike information criterion (ACI) is the most useful indicator to select variables in multivariate analysis. It’s assumed that N is free parameter number, ACI is calculated as below;

$\displaystyle AIC = -2(Maximum\ Log\ Likelihood)+2N$

Free parameter number of model is dimension of the space that parameter value could take in expected models. AIC is an evaluation criterion when expected model is estimated with maximum likelihood method and it indicates that log likelihood bias approximates to free parameter number included in model.

How to find maximum log likelihood? Let’s define log likelihood function as following equation;

$\displaystyle l(\theta) = \sum_{\alpha=1}^{n}\log f(x_{\alpha}|\theta)$

$\hat\theta$ , that is maximum likelihood estimator, maximizes l(θ) and this is called as maximum-likelihood method. $l(\hat\theta) = \Sigma_{\alpha=1}^{n}\log f(x_\alpha |\hat\theta)$ is called as maximum log-likelihood.

If log likelihood function (l(θ)) could be differentiable, maximum likelihood estimator ( $\hat\theta$ ) would be given by solving differentiated likelihood equation.

$\displaystyle \frac{\partial l(\theta)}{\partial \theta} = 0$

References:
Probability density function, expected value and variance of each probability distribution

Pocket

投稿者: admin

趣味：写真撮影とデータベース．カメラ：TOYO FIELD, Hasselblad 500C/M, Leica M6． SQL Server 2008 R2, MySQL, Microsoft Access． admin のすべての投稿を表示

月	火	水	木	金	土	日
1	2	3	4	5	6	7
8	9	10	11	12	13	14
15	16	17	18	19	20	21
22	23	24	25	26	27	28
29	30

投稿者: admin

コメントを残す コメントをキャンセル

コメントを残すコメントをキャンセル