Density Estimation Main Results Examples

Nonparametric/semiparametric estimation and testing of econometric models with data dependent smoothing parameters Dong Li and Qi Li

Presented by Xiaojun Song (UC3M) March 6th, 2012

,

Density Estimation Main Results Examples

Outline

1 Density Estimation

2 Main Results

3 Examples

,

Density Estimation Main Results Examples

Outline

1 Density Estimation 2 Main Results 3 Examples

,

Density Estimation Main Results Examples

Let X1 , · · · , Xn be strictly stationary ρ, or β, or α mixing data set with density function f (x). The kernel estimator of f (x): n

1 X fˆ(x, h) = k nh t=1



xt − x h

 ,

where k(·) is a non-negative, bounded symmetric second order kernel function, and h is the smoothing parameter.

,

Density Estimation Main Results Examples

Let h0 = h0n be a deterministic sequence that converges to zero. For example, if we choose h0 = b0 n−1/5 for some positive constant b0 , it is well established that ˆ ∆(x, h0 ) := (nh0 )1/2 [fˆ(x, h0 ) − f (x) − B(x)(h0 )2 ] → N (0, V (x)) R 00 2 where R B(x)2 = f (x)κ2 /2, V (x) = κf (x), κ2 = k(v)v dv and κ = k(v) dv. Define m(x, h) = E[fˆ(x, h)] − f (x). Note that ˆ ˆ 1 (x, h0 ) + ∆ ˆ 2 (x, h0 ) with ∆(x, h0 ) = ∆ ˆ 1 (x, h) = (nh)1/2 [fˆ(x, h) − E(fˆ(x, h))], ∆ ˆ 2 (x, h) = (nh)1/2 [m(x, h) − B(x)h2 ]. ∆ Hence prove the claim.

,

Density Estimation Main Results Examples

p ˆ with h/h ˆ 0− → 1. We want Consider a stochastic smoothing parameter h ˆ If one can show that to establish the asymptotic distribution of fˆ(x, h). 0 ˆ ˆ ˆ ˆ ˆ ˆ ∆(x, h) − ∆(x, h ) = op (1), then ∆x, h and ∆(x, h0 ) have the same distribution.

Note ˆ − ∆(x, ˆ −∆ ˆ ˆ ˆ 1 (x, h) ˆ 1 (x, h0 )] ∆(x, h) h0 ) = [∆ ˆ −∆ ˆ 2 (x, h) ˆ 2 (x, h0 )]. + [∆ ˆ and ∆(x, ˆ ˆ Asymptotic equivalence between ∆(x, h) h0 ) follows if one can 0 ˆ −∆ ˆ l (x, h) ˆ l (x, h ) = op (1) for l = 1, 2. show that ∆

,

Density Estimation Main Results Examples

p p ˆ 0− ˆ = ˆbn−1/5 , then h/h → 1 is equivalent to ˆb/b0 − → 1. Define Write h 0 B = [B1 , B2 ] with 0 < B1 < b < B2 < ∞. Define

ˆ l (x, h)|h=bn−1/5 , In,l (b) = ∆

b ∈ B.

for l = 1, 2. ˆ −∆ ˆ 1 (x, h) ˆ 1 (x, h0 ) = op (1) is that A sufficient condition for ∆ E{[In,1 (b0 ) − In,1 (b)]2 } ≤ C(b0 − b)2 for all b, b0 ∈ B. ˆ −∆ ˆ 2 (x, h) ˆ 2 (x, h0 ) = op (1) is that A sufficient condition for ∆ sup |In,2 (b)| = o(1). b∈B

,

Density Estimation Main Results Examples

Recall that E{[In,1 (b0 ) − In,1 (b)]2 } ≤ C(b0 − b)2 implies that the ˆ 1 (x, ·) is tight and stochastically equicontinuous for stochastic process ∆ b ∈ B. That is, for any  > 0, " # lim lim P r

n→∞ δ→0

sup

|In,1 (x, b0 ) − In,1 (x, b)| >  = 0.

b,b0 ∈B:|b−b0 |<δ

,

Density Estimation Main Results Examples

Outline

1 Density Estimation 2 Main Results 3 Examples

,

Density Estimation Main Results Examples

Let Jn (b) denote an estimator or a test statistic that involves some nonparametric estimations. Jn (b) can be a vector, say Jn (b) = (Jn1 (b), · · · , Jnq (b))0 is a q × 1 vector of stochastic process indexed by b, where b = (b1 , · · · , br ) is a r-dimensional parameter that has a one to one correspondence with a set of smoothing parameters: h = (h1 , · · · , hr ) with hj = bj n−δj for some δj > 0 (j = 1, · · · , r). Let b0 = (b01 , · · · , b0r ) denote a set of positive constants, and ˆb = (ˆb1 , · · · , ˆbr ) denote a set of random variables that depend on n. Qr p Assume that ˆbj /b0j − → 1 for all j = 1, · · · , r. Let B = j=1 [B1j , B2j ], where 0 < B1j < b0j < B2j < ∞ for j = 1, · · · , r. Assume that for any give b ∈ B, Jn (b) converges in distribution to J as n → ∞.

,

Density Estimation Main Results Examples

Theorem d

→ J, Let b0 = (b01 , · · · , b0r ) be an interior point in B. Assume Jn (b0 ) − where J denotes the well defined limiting distribution of Jn (b0 ) (it maybe a zero mean normal distribution). Let ˆb = (ˆb1 , · · · , ˆbr ) denote a r-vector of random variables, and assume that kˆb − b0 k = op (1). Then Jn (ˆb) − Jn (b0 ) = op (1), and consequently, d Jn (ˆb) − → J,

provided that for all b, b0 ∈ B E{|Jn (b0 ) − Jn (b)|α } ≤ Ckb0 − bkγ , for some α > 0 and γ > 1.

,

Density Estimation Main Results Examples

Theorem If the stochastic process Jn (b), indexed by b ∈ B, is stochastically equicontinuous, i.e., " # lim lim sup P r

δ→0 n→∞

sup

|Jn (b0 ) − Jn (b)| >  = 0,

b,b0 ∈B:kb−b0 k<δ

the conclusion still holds true. Corollary If we assume further that Jn (b) is non-stochastic, and if uniformly in b ∈ B, |Jn (b)| = o(1), the conclusion holds true.

,

Density Estimation Main Results Examples

Outline

1 Density Estimation 2 Main Results 3 Examples

,

Density Estimation Main Results Examples

Multivariate Regression Estimator

Consider a r-dimensional kernel regression function estimator of g(x) = E(Y |X = x) given by  Pn gˆ(x, h) = (nh1 · · · hr )−1 t=1 K Xth−x Yt /fˆ(x, h). It is well established that  (nh01 · · · h0r )1/2 gˆ(x, h0 ) − g(x) −

r X

 d

Bj (x)(h0j )2  − → N (0, Vreg (x)).

j=1

We want to show that  ˆ1 · · · h ˆ r )1/2 gˆ(x, h) ˆ − g(x) − (nh

r X

 d ˆ 2 − Bj (x)h → N (0, Vreg (x)). j

j=1

,

Density Estimation Main Results Examples

Estimation of Conditional Cumulative Distribution Function Let F (y|x) denote the conditional cumulative distribution function (cdf) of Yt = y given Xt = x. Since F (y|x) = E[1(Yt ≤ x)|Xt = x], we can estimate F (y|x) by  Pn Fˆ (y|x, h) = (nh1 · · · hr )−1 t=1 K Xth−x 1(Yt ≤ y)/fˆ(x, h). With h0j = b0j n−δj for some δj ∈ (1/(r + 6), 1/r), so that n(h0j )r+6 = o(1) and n(h0j )r → ∞,

  r q X d nh01 · · · h0r Fˆ (y|x, h0 ) − F (y|x) − B(x) Bj,cdf (y, x)(h0j )2  − → N (0, Vcdf (x j=1

We want to show that   q r X d ˆ1 · · · h ˆ r Fˆ (y|x, h) ˆ − F (y|x) − B(x) ˆ 2 − nh Bj,cdf (y, x)h → N (0, Vcdf (x)). j j=1

,

Density Estimation Main Results Examples

Estimation of Conditional Quantile Function The conditional αth quantile function of y given x is defined as qα (x) = inf{y : F (y|x) ≥ α} ≡ F −1 (α|x). One can estimate qα (x) by qˆα (x, h) = argmin|Fˆ (q|x, h) − α|. q∈R

With h0j = b0j n−δj for some δj ∈ (1/(r + 6), 1/r),  q

nh01 · · · h0r qˆα (x, h0 ) − qα (x) −

r X

 d

Bj,quan (y, x)(h0j )2  − → N (0, Vquan (x)).

j=1

We want to show that   q r X d ˆ1 · · · h ˆ r qˆα (x, h) ˆ − qα (x) − ˆ 2 − Bj,quan (y, x)h → N (0, Vquan (x)). nh j j=1

,

Density Estimation Main Results Examples

Partially Linear Model A semiparametric partially linear model is given by Yt = Zt0 β + g(Xt ) + ut . Assume h1 = h2 = · · · = hr = h = bn−δ . A density weighted estimator is " βˆh =

n X

#−1 (Zt − Zˆt )fˆt (Zt − Zˆt )0 fˆt

t=1

n X

(Zt − Zˆt )fˆt (Yt − Yˆt )0 fˆt ,

t=1

where Zˆt , Yˆt and fˆt are the kernel estimators of E(Zt |Xt ), E(Yt |Xt ) and f (Xt ), respectively. Fan and Li (1999) proved that √ Once we show that

d

n(βˆh0 − β) − → N (0, Φ−1 ΨΦ−1 ).



n(βˆhˆ − βˆh0 ) = op (1), we have



d

n(βˆhˆ − β) − → N (0, Φ−1 ΨΦ−1 ).

,

Density Estimation Main Results Examples

Specification Test for a Parametric Model For testing a parametric regression functional form, the null hypothesis is stated as H0 : E(Y |X) = α + X 0 β

a.s.,

for some

β ∈ B.

The null hypothesis is equivalent to E(ut |Xt ) = 0 a.s. One can construct a test statistic based on sample analogue of E[ut E(ut |Xt )f (Xt )]. The test statistic is given by Un (b) =

  n X n X 1 xt − xs u ˆ u ˆ K . t s h [n(n − 1)hr ]1/2 t=1 s6=t

Under H0 , Fan and Li (1999) have shown that d

Un (b0 )/ˆ σn (b0 ) − → N (0, 1). We need to show that d

Un (ˆb)/ˆ σn (ˆb) − → N (0, 1). ,

Density Estimation Main Results Examples

A Nonparametric Significance Test

Fan and Li (1996) propose a procedure for testing the following null hypothesis: H0 : E(Yt |Wt = w, Zt = z) = E(Yt |Wt = w) for almost all (w, z). Fan and Li (1996) use the density weighted error to construct the test, i.e., the sample analog of E[ut fw (Wt )E(ut fw (Wt )|Xt )f (Xt )] to test the null hypothesis. The test statistic is given by   n X n X xt − xs 1 ˆ ˆ Vn (a, h) = u ˆt u ˆs fwt fws K , h [n(n − 1)hr ]1/2 t=1 s6=t ˆ−t (Yt |Wt ). where u ˆt = Yt − E

,

Density Estimation Main Results Examples

A Nonparametric Significance Test Cont.

Li (1999) has shown that under the null, Vn (a, h) = Vn,0 (a, h) + (s.o.), with   n X n X 1 xt − xs , Vn,0 (a, h) = u u f f K t s wt ws h [n(n − 1)hr ]1/2 t=1 s6=t

q d ˆ h) − and Vn,0 (a, h)/ Ω(a, → N (0, 1). ˆ = Vn,0 (a0 , h0 ) + op (1) and If we show that Vn,0 (ˆ a, h) 0 0 ˆ = Ω(a ˆ a, h) ˆ , h ) + op (1), we have Ω(ˆ q d ˆ − ˆ ˆ a, h) Vn,0 (ˆ a, h)/ Ω(ˆ → N (0, 1). q d ˆ ˆ − ˆ a, h) Hence Vn (ˆ a, h)/ Ω(ˆ → N (0, 1).

,

Density Estimation Main Results Examples

More Examples

Average derivative estimator Powell et al. (1989). Smooth maximum score estimator of Horowitz (1992). Single index model estimator of Ichimura (1993).

,

Thanks for your time!

,

Nonparametric/semiparametric estimation and testing ...

Mar 6, 2012 - Density Estimation Main Results Examples ..... Density Estimation Main Results Examples. Specification Test for a Parametric Model.

205KB Sizes 1 Downloads 280 Views

Recommend Documents

Nonparametric/semiparametric estimation and testing ...
Mar 6, 2012 - Consider a stochastic smoothing parameter h with h/h0 p−→ 1. We want to establish the asymptotic distribution of ˆf(x, h). If one can show that.

Spatial dependence models: estimation and testing -
Course Index. ▫ S1: Introduction to spatial ..... S S. SqCorr Corr y y. = = ( ). 2. ,. IC. L f k N. = − +. 2. 2. ' ln 2 ln. 0, 5. 2. 2 n n. e e. L π σ σ. = −. −. −. ( ),. 2 f N k k. = ( ).

Testing and Measuring Instruments
United Systems & Automation is a business enterprise deals in testing, measuring instruments and automation products and it is one of the fastest-growing Automation company in Mohali Punjab. Having built a large clientele in the domestic market, our

white box testing and blackbox testing pdf
There was a problem previewing this document. Retrying... Download. Connect more apps... Try one of the apps below to open or edit this item. white box testing ...

white box testing and blackbox testing pdf
testing pdf. Download now. Click here if your download doesn't start automatically. Page 1 of 1. white box testing and blackbox testing pdf. white box testing and ...

Identification, Estimation and Inference
E Fs t. 4. ≤ M < ∞, T−1 ∑T t=1 Fs t Fs t p. → ΣFs for some r ×r p.d.. ΣFs , s = 1,...,S. • Ht = [Gt,Ft ] . T−1 ∑T t=1 HtHt p. → ΣH for p.d. ΣH with rank r +r1 +...+rs and ...

IMPORT BANS, AND TESTING AND CERTIFICATION REQUIREMENT
Aug 21, 2015 - Press release by MIFAFF, dated 9 May 2012, "Temporary ban on import of panther puffer from Miyagi-ken"; n. Press release by MIFAFF, dated ...

IMPORT BANS, AND TESTING AND CERTIFICATION REQUIREMENT
Aug 21, 2015 - certain measures of the Republic of Korea ("Korea"), in the form of import ..... MFDS Notice of Temporary Special Measure for Safety for Food ...

DECENTRALIZED ESTIMATION AND CONTROL OF ...
transmitted by each node in order to drive the network connectivity toward a ... Numerical results illustrate the main features ... bile wireless sensor networks.

CE6704-Estimation and Quantity Surveying.pdf
9 Briefly explain various types of estimates in detail? BT-3. Page 3 of 12. CE6704-Estimation and Quantity Surveying.pdf. CE6704-Estimation and Quantity ...

Identification and Semiparametric Estimation of ...
An important insight from these models is that plausible single-crossing assump- ...... in crime and commuting time to the city center in estimation using a partially.

Estimation, Optimization, and Parallelism when ... - Semantic Scholar
Nov 10, 2013 - Michael I. Jordan. H. Brendan McMahan. November 10 ...... [7] J. Ma, L. K. Saul, S. Savage, and G. M. Voelker. Identifying malicious urls: An ...

Maxime Rizzo_Attitude estimation and control for BETTII.pdf ...
Page 1 of 2. Stand 02/ 2000 MULTITESTER I Seite 1. RANGE MAX/MIN VoltSensor HOLD. MM 1-3. V. V. OFF. Hz A. A. °C. °F. Hz. A. MAX. 10A. FUSED. AUTO HOLD. MAX. MIN. nmF. D Bedienungsanleitung. Operating manual. F Notice d'emploi. E Instrucciones de s

Maxime Rizzo_Attitude estimation and control for BETTII.pdf ...
Maxime Rizzo_Attitude estimation and control for BETTII.pdf. Maxime Rizzo_Attitude estimation and control for BETTII.pdf. Open. Extract. Open with. Sign In.

Noise-contrastive estimation: A new estimation principle for ...
Any solution ˆα to this estimation problem must yield a properly ... tion problem.1 In principle, the constraint can always be fulfilled by .... Gaussian distribution for the contrastive noise. In practice, the amount .... the system to learn much

Component Testing
Jul 8, 2002 - silicon atom. ... you really have to understand the nature of the atom. ..... often that you see a desktop computer burst into flames and burn down ...

Age estimation of faces: a review - Dental Age Estimation
Feb 27, 2008 - The current paper reviews data on the ... service) on the basis of age. ... than the remainder of the face and a relatively small, pug-like nose and ..... For example, does wearing formal attire such as a business suit, associated with

Component Testing
Jul 8, 2002 - use a meter to test suspect components and troubleshoot electronic circuits. ..... The valence electron is held loosely to the atom and moves.

Testing Computational Models of Dopamine and ... - CiteSeerX
performance task, ADHD participants showed reduced sensitivity to working memory contextual ..... perform better than chance levels during the test phase2.