Curse of Dimensionality in Approximation of Random Fields Mikhail Lifshits and Ekaterina Tulyakova Consider a random field of tensor product type X(t), t ∈ [0, 1]d , given by d d X Y Y ξk X(t) = λ(kl ) ϕkl (tl ), k∈Nd

l=1

l=1

where (λ(i))i>0 ∈ `2 , (ϕi )i>0 is an orthonormal system in L2 [0, 1] and (ξk )k∈Nd are noncorrelated random variables with zero mean and unit variance. We investigate the quality of approximation (both in the average and in the probabilistic sense) to X by the n-term partial sums Xn minimizing the quadratic error EkX − Xn k2 . In the first part of the article we consider the case of fixed dimension d. In the second part, following the suggestion of H.Wo´zniakowski, we consider the same problem for d → ∞. We show that, for any fixed level of relative error, approximation complexity increases exponentially and find the explosion coefficient. We also show that the behavior of the probabilistic and average complexity is essentially the same in the large domain of parameters.

1

Curse of Dimensionality in Approximation of Random Fields Mikhail ...

Curse of Dimensionality in Approximation of Random Fields. Mikhail Lifshits and Ekaterina Tulyakova. Consider a random field of tensor product type X(t),t ∈ [0 ...

54KB Sizes 1 Downloads 244 Views

Recommend Documents

Small Deviations of Gaussian Random Fields in Lq-spaces Mikhail ...
We investigate small deviation properties of Gaussian random fields in the space Lq(RN ,µ) where µ is an arbitrary finite compactly supported Borel measure. Of special interest are hereby “thin” measures µ, i.e., those which are singular with

Approximation Complexity of Additive Random Fields ...
of Additive Random Fields. Mikhail Lifshits and Marguerite Zani. Let X(t, ω),(t, ω) ∈ [0,1]d × Ω be an additive random field. We investigate the complexity of finite ...

Tail measures of stochastic processes or random fields ...
bi > 0 (or ai > 0, bi = 0) for some i ∈ {1,...,m + 1}, then 0F ∈ (−a,b)c; therefore, ..... ai. )α for every s ∈ E. Therefore, we only need to justify taking the limit inside.

Co-Training of Conditional Random Fields for ...
Bootstrapping POS taggers using unlabeled data. In. CoNLL-2003. [26] Berger, A., Pietra, A.D., and Pietra, J.D. A maximum entropy approach to natural language processing. Computational Linguistics, 22(1):39-71,. 1996. [26] Kudo, T. and Matsumoto, Y.

On the Fisher's Z transformation of correlation random fields (PDF ...
Our statistics of interest are the maximum of a random field G, resulting from the .... by a postdoctoral fellowship from the ISM-CRM, Montreal, Quebec, Canada. 1.

Random Multi-Overlap Structures and Cavity Fields in ... - Springer Link
NJ 08544–1000, USA; e-mail: [email protected]. 785 ... We will have in mind a lattice with a large bulk of N sites (cavity) and M additional spins (N is ...

Random Multi-Overlap Structures and Cavity Fields in ... - Springer Link
1Department of Mathematics, Princeton University, Fine Hall, Washington Road, Princeton,. NJ 08544–1000 ... the spin variables, to be specified each time.

Speech Recognition with Segmental Conditional Random Fields
learned weights with error back-propagation. To explore the utility .... [6] A. Mohamed, G. Dahl, and G.E. Hinton, “Deep belief networks for phone recognition,” in ...

Jittered random sampling with a successive approximation ADC.pdf ...
Georgia Institute of Technology, 75 Fifth Street NW, Atlanta, GA 30308. Abstract—This paper ... result, variable word length data samples are produced by the ... Successive Sine Matching Pursuit (SSMP) is proposed to recover. spectrally ...

Transferred Dimensionality Reduction
propose an algorithm named Transferred Discriminative Analysis to tackle this problem. It uses clustering ... cannot work, as the labeled and unlabeled data are from different classes. This is a more ... Projection Direction. (g) PCA+K-means(bigger s

Comparison of Dimensionality Reduction Techniques ...
In many domains, dimensionality reduction techniques have been shown to be very effective for elucidating the underlying semantics of data. Thus, in this paper we investigate the use of various dimensionality reduction techniques (DRTs) to extract th

Context-Specific Deep Conditional Random Fields - Sum-Product ...
In Uncertainty in Artificial Intelli- gence (UAI), pp ... L. R. Rabiner. A tutorial on hidden markov models and ... ceedings of 13th Conference on Artificial Intelligence.

mikhail blagodatkov
Microsoft.NET Framework 4.0-3.x-2.0-1.x, Microsoft.NET Compact Framework, LINQ, ActiveX, COM/DCOM, WIN32 API, OLE. 12/2009- present. Litmark Inc. Contract Software Engineer. Worked on software solution. Developed database, program for managers, repor

Ergodicity and Gaussianity for spherical random fields - ORBi lu
hinges on the fact that one can regard T as an application of the type T: S2 ..... analysis of isotropic random fields is much more recent see, for instance, Ref. ...... 47 Yadrenko, M. I˘., Spectral Theory of Random Fields Optimization Software, In

Ergodicity and Gaussianity for spherical random fields - ORBi lu
the cosmic microwave background CMB radiation, a theme that is currently at the core of physical ..... 14 , we rather apply some recent estimates proved in Refs.

Ergodicity and Gaussianity for spherical random fields
From a mathematical point of view, the CMB can be regarded as a single realization of ... complete orthonormal system for the L2 S2 space of square-integrable ...... 5 Biedenharn, L. C. and Louck, J. D., The Racah-Wigner Algebra in Quantum ...

Random Fields - Union Intersection tests for detecting ...
Statistical Parametric Mapping (SPM) for these two situations be developed separately. In ... Mapping (SPM) approach based on Random Field Theory (RFT).

Conditional Random Fields with High-Order Features ...
synthetic data set to discuss the conditions under which higher order features ..... In our experiment, we used the Automatic Content Extraction (ACE) data [9], ...

Properties of the Stochastic Approximation Schedule in ...
the desired frequencies. Behaviour of the penalties. For fixed γ, θt does not converge but seems stable, and its variations decrease with the number of chains.

Conditional Random Fields for brain tissue ... - Swarthmore's CS
on a segmentation approach to be (1) robust to noise, (2) able to handle large variances ... cation [24]. Recent years have seen the emergence of Conditional Random Fields .... The Dice index measures the degree of spatial overlap between ...

FINITE FIELDS Contents 1. Finite fields 1 2. Direct limits of fields 5 ...
5. References. 6. 1. Finite fields. Suppose that F is a finite field and consider the canonical homomorphism. Z → F. Since F is a field its kernel is a prime ideal of Z ...