Dual Problems in Property Testing Roei Tell, Weizmann Institute of Science ITCS, January 2016

Property Testing Distinguish between objects that:

> Have the property > Far from having the property

A Broad Question What happens when the property that we want to test is “being far from a set”?

Example: -

Test the property of graphs that are far from being connected

A Broad Question Distinguish between objects that are:

> Far from the set > Far from any object that is far from the set

Distinguish between: -

Graph is far from connected Graph is far from any graph that is far from connected

Dual Problems Standard Problem:

Dual Problem:

> Fε(Π)={ objects that are ε-far from Π }

x∈Π x∈Fε(Π)

vs

x∈Fε(Π)

vs

x∈Fε(Fε(Π))

Dual Problems Standard Problem:

Dual Problem:

> Fε(Π)={ objects that are ε-far from Π }

x∈Π x∈Fε(Π)

vs

≠ vs

x∈Fε(Π) x∈Fε(Fε(Π))

Dual Problems: Overview > Question has not been asked so far > Current work - first exploration: ● Non-triviality, different from original problems ● Testers for several prominent dual problems ● Identify specific setting of interest - graphs

Non-Triviality of Dual Problems

Non-Triviality: Example

Π Fε(Π) Fε(Fε(Π))

Non-Triviality: Example

Π Fε(Π) Fε(Fε(Π))

Non-Triviality: Example

Π Fε(Π) Fε(Fε(Π))

Non-Triviality: Basic Facts 1. A random* property Π satisfies Fε(Fε(Π))≠Π. 2. Π⊆Fε(Fε(Π)), but Fε(Fε(Π)) can be much larger than Π.** 3. Fε(Fε(Π)) can contain points that are almost ε-far from Π.

* In {0,1}n and in other classes of metric spaces. ** In {0,1}n the set Fε(Fε(Π)) can be exp(n) larger, even for a small ε.

Non-Triviality: More Examples Π≠Fε(Fε(Π)) > graph properties > > > > > > >

k-colorable graphs with large clique graphs isomorphic to a given graph connected cycle-free bipartite ...

} }

dense graphs model

bounded-degree graphs model

Dual Problems: What we Know

Our Main Results > The query complexity of dual testing problems ■ General lower bounds ■ Testers for specific problems

> The behavior of “far-from-far” sets ■ “Far-from-far” closure operator ■ Not presented in this talk

Our Main Results: General Lower Bounds Thm 1: The query complexity of any dual problem is lower bounded by that of the original problem.

Thm 2: Testing any dual problem with one-sided error requires a linear number of queries (unless Fε(Π)=Ø).

Our Main Results: General Lower Bounds Thm 1: The query complexity of any dual problem is lower bounded by that of the original problem. Pf:

Standard:

Π

Dual:

Fε(Π)



Fε(Π) Fε(Fε(Π))

Thm 2: Testing any dual problem with one-sided error requires a linear number of queries (unless Fε(Π)=Ø).

Our Main Results: Specific Upper Bounds > Testers via equivalence to the original problem ( Π=Fε(Fε(Π)) )

Thm 3: The following dual problems are equivalent to the original problems: 1. Testing whether a string is far from a code. * 2. Testing whether a function is far from monotone. ** 3. Testing whether a distribution is far from uniform. *** * A code with constant relative distance. ** Functions D→R such that the width of D is bounded (includes functions {0,1}n⟶{0,1}). *** Generalizes to testing whether a distribution is far from D, if D is from a large class.

Our Main Results: Specific Upper Bounds > Testers via reductions to tolerant testing

Thm 4: For every ε, it is possible to test whether a graph is: 1. Far from k-colorable, with Tower(1/ε) queries. * 2. Far from being connected, with poly(1/ε) queries. ** 3. Far from being cycle-free, with poly(1/ε) queries. **

* Dense graphs model. ** Bounded-degree graphs model.

Reductions to Tolerant Testing > Tolerant testing [PRR]: Distinguish between objects that are ○

0.99ε-close to Π



ε-far from Π

ε-far from Π

Reductions to Tolerant Testing > Tolerant testing [PRR]: Distinguish between objects that are ○

0.99ε-close to Π



ε-far from Π

> Dual reduces to tolerant testing if all points in Fε(Fε(Π)) are 0.99ε-close to Π

Sometimes Fε(Fε(Π)) is 0.99ε-close to Π ...

Π Fε(Π) Fε(Fε(Π))

ε-far from Π

Distinguish

0.99ε-close to Π

... but Fε(Fε(Π)) not always 0.99ε-close to Π

Π Fε(Π) Fε(Fε(Π))

Almost 2ε...

Generalized Version: ε’-far from ε-far Standard Problem: Generalized Dual Problem:

x∈Π

vs

x∈Fε(Π)

x∈Fε(Π) vs x∈Fε’(Fε(Π)) ∀ε’ Generalization

> Fε(Π)={ objects that are ε-far from Π }

Dual Problems: Digest and Current Frontiers

Dual Problems: Key Takeaways > Class of natural and unexplored problems ●

Current work: General lower bounds, six specific testers

> Different from original problems ●

And don’t reduce (in general) to tolerant testing

> Not expecting one global answer ●

Different settings, different behaviors (graphs vs codes)

Dual Problems: Two Frontiers 1. Can a dual problem be more difficult to test than the original problem? ○

Current work: Gap in upper bounds, but no separation

2. Dual problems of graph partition problems ○

Does testing whether a graph is far from having a large clique* reduce to tolerant testing?

* Where “large clique” means clique of density ρ|V|, for a constant predetermined ρ>0.

Thank you! A far-from-far visual game is available at http://sites.google.com/site/roeitell

Dual Problems in Property Testing - MIT CSAIL Theory of Computation

Testing whether a function is far from monotone. **. 3. Testing whether a distribution is far from uniform. ***. > Testers via equivalence to the original problem ...

365KB Sizes 1 Downloads 284 Views

Recommend Documents

Dual Problems in Property Testing - MIT CSAIL Theory of Computation
Thm 3: The following dual problems are equivalent to the original problems: 1. Testing whether a string is far from a code. *. 2. Testing whether a function is far from monotone. **. 3. Testing whether a distribution is far from uniform. ***. > Teste

Power in High-Dimensional Testing Problems - ULB
In the sequel we call tests ... As a consequence, in many high-dimensional testing problems the power .... for all possible rates d(n) at which the dimension of the parameter space can increase ..... that the total variation distance between Nn(θn,n

Power in High-Dimensional Testing Problems - ULB
In regression models power properties of F-tests when the ...... But a(n) → ∞ hence implies (via the triangle inequality, together with dw-continuity of (µ, σ2) ↦→.

Theory of Computation-II
Mar 31, 2014 - Question 2: Show that PCP is decidable relative to ATM. [10]. Question 3: Consider the problem of determining whether a PDA accepts some ...

DUAL THEORY OF CHOICE UNDER MULTIVARIATE RISKS ...
To handle these situations, we need to be able to express utility derived from monetary ... a liquidity and a price risk, collection of payments in different currencies, ...... [17] Villani, C., Topics in Optimal Transportation, Providence: American 

Open Problems in Coding Theory
Email: [email protected] ... Email: [email protected] ..... sarily optimal in the sense that they are the best self-dual codes possible, whereas ...

An Introduction to Property Testing
What if we only want a check that rejects any x such that ~P(x), with probability > 2/3? Can we do better? ... Can we do better? Intuitively, we must expect to look at 'almost all' input bits if we hope to reject x that are only one bit ..... study o

An Introduction to Property Testing
Accuracy or speed? Work hard or cut ... Possibly infeasible if we are doing: internet or genome analysis ... What if we only want a check that rejects any x such.

Problems of Projection Noam Chomsky MIT From its ...
MIT. From its modern origins, generative grammar has been concerned with several ... It does suggest some new research programs, inquiring into apparent.

Theory and Problems of Engineering.pdf
Theory and Pr ... gineering.pdf. Theory and Pr ... gineering.pdf. Open. Extract. Open with. Sign In. Main menu. There was a problem previewing this document.

Ebook A Primer in Econometric Theory (MIT Press ...
PDF A Primer in Econometric Theory (MIT Press) Download Online, A Primer in Econometric Theory (MIT Press) Ebook Download, Read A Primer in Econometric Theory (MIT Press) Ebook Popular, A Primer in Econometric ... statistics and econometrics with mod

ROBUST COMPUTATION OF AGGREGATES IN ...
aggregate statistics (aggregates) amid a group of sensor nodes[18,. 29, 14]. .... and broadcasts a group call message, GCM ≡ (groupid = i), to all its neighbors. 1.3 The ...... [15] J. M. Hellerstein, P. J. Haas, and H. J. Wang, ”Online Aggregati