The Polynomial Hierarchy And Randomized Computations Complexity D
- Slides: 27
The Polynomial Hierarchy And Randomized Computations Complexity ©D. Moshkovitz 1
Introduction • Objectives: – To present the polynomial hierarchy (PH) – To show the connection to BPP • Overview: – satisfiability and PH – probabilistic TMs and BPP – BPP 2 Complexity ©D. Moshkovitz 2
Deciding Satifiability We’ve already seen, that deciding whether a formula is satisfiable… the number of adjacent existential quantifiers is not important: the y in y may encode a tuple (x 1, …, xk) x 1 …xn(x 1 x 2 x 8) … ( x 6 x 3) only existential quantifier Complexity ©D. Moshkovitz x 1 x 2 x 3… [(x 1 x 2 x 8) … ( x 6 x 3)] existential & universal quantifiers 3
The Hierarchy Definition ( i): i is the class of all languages reducible to deciding the sat. of a formula of type: x 1 x 2 x 3… R(x 1, x 2, x 3, …) i alternating quantifiers Complexity ©D. Moshkovitz 4
The Hierarchy Definition ( i): i is the class of all languages reducible to deciding the sat. of a formula of type: x 1 x 2 x 3… R(x 1, x 2, x 3, …) i alternating quantifiers Complexity ©D. Moshkovitz 5
PH (Polynomial Hierarchy) Definition: PH = Complexity ©D. Moshkovitz i 1 i 6
Simple Observations • “base”: 1=NP • “connection between and ”: i i+1 “upper bound”: PH PSPACE i=co i • “hierarchy”: • Complexity ©D. Moshkovitz 7
Can the Hierarchy Collapse? Proposition: If NP=co. NP, then PH=NP. Proof Idea: By induction on i, i=NP. Complexity ©D. Moshkovitz 8
Probabilistic Turing Machines • Probabilistic TMs have an “extra” tape: the random tape “standard” TMs M(x) content of input tape Complexity ©D. Moshkovitz probabilistic TMs Prr[M(x, r)] content of random tape 9
Does It Really Capture The Notion of Randomized Algorithms? It doesn’t matter if you toss all your coins in advance or throughout the computation… Complexity ©D. Moshkovitz 10
BPP (Bounded-Probability Polynomial-Time) Definition: BPP is the class of all languages L which have a probabilistic polynomial time TM M, s. t L(x)=1 x L x Prr[M(x, r) = L(x)] 2/3 such TMs are called ‘Atlantic City’ Complexity ©D. Moshkovitz 11
BPP Illustrated For any input x, Note: TMs which are right for most x’s (e. g for PRIMES: always say ‘NO’) are NOT acceptable! all random strings for which M is right Complexity ©D. Moshkovitz 12
Amplification Claim: If L BPP, then there exists a probabilistic polynomial TM M’, and a polynomial p(n) s. t x {0, 1}n Prr {0, 1}p(n)[M’(x, r) L(x)] < 1/(3 p(n)) We can get better amplifications, but this will suffice. . . Complexity ©D. Moshkovitz 13
Proof Idea • Repeat – Pick r uniformly at random – Simulate M(x, r) • Output the majority answer Complexity ©D. Moshkovitz r M(x, r) 0111001 Yes 1011100 Yes 0001001 No 1100000 Yes 0010011 No 0110001 Yes 14
Relations to P and NP P ? BPP NP ignore the random input Complexity ©D. Moshkovitz 15
Does BPP NP? We may have considered saying: “Use the random string as a witness” Why is that wrong? Because non-members may be recognized as members Complexity ©D. Moshkovitz 16
“Some Comfort” Theorem (Sipser, Lautemann): BPP 2 Underlying observation: L BPP there exists a poly. probabilistic TM M, s. t for any n and x {0, 1}n there is m s. t x L s 1, …, sm {0, 1}m r {0, 1}m 1 i m. M(x, r si)=1 Make sure you understand why theorem follows Complexity ©D. Moshkovitz 17
Our Starting Point n bits • L BPP • By amplification, there’s a poly-time machine M which – uses m random coins – errs w. p < 1/3 m x m bits r M x L? false for less than 1/3 m of the r’s Complexity ©D. Moshkovitz 18
Proving the Underlying Observation We will follow the Probabilistic Method Prr[r has property P] > 0 r with property P Complexity ©D. Moshkovitz 19
First Direction • Let x L. • We want s 1, …, sm {0, 1}m s. t r {0, 1}m 1 i m. M(x, r si)=1 • So we’ll bound the probability over si’s that it doesn’t hold. Complexity ©D. Moshkovitz 20
Bounding The Probability Random si’s Do Not Satisfy This unionbound si’s independent r: s is random r s is random x L Complexity ©D. Moshkovitz 21
Second Direction • Let x L. • Let s 1, …, sm {0, 1}m. • We want r {0, 1}m s. t 1 i m. M(x, r si)=0 • So we’ll bound the probability over r that it doesn’t hold. Complexity ©D. Moshkovitz 22
Bounding The Probability Random r Does Not Satisfy This unionbound x L Complexity ©D. Moshkovitz 23
Q. E. D! It follows that: L BPP there’s a poly. prob. TM M, s. t for any x there is m s. t x L s 1, …, sm r 1 i m. M(x, r si)=1 Thus, L 2 BPP 2 Complexity ©D. Moshkovitz 24
Summary • We defined the polynomial hierarchy – Saw NP PH PSPACE – NP=co. NP PH=NP (“the hierarchy collapses”) Complexity ©D. Moshkovitz 25
Summary • We presented probabilistic TMs – We defined the complexity class BPP – We saw how to amplify randomized computations – We proved P BPP 2 Complexity ©D. Moshkovitz 26
Summary • We also presented a new paradigm for proving existence utilizing the algebraic tools of probability theory The probabilistic method Prr[r has property P] > 0 r with property P Complexity ©D. Moshkovitz 27
- Randomized polynomial time
- Randomized polynomial time
- Time space complexity of algorithm
- Incrementalizing graph algorithms
- Embarrassingly parallel
- Time hierarchy theorem proof
- Matplotlib inline
- How to divide a polynomial by another polynomial
- Randomized algorithms and probabilistic analysis
- Completely randomized design
- Randomized skip list
- Randomized group design
- Duncan's multiple range test
- Advantages of rcbd
- "randomized complete block design" "with replication"
- Types of randomized algorithms
- Rcbd meaning in research
- Crd lab
- Randomized hill climbing
- Completely randomized design
- Expected running time of randomized algorithm
- Randomized design
- Randomized hill climbing
- Blok atau kelompok bias berupa
- Statistical model for crd
- Factorial randomized block design
- Advantage of randomized controlled trial
- How to pronounce nivolumab