Language Recognition 11 4 and Turing Machines 11
- Slides: 136
Language Recognition (11. 4) and Turing Machines (11. 5) Longin Jan Latecki Temple University Based on slides by Costas Busch from the course http: //www. cs. rpi. edu/courses/spring 05/modcomp/ and … 1
Three Equivalent Representations Regular expressions Finite automata Each can describe the others Regular languages Kleene’s Theorem: For every regular expression, there is a deterministic finite-state automaton that defines the same language, and vice versa. 2
EXAMPLE 1 Consider the language { ambn | m, n N}, which is represented by the regular expression a*b*. A regular grammar for this language can be written as follows: S | a. S | B B b | b. B. 3
Regular Expression Regular Grammar a* (a+b)* a* + b* a*b ba* (ab)* S | a. S | b. S S |A|B A a | a. A B b | b. B S b | a. S S b. A A | a. A S | ab. S 4
NFAs Regular grammars Thus, the language recognized by FSA is a regular language Every NFA can be converted into a corresponding regular grammar and vice versa. Each symbol A of the grammar is associated with a nonterminal node of the NFA s. A, in particular, start symbol S is associated with the start state s. S. Every transition is associated with a grammar production: T(s. A, a) = s. B A a. B. Every production B is associated with final state s. B. See Ex. 3, p. 771, and Ex. 4, p. 772. 5
Kleene’s Theorem Languages Generated by Regular Expressions Languages Recognized by FSA 6
We will show: Languages Generated by Regular Expressions Languages Recognized by FSA 7
Proof - Part 1 Languages Generated by Regular Expressions Languages Recognized by FSA For any regular expression the language is recognized by FSA (= is a regular language) Proof by induction on the size of 8
Induction Basis Primitive Regular Expressions: NFAs regular languages 9
Inductive Hypothesis Assume for regular expressions and that and are regular languages 10
Inductive Step We will prove: Are regular Languages 11
By definition of regular expressions: 12
By inductive hypothesis we know: and are regular languages We need to show: Regular languages are closed under: Union Concatenation Star This fact is illustrated in Fig. 2 on p. 769. 13
Therefore: Are regular languages And trivially: is a regular language 14
Proof - Part 2 Languages Generated by Regular Expressions Languages Recognized by FSA For any regular language there is a regular expression with Proof by construction of regular expression 15
Since NFA is regular take that accepts it Single final state 16
From construct the equivalent Generalized Transition Graph in which transition labels are regular expressions Example: 17
Another Example: 18
Reducing the states: 19
Resulting Regular Expression: 20
In General Removing states: 21
The final transition graph: The resulting regular expression: 22
Models of computing DFA Push down automata Bounded Turing M’s Turing machines - regular languages Context-free Context sensitive Phrase-structure 23
Foundations The theory of computation and the practical application it made possible — the computer — was developed by an Englishman called Alan Turing. 24
Alan Turing 1912 (23 June): Birth, Paddington, London 1939 -42: Breaking of U-boat Enigma, saving battle of the Atlantic 1931 -34: Undergraduate at King's College, Cambridge University 1946: Computer and software design leading the world. 1932 -35: Quantum mechanics, probability, logic 1948: Manchester University 1936: The Turing machine, computability, universal machine 1936 -38: Princeton University. Ph. D. Logic, algebra, number theory 1938 -39: Return to Cambridge. Introduced to German Enigma cipher machine 1939 -40: The Bombe, machine for Enigma decryption 1949: First serious mathematical use of a computer 1950: The Turing Test for machine intelligence 1952: Arrested as a homosexual, loss of security clearance 1954 (7 June): Death (suicide) by cyanide poisoning, Wilmslow, Cheshire. —from Andrew Hodges http: //www. turing. org. uk/turing/ 25
The Decision Problem In 1928 the German mathematician, David Hilbert (1862 -1943), asked whethere could be a mechanical way (i. e. by means of a fully specifiable set of instructions) of determining whether some statement in a formal system like arithmetic was provable or not. In 1936 Turing published a paper the aim of which was to show that there was no such method. “On computable numbers, with an application to the Entscheidungs problem. ” Proceedings of the London Mathematical Society, 2(42): 230 -265. 26
The Turing Machine In order to argue for this claim, he needed a clear concept of “mechanical procedure. ” His idea — which came to be called the Turing machine — was this: (1) A tape of infinite length (2) Finitely many squares of the tape have a single symbol from a finite language. (3) Someone (or something) that can read the squares and write in them. (4) At any time, the machine is in one of a finite number of internal states. (5) The machine has instructions that determine what it does given its internal state and the symbol it encounters on the tape. It can change its internal state; change the symbol on the square; move forward; move backward; halt (i. e. stop). 27
Current state = 10 If current state = 1 and current symbol = 0 then new state = 10 new symbol = 1 move right 1 0 1 1 1 28
Current state = 10 If current state = 1 and current symbol = 0 then new state = 10 new symbol = 1 move right 1 1 1 29
Current state = 10 If current state = 1 and current symbol = 0 then new state = 10 new symbol = 1 move right 1 1 1 30
Functions It is essential to the idea of a Turing machine that it is not a physical machine, but an abstract one — a set of procedures. It makes no difference whether the machine is embodied by a person in a boxcar on a track, or a person with a paper and pencil, or a smart and well-trained flamingo. 31
Turing’s Theorem In the 1936 paper Turing proved that there are “generalpurpose” Turing machines that can compute whatever any other Turing machine. This is done by coding the function of the special-purpose machine as instructions of the other machine — that is by “programming” it. This is called Turing’s theorem. These are universal Turing machines, and the idea of a coding for a particular function fed into a universal Turing machine is basically our conception of a computer and a stored program. The concept of the universal Turing machine is just the concept of the computer as we know it. 32
First computers: custom computing machines Input tape (read only) Control Work tape (memory) 1946 -- Eniac: the control is hardwired manually for each problem. Output tape (write only) 1940: VON NEUMANN: DISTINCTION BETWEEN DATA AND INSTRUCTIONS 33
Can Machines Think? In “Computing machinery and intelligence, ” written in 1950, Turing asks whether machines can think. He claims that this question is too vague, and proposes, instead, to replace it with a different one. That question is: Can machines pass the “imitation game” (now called the Turing test)? If they can, they are intelligent. Turing is thus the first to have offered a rigorous test for the determination of intelligence quite generally. 34
The Turing Test The game runs as follows. You sit at a computer terminal and have an electronic conversation. You don’t know who is on the other end; it could be a person or a computer responding as it has been programmed to do. If you can’t distinguish between a human being and a computer from your interactions, then the computer is intelligent. Note that this is meant to be a sufficient condition of intelligence only. There may be other ways to be intelligent. 35
Artificial Intelligence 36
The Church-Turning Thesis Turing, and a logician called Alonzo Church (1903 -1995), independently developed the idea (not yet proven by widely accepted) that whatever can be computed by a mechanical procedure can be computed by a Turing machine. This is known as the Church-Turing thesis. 37
AI: The Argument We’ve now got the materials to show that AI is possible: P 1: Any function that can be computed by a mechanical procedure can be computed by a Turing machine. (Church-Turing thesis) P 2: Thinking is nothing more than the computing of functions by mechanical procedures (i. e. , thinking is symbol manipulation). (Functionalist-Computationalist thesis) C 1: Therefore, thinking can be performed by a Turing machine. P 3: Turing machines are multiply realizable. In particular, they can be realized by computers, robots, etc. It is possible to build a computer, robot, etc. that can think. That is, AI is possible. 38
Turing Machines 39
The Language Hierarchy ? ? Context-Free Languages Regular Languages 40
Languages accepted by Turing Machines Context-Free Languages Regular Languages 41
Tape. . . A Turing Machine. . . Read-Write head Control Unit 42
The Tape No boundaries -- infinite length. . . Read-Write head The head moves Left or Right 43
. . . Read-Write head The head at each time step: 1. Reads a symbol 2. Writes a symbol 3. Moves Left or Right 44
Example: . . . Time 0 Time 1 . . . 1. Reads 2. Writes 3. Moves Left 45
. . . Time 1 Time 2 . . . 1. Reads 2. Writes 3. Moves Right 46
The Input String Input string Blank symbol . . . head Head starts at the leftmost position of the input string 47
Input string. . . Blank symbol. . . head Remark: the input string is never empty 48
States & Transitions Read Write Move Left Move Right 49
Example: Time 1. . . current state 50
. . . Time 1 Time 2 . . . 51
Example: . . . Time 1 Time 2 . . . 52
Example: . . . Time 1 Time 2 . . . 53
Determinism Turing Machines are deterministic Allowed Not Allowed No lambda transitions allowed 54
Partial Transition Function Example: . . . Allowed: No transition for input symbol 55
Halting The machine halts if there are no possible transitions to follow 56
Example: . . . No possible transition HALT!!! 57
Final States Allowed Not Allowed • Final states have no outgoing transitions • In a final state the machine halts 58
Acceptance Accept Input If machine halts in a final state Reject Input If machine halts in a non-final state or If machine enters an infinite loop 59
Turing Machine Example A Turing machine that accepts the language: 60
Time 0 61
Time 1 62
Time 2 63
Time 3 64
Time 4 Halt & Accept 65
Rejection Example Time 0 66
Time 1 No possible Transition Halt & Reject 67
Infinite Loop Example A Turing machine for language 68
Time 0 69
Time 1 70
Time 2 71
Time 2 Time 4 Infinite loop Time 3 Time 5 72
Because of the infinite loop: • The final state cannot be reached • The machine never halts • The input is not accepted 73
Another Turing Machine Example Turing machine for the language 74
Time 0 75
Time 1 76
Time 2 77
Time 3 78
Time 4 79
Time 5 80
Time 6 81
Time 7 82
Time 8 83
Time 9 84
Time 10 85
Time 11 86
Time 12 87
Time 13 Halt & Accept 88
Observation: If we modify the machine for the language we can easily construct a machine for the language 89
Formal Definitions for Turing Machines 90
Transition Function 91
Transition Function 92
Turing Machine: States Input alphabet Tape alphabet Transition function Initial state Final states blank 93
Configuration Instantaneous description: 94
Time 4 Time 5 A Move: 95
Time 4 Time 5 Time 6 Time 7 96
Equivalent notation: 97
Initial configuration: Input string 98
The Accepted Language For any Turing Machine Initial state Final state 99
Standard Turing Machine The machine we described is the standard: • Deterministic • Infinite tape in both directions • Tape is the input/output file 100
Computing Functions with Turing Machines 101
A function Domain: has: Result Region: 102
A function may have many parameters: Example: Addition function 103
Integer Domain Decimal: 5 Binary: 101 Unary: 11111 We prefer unary representation: easier to manipulate with Turing machines 104
Definition: A function is computable if there is a Turing Machine such that: Initial configuration Final configuration initial state For all final state Domain 105
In other words: A function is computable if there is a Turing Machine such that: Initial Configuration For all Final Configuration Domain 106
Example The function is computable are integers Turing Machine: Input string: unary Output string: unary 107
Start initial state The 0 is the delimiter that separates the two numbers 108
Start initial state Finish final state 109
The 0 helps when we use the result for other operations Finish final state 110
Turing machine for function 111
Execution Example: Time 0 (2) Final Result 112
Time 0 113
Time 1 114
Time 2 115
Time 3 116
Time 4 117
Time 5 118
Time 6 119
Time 7 120
Time 8 121
Time 9 122
Time 10 123
Time 11 124
Time 12 HALT & accept 125
Another Example The function is computable is integer Turing Machine: Input string: unary Output string: unary 126
Start initial state Finish final state 127
Turing Machine Pseudocode for • Replace every 1 with $ • Repeat: • Find rightmost $, replace it with 1 • Go to right end, insert 1 Until no more $ remain 128
Turing Machine for 129
Start Example Finish 130
Another Example if The function is computable if 131
Turing Machine for if if Input: Output: or 132
Turing Machine Pseudocode: • Repeat Match a 1 from Until all of or with a 1 from is matched • If a 1 from is not matched erase tape, write 1 else erase tape, write 0 133
Combining Turing Machines 134
Block Diagram input Turing Machine output 135
Example: if if Adder Comparer Eraser 136
- Joan alan turing
- Pda is more powerful than
- Turing machine
- Kinect for windows runtime
- Language
- Progress babbage programmable
- Alan turing computing machinery and intelligence
- Recognition and regard for oneself and one's abilities: *
- Chapter 4 section 1 work and machines answer key
- Alan turing facts
- Turing macine
- Turing tumble simulator
- Recursive enumerable language
- Turing machine examples
- Hopcroft ullman
- Church turing hypothesis
- Turing machine for wcw
- Turing machine 7 tuple
- Arnold murray turing
- Turing machine examples
- Turing machine simulator tutorial
- The turing way
- Turing unrecognizable languages
- Quantum turing machine
- Multistack turing machine
- Tm pp
- Grammatica non ristretta
- Morphett turing machine
- Turing machine 7 tuple
- Church turing hypothesis
- Formal definition of turing machine
- Multidimensional turing machine
- Int 404
- Alan turing infancia
- Turing gép
- Mechanical turing machine
- Tm in automata
- H alphabet position
- Wcw turing machine
- Alan turing king's college
- Turing kara
- Turing recognizable vs decidable
- Turing scholars
- Alan turing halting problem
- Chocolate turing
- Good turing smoothing
- Was alan turing married
- Contoh soal mesin turing
- Mesin turing
- Atm turing machine
- Turing machine pseudocode
- Define a computer based on the turing model
- Turing php test answers
- Turing test
- Costas busch
- Teori graf dan otomata
- Turing test
- Macchina di turing
- Contoh soal mesin turing
- Alan turing stake
- Turing machine
- Bob alice private key
- Turing machine
- Turing test
- Turing test
- Turing machine is more powerful than:
- Maquinas de turing
- Extensions of turing machine
- Mesin turing
- A deterministic turing machine is: *
- Alan turing
- Turing intelligent machinery
- Godel incompleteness theorem
- Turing machine
- Turing machine
- The turing way
- Máy turing
- Contoh soal mesin turing
- Alan turing machine
- Turing machine is more powerful than: *
- Teste de turing
- Busy beavers numbers
- Bing
- Cara kerja mesin turing
- Extended church-turing thesis
- Turing award 1994
- Swedish chess computer association
- Turing test summary
- Enumerator turing machine
- Turing test
- Turing program
- Turing machine
- Deped order no 36 s 2016
- Difference between recognition and recall
- Reinforcing effort and providing recognition
- Disadvantages of optical character recognition
- Nrl head injury recognition and referral form
- An opportunity assessment plan is
- Va professional standards board
- Reinforcing effort and providing recognition
- Recall type
- Incoterms and revenue recognition us gaap
- Opportunity recognition shaping and reshaping
- Praise, recognition and power are_______.
- Reinforcing effort and providing recognition
- Shape matching and object recognition using shape contexts
- Suspected cancer recognition and referral
- Suspected cancer recognition and referral
- Cm bishop pattern recognition and machine learning
- Celebrating performance accenture
- Template matching
- The force you exert on a machine
- Section 1 work and machines
- Chapter 14 work power and machines
- Differentiate between simple machine and compound machine
- 5m man money machine material management
- Chapter 14 work power and machines
- Neural networks and learning machines 3rd edition
- Machines statics
- Frame in engineering mechanics
- Chapter 10 energy, work and simple machines answer key
- Energy work and simple machines chapter 10 answers
- Describing energy section 2 answers
- He invented over 80 machines using pulleys and weights
- Les machines simple
- Mechanical drives and lifting machines n2
- Work power energy and machines
- Parts of welding machine smaw
- What is a wheel and axle? *
- Machines and gadgets
- Wheel and axle examples around the house
- Kinematics and dynamics of machines
- What is tools and tackles
- Neural networks and learning machines
- Work power and machines
- Work power and machines
- Physics 10