Intelligent Agents Chapter 2 Concepts Properties of Agents

What is an Agent? Þ An agent q q n perceives its environment with

What is an Agent? Þ Agents usually carry out a task on behalf of

Simple Agent Model Environment Agent 1. Percieve 2. Reason/Deci de 3. Act 4. Repeat

How should an Agent Act? Þ A rational agent acts intelligently to achieve some

How should an Agent Act? Þ An ideal rational agent, for each possible percept

Examples of Rational Agents Type Percepts Actions Goals Environment ALVINN Images, Signals, Position Web

Properties of Agents n Some main properties of software agents are: q q situatedness

Properties of Agents n Situatedness The agent q q q has a direct connection

Properties of Agents n Autonomy The agent q q can act without direct intervention

Properties of Agents n Adaptivity The agent is capable of q q q reacting

Properties of Agents n Sociability The agent is capable of q q q interacting

Classes of Agents n Simple Table-Based Reflex Agents use a table lookup where each

Classes of Agents n Simple Rule-Based Reflex Agents use if-then rule to match percepts

Classes of Agents n Reflex Agents with an Internal State encodes state of the

Classes of Agents n Goal-Based Agents chose actions to achieve a desired goal q

Classes of Agents n Utility-Based Agents achieve goals while trying to maximize some utility

Intelligent Agent Model Agent Environment Sensors Model of World (being updated) Prior Knowledge about

Characteristics of Environments n Is the environment fully observable or partially observable? Þ An

Characteristics of Environments n Is the environment deterministic or stochastic? Þ An environment is

Characteristics of Environments n Is the environment episodic or sequential? Þ An environment is

Characteristics of Environments n Is the environment static or dynamic? Þ An environment is

Characteristics of Environments n Is the environment discrete or continuous? Þ An environment is

Characteristics of Environments n Is the environment single agent or multiagent? Þ An environment

Characteristics of Environments Þ In “real world” environments there is often uncertainty due to

Summary Þ An agent perceives and acts in an environment to achieve specific goals.

Summary n Agent Types q simple reflex n n q q q lookup table

Summary n Characteristics of Environments q q q fully observable vs. partially observable deterministic

Slides: 28

Download presentation

What is an Agent? Þ An agent q q n perceives its environment with sensors and acts upon that environment with its effectors. An agent gets percepts one at a time, and maps this percept sequence to actions. FWhy Agents? The agent metaphor provides a useful framework for thinking about and designing AI systems. 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 2

What is an Agent? Þ Agents usually carry out a task on behalf of a user. n Agents can be biological, robotic, or computational. n We’ll focus on computational agents more commonly called software agents. 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 3

How should an Agent Act? Þ A rational agent acts intelligently to achieve some goal. n A performance measure is used to determine how successfully a goal has been achieved. q q q n time taken resources required false alarm rate A rational agent tries to maximize its success by increasing its performance. 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 5

How should an Agent Act? Þ An ideal rational agent, for each possible percept sequence, does whatever action(s) maximizes its performance measure given q q n the percept sequence and its knowledge, both built-in and acquired These agents gather information so they aren’t “rationally” ignorant. 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 6

Examples of Rational Agents Type Percepts Actions Goals Environment ALVINN Images, Signals, Position Web pages Steer, Speed control, Sensor control Navigate web, Gather info. Drive from A to B Roads, Vehicles, Hazards Internet Current board state Next move Win game Tests, Treatments Healthy patient Price Grabber Chess program Medical Symptoms, Diagnosis Test results 2/21/2021 Find best price © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. Opponent, Game board Patient, Hospital 7

Properties of Agents n Situatedness The agent q q q has a direct connection to its environment receives some form of sensory input from its environment performs some action that changes its environment in some way 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 9

Properties of Agents n Autonomy The agent q q can act without direct intervention by humans or other agents has control over its own actions and internal state. Decisions must be made independently of the programmer. Some aspect of the current situation must trigger a response. 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 10

Properties of Agents n Adaptivity The agent is capable of q q q reacting flexibly to changes in its environment taking goal-directed initiative (being pro-active) learning from its own experience, its environment, and interactions with others 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 11

Properties of Agents n Sociability The agent is capable of q q q interacting in a peer-to-peer manner with other agents or humans communicating, sharing information cooperating and/or competing 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 12

Classes of Agents n Simple Table-Based Reflex Agents use a table lookup where each percept is matched to an action FExamples? n Problems/Limitations? q q table may be too big to generate and store not adaptive to changes in the environment; instead table must be updated can't make actions conditional reacts only to current percept; no history kept 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 13

Classes of Agents n Simple Rule-Based Reflex Agents use if-then rule to match percepts to actions q q q no need to consider all percepts can generalize percepts by mapping to the same action can adapt to changes in the environment by adding rules FExamples? n Problems/Limitations? q reacts only to current percept; no knowledge of non-perceptual parts of the current state 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 14

Classes of Agents n Reflex Agents with an Internal State encodes state of the world from past percepts (and knowledge of the world) q q actions can be based on a sequence of percepts and knowledge of non-perceptual world state representing current state limits reasoning ability, better to also represent changes in the world FExamples? n Problems/Limitations? q not deliberative, agent classes so far are reactive 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 15

Classes of Agents n Goal-Based Agents chose actions to achieve a desired goal q q search or planning often used deliberative/purposeful rather than reactive FExamples? n Problems/Limitations? q q may have to consider long sequences of possible actions before goal is achieved involves consideration of the future, “What will happen if I do. . . ? ” How are competing goals treated? What about degrees of success? 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 16

Classes of Agents n Utility-Based Agents achieve goals while trying to maximize some utility value q q utility value gives a measure of success or "happiness" for a given situation allows decisions comparing choice between n n conflicting goals likelihood of success and importance of goal FExamples? 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 17

Intelligent Agent Model Agent Environment Sensors Model of World (being updated) Prior Knowledge about the World Reasoning & Decisions Making Effectors 2/21/2021 List of Possible Actions © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. Goals/Utility 18

Characteristics of Environments n Is the environment fully observable or partially observable? Þ An environment is fully observable if the agent's sensors give it access to the complete state of the environment at any point in time. n n If all aspects that are relevant to the choice of action are able to be detected then the environment is effectively fully observable. Noisy and inaccurate sensors can result in partially observable environments. 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 19

Characteristics of Environments n Is the environment deterministic or stochastic? Þ An environment is deterministic if the next state of the world is completely determined by the current state and the agents' actions. n n Often it is better to consider this from the point of view of the agent. Randomness and chance are common causes non-deterministic environments. 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 20

Characteristics of Environments n Is the environment episodic or sequential? Þ An environment is episodic if each percept-action episode does not depend on the actions in prior episodes. n Games are often sequential requiring one to think ahead. 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 21

Characteristics of Environments n Is the environment static or dynamic? Þ An environment is static if it doesn't change between the time of perceiving and acting. n n An environment is semidynamic if it doesn't change but the agent does (e. g. performance score). Time is an important factor in dynamic environments, since perceptions can become "stale". 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 22

Characteristics of Environments n Is the environment discrete or continuous? Þ An environment is discrete if there a limited number of distinct, clearly-defined states of the world which limits range of possible percepts and actions. 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 23

Characteristics of Environments n Is the environment single agent or multiagent? Þ An environment is multiagent if more than one agents effect the each other's performance. n Multiagent environments can be competitive and/or cooperative. 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 24

Characteristics of Environments Þ In “real world” environments there is often uncertainty due to partially observable, stochastic, dynamic environments. Þ In AI research, it is common to use “toy worlds”, which approximate the “real world” but are simplified and often oversimplified in a manner that diminishes the value of the results. 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 25

Summary Þ An agent perceives and acts in an environment to achieve specific goals. n Characteristics of Agents q q situatedness autonomy adaptivity sociability 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 26

Summary n Characteristics of Environments q q q fully observable vs. partially observable deterministic vs. stochastic episodic vs. sequential static vs. dynamic discrete vs. continuous single agent vs. multiagent 2/21/2021 © 2001 -2004 James D. Skrentny from notes by C. Dyer, et. al. 28