Intelligent AgentBased Tactical Operations Center Staff Training Systems

Intelligent Agent-Based Tactical Operations Center Staff Training Systems Yu Zhang, Keith Biggers, Linli He, John Yen, Thomas Ioerger University XXI Texas A&M University Sponsors STRICOM, TEES

Motivation • Provide Scenario-Based Training At Drastically Lower Costs (Personnel and Dollars) Through The Use Of Agent-Based Technologies • Provide a Solution For What Simulations Currently Lack - Aggregate Unit Decision Making - Communication and Interactions with Human Players

TOC Staff Training Layout BDE Trainees S 2 CDR S 3 FSO BN Trainer/Observer OTB Scenario Agents

High-Level Architecture of DBST PDUs OTB mouse PDUs Puckster Interface Agents actions RFS, CFF inform, request, direct, approve, respond BDE Interface text, forms, map

Brigade Trainee Interfaces Example S 2 Map Display Example S 2 Report Forms

Simulation One. SAF Testbed DIS Periodic Updates From Simulation Cache Agents KB PDUs Translated To Facts (speed, location, unit type, etc. )

Agent Decision-Tracking Window/Controller

Taskable. Agents Architecture • Written in Java • TRL Knowledge Representation Language - For Capturing Procedural Knowledge (Tasks & Methods) • APTE Method Selection-Algorithm • Inference Engine JARE - Java Automated Reasoning Engine - Knowledge Base with Facts and Horn Clauses - Updating World With Facts

Taskable. Agents TRL Task Decomposition Hierarchy TRL KB: tasks & methods APTE Algorithm Process Nets operators messages OTB (simulation) assert, query, retract results sensing Other Agents JARE KB: facts & Horn-clauses messages

Task Representation Language (TRL) • Provides descriptors for: goals, tasks, methods, and operators • Tasks: “what to do” – Can associate alternative methods, with priorities or preference conditions – Can have termination conditions • Methods: “how to do it” – Can define preference conditions for alternatives – Process Net - Procedural language for specifying how to do things - While loops, if conditionals, sequential, parallel constructs - Can invoke sub-tasks or operators - Semantics based on Event Logic

Task Representation Language (Cont. ) • Operators: lowest-level actions that can be directly executed in the simulation environment, e. g. move unit, send message, fire on enemy • Each descriptor is a schema with arguments and variables • Conditions are evaluated as queries to JARE

Example TRL Knowledge (: Task Monitor (? unit) (: Term-cond (destroyed ? unit)) (: Method (Track-with-UAV ? unit) (: Pref-cond (not (weather cloudy)))) (: Method (Follow-with-scouts ? unit) (: Pref-cond (ground-cover dense)))) (: Method Track-with-UAV (? unit) (: Pre-cond (have-assets UAV)) (: Process (: seq (: if(: cond(not(launched UAV)))(launch UAV)) (: let((x y)(loc ? unit ? x ? y))(fly UAV ? x ? y)) (circle UAV ? x ? y))))

Task-Decomposition Hierarchy level 1 T 1 M 1 level 2 T 3 T 2 T 5 T 4 level 3 level 4 M 7 M 12 M 92 M 60 level 5 T 18 Tx =Task Mx = Method C = Condition T 40 T 45 T 40 C T 45 T 2

Adaptive Protocol for Task Execution (APTE) • Task decomposition tree – Selecting appropriate methods for tasks – Instantiating the process networks for selected methods – Identifying sub-tasks that could be taken as “first steps” – Recursively expanding these sub-tasks further downward • Collecting the set of all active operators and selecting one to execute

APTE (Cont. ) T 1 M 1 T 3 M 2 M 3 T 5 T 2 T 7 T 4 T 6 process net

APTE (Cont. ) • Repairing the task-decomposition tree – Move token forward in the corresponding process net – Check conditions associated with the tasks and methods – If termination condition has been reached, APTE back-tracks and tries to find another method that would satisfy the parent task – If a task at some level has successfully completed, then a step forward can be taken in the process net of its parent

APTE (Cont. ) T 1 M 1 T 1 M 2 M 1 M 3 M 2 M 3 step T 3 T 5 T 2 T 7 T 4 T 6 process net After T 2 completes T 5 T 2 T 7 T 4 T 6 process net After T 7 completes

Distributed Taskable. Agents • Message Queue (MQ) – A queue system for receiving string messages – Each message is tagged with a sender ID and a timestamp – Implemented in Java Remote Method Invocation (RMI) – Methods for sending and receiving messages written in TRL Java Process 2 update Java Process 1 Sender Agent MQ RMI SEND Operator MQ KB Receiver Agent

TOC Staff - Agent Decomposition Control indirect fire, Artillery, Close Air, ATK Helicopter Maintain friendly situation, S 3 Maneuver sub-units FSO CDR Companies Maneuver, React to enemy/orders, Move along assigned route Maintain enemy situation, Detect/evaluate threats, Evaluate PIRs S 2 Move/hold, Make commands/decisions, RFI to Brigade Scouts Move to OP, Track enemy * Selected Functions handled by our model

Commander Agent and Interactions Scout BDE CDR CCIR RFI/ RFS Move/Hold S 3 PIR Threats CDR Enemy Info S 2 Move/Hold, RFI Decision Point Reached=Order Move

S 2 Agent and Interactions BDE S 2 RFI/RFS SALT/ INTSUM S 2 CCIR Enemy info intel Move to OP Threat level, PIR BDE/DIV Sensors/ Recon intel Scout CDR DP approval S 3

S 3 Agent and Interactions Situation Update Scout S 2 Track/ Threats, Destroy PIR Obstacles, BDA RFS, RFI Bde Inform S 3 Friendly units info, Shift priority of fires FSO INTSUM CDR Move/hold, Shift main effort, Commit reserves DP reached=order Company

FSO Agent and Interactions S 2 CFF Scout CFF Companie s Fire Missions, Artillery, Enemy Close Air, info ATK BDE Helicopter FSO Inform CDR Fire support approval FSO Friendly units info, Shift main effort S 3

Tactical Overview • Movement to Contact - High tempo and high uncertainty • Early stages in which reconnaissance is occurring, developing towards the engagement Dallasia Decision Points Gatesville Hy 84 1 Continuation of attack to north or hasty defense 2 Initiation of Bde fires & CAS 3 IB 2 X 1 3 -66 =1 -22 Shift fires & CAS to TF close fight Lampasas 4 5 Commitment of BCT reserve Shift fires & CAS to 2 d echelon uav Copperas Cove TF 3 -66 Hy 1 28 Fort Hood Gray Army Airfield TF 1 -22 Lampa sa Austonias R. BOB Co wh ous e. C r. 4 ID XX 1 CD MATTHEW Killeen Hy 190 LD

Vignette 1 – Scout Reaction to Enemy Recon Unit Variation A: Move to OP (Position to Develop Intel) Variation B: Attack by Indirect Fire (Using TAI & planned TRP) AA 5 AA 4 AA 3 AA 4 OP Y 2 vehicles 1 -4 vehicles ? AA 5 Artillery target NAI/ TAI X AE xxxx SCT AA 3 NAI X OP Y Sec n SCT SCT Sec n SCT • Assess threat • Select action • Select OP • Select scout section • Order • Report move • Assess threat • Select action • Select method(s) • Order • Discern target & Call for fire(CFF) • Shoot target • Report Results - BDA

Vignette 1 A Time Line Sequence # Timing 01 H+3 02 H+3. 05 03 H+3. 1 04 H+3. 15 S 2 determines which OP is best suited to position Scouts for development of situation. (OP Y over watches NAI X) H+3. 2 S 2 sends order to Scout Ldr to move a section to OP Y immediately) 05 Source – Task Force Units Bde S 2 passes Recon report via INTSUM to TF 1 -22. TFS 2 relays enemy sighting to Cdr, S 3, FSO and Scout Ldr. S 2 assesses threat. H+3. 27 Scout Ldr determines Scout Sec n is closest to OP Y. Sends order to Scout Sec n (OTB action). 07 H+3. 75 Scout Sec n reports when on OP Y to Scout Ldr. H+3. 78 09 H+3. 8 Source – Brigade Bde Recon reports to Bde S 2: 1 tank & 2 BMPs moving along AA 3 south toward NAI X. 06 08 Source - Task Force TOC/Staff/Cdr S 2 monitors. Scout Ldr reports to TF S 2 reports move of scouts to Bde S 2.

Vignette 1 B Time Line Sequence # Timing Source – Task Force Units 01 H+3 Scout Sec n is on OP Y, reports (SALT) 2 vehicles moving south on AA 3, 2 kms north of NAI X. 02 H+3. 15 Scout Ldr relays report to S 2. 03 H+3. 15 FIST with Scouts generates a CFF that goes to FSO. Source - Task Force TOC/Staff/Cdr Source – Brigade TF S 2 monitors 04 H+3. 2 TF S 2 reports enemy vehicles to Cdr and staff. FSO informs on CFF. 05 H+3. 25 TF S 3 collaborates with Cdr and decides to approve artillery fire on enemy. 06 H+3. 3 FSO confirms target as AE xxxx. S 3 approves. 07 H+3. 31 FSO sends approval to Bde FSO. 08 H+3. 333. 35 Bde FSO receives TF target. DS artillery unit receives target and fires mission. 09 H+3. 353. 40 Scout FIST observes fire and corrects as needed. 10 H+3. 45 Scout Sec n reports BDA (I BMP destroyed, 1 BRDM damaged and halted) 11 H+3. 5 Scout Ldr relays BDA to S 2 12 H+3. 55 S 2 reports BDA to Cdr, staff and Bde S 2

Vignette 2 – Decision Point 1 [Shift Main Effort] IB Company Size forces 3 234 1 Company Size forces AA 5 235 3 -234 IB AA 5 1 -234 Company Size forces AA 3 PL AA 6 c Main Effort(ME) 1 4 ID X C X D Co. C 3 -66=1 -22 Tm. B PL AA 3 AA 4 AA 5 c PL 3 -66=1 -22 tch wi ME S Main Effort(ME) Tm. B Co. C Tm. A 1 4 ID X C X D PL Tm. A INTEL AA 5 a AA 4 • 2 Companies of 3 -234 heading along AA 3 • 3 -234 lead Bn of 234 Regt. • Situation unclear on AA 5 DP 1 Variation A: Enemy major threat is on Shift ME from Tm B to Co C? main route (AA) as in route (planned AA). N Y INTEL • 2 Companies of 234 heading along AA 3 & AA 4 • 3 -234 lead Bn of 234 Regt intent is unclear. • Lead Bn (1 -235) of 235 Regt on AA 5 a Variation B: Enemy major threat changes to secondary approach DP 1 Shift ME from Tm B to Co C? N Y

Vignette 2 A Time Line Sequence # Timing 01 H+7 02 H+7. 1 Source – Task Force Units Source - Task Force TOC/Staff/Cdr Source – Brigade Scouts report all enemy recon units destroyed. TF S 2 informs TOC and Bde S 2 03 Bde Recon sights major units moving along IB on AA 3 south. 04 Bde S 2: Company size units moving south on AA’s 4&5. 05 TF S 2 assesses threat to determine PIR status. Informs TOC and Companies of Bde S 2 INTSUM. 06 TF S 3 assesses location of companies relative to PL Y. 07 Bde UAV indicates heavy forces crossing IB west of Gatesville to south. Artillery spotted just north of IB. 08 Bde S 2 assessment is that the UAV sighting is a battalion of the 234 Mech Bde. 09 TF S 2 checks position of scouts along AA 3. Orders OP occupation if needed. Reports to Cdr and S 3 that PIR now indicates lead bn on AA 3. (DP 1 trigger) 10 Cdr: DP 1 is triggered to a NO. (Lead Bn was on AA 3, which is already ME (Tm. B). 11 S 3 assesses closing speed of threat on PL Y versus Tm B. 12 S 2 informs companies and scouts that lead bn is along AA 3

Vignette 2 B Time Line Sequence # Timing 01 H+7 Source – Task Force Units Source - Task Force TOC/Staff/Cdr Source – Brigade Scouts report new recon units along AA 5 02 S 2 RFI to Bde S 2 on situation in 235 Mech Bde area. 03 Bde S 2 request info from Recon and Div G 2. 04 Div G 2 relays that a UAV and other platforms indicate artillery and tank columns north of IB on AA 5. 05 Bde S 2 confirms what seems to be lead Bn of 235 Regt near IB east of Gatesville 06 Scouts report no unusual movement of enemy on AA’s 3&4. 07 S 2 informs Cdr that PIR on lead bn has been triggered and main threat is in east. 08 Cdr triggers DP 1 YES and informs S 3. 09 S 3 informs TOC and issues FRAGO changing main effort to Co C. 10 FSO informs Bde FSO

Vignette 3 – Decision Point 2 [Commit TF Reserve] IB Company Size forces 3 234 1 1 AA 5 235 Company Size forces 3 -234 IB AA 5 1 -234 Company Size forces AA 3 PL AA 6 c Main Effort(ME) 1 4 ID X C X D Co. C Tm. B … Res Variation A: Heavy enemy threat across entire sector. Blocking Positions AA 4 AA 5 c PL 3 -66=1 -22 Tm. A (-) Main Effort(ME) … Res Tm. B (+) Co. C 1 4 ID X C X D PL Tm. A INTEL AA 3 TAI Y 3 -66=1 -22 PL AA 5 a AA 4 • Company units of 3 different Bns on all 3 AAs • Estimate enemy will reach PL Y at same time • 238 Regt lead units not committed INTEL • 2 Companies of 234 heading down AA 3 • Uniform pressure on AA’s 4 & 5 ar. • Calculations indicate Tm A unit can move to PL Y prior to lead of enemy unit. DP 2 Commit the TF Reserve platoon? N Y Go to DP 3 Variation B: Major enemy movement on one avenue (AA). Commit the TF Reserve platoon? N Y

Vignette 3 A Time Line Sequence # Timing 01 H+8 Source – Task Force Units Source - Task Force TOC/Staff/Cdr Bde Recon & Div intel confirms that at least 2 companies each are advancing south across IB on AA’s 3, 4 &5 (INTSUM) 02 TF S 2 relays report (INTSUM) to TOC, scouts and companies. 03 TF S 2 requests (RFI) for any intel on enemy reserves and artillery (PIR) 04 TF S 3 checks status of companies to occupy battle positions along PL Y 05 Bde S 2 responds to RFI that major reserves have not been confirmed, artillery is disbursed. 06 S 2 confirms to Cdr PIR on lead bns (DP 2 trigger) 07 Cdr: assessment is that threat is uniform and chooses not to weaken any of the 3 TF positions along PL Y 08 Cdr: reports decision to S 3 and staff 09 S 3 requests (RFS) to Bde S 3 FASCAM and air strikes or atk helicopters at targets south of IB along AA’s. 10 11 Source – Brigade Companies report positions relative to PL Y. FSO RFS to Bde FSO for FASCAM, and air support.

Vignette 3 B Time Line Sequence # Timing 01 H+8 02 Source – Task Force Units Source - Task Force TOC/Staff/Cdr Bde Recon and UAV sightings report (SALT) concentration of artillery and C 2 just north of IB west of Gatesville near AA 3 Scouts confirm lack of movement along AA 4. 03 S 2 passes Bde INTSUM and SALT to TOC and companies. RFI to Bde S 2 for intel to the east in 1 st CD sector (AA 5). 04 Bde S 2 reports that 1 CD G 2 has reported a battalion on AA 5. At least one company size force turning west on AA 5 a. 05 06 S 3 checks location of companies moving to PL Y positions. (RFI) Companies report status. 07 S 2 informs Cdr that PIR on ID of lead Bn of the 234 Mech Bde indicates major enemy avenue to be AA 3 into Tm B area. 08 Cdr triggers DP’s (DP 1 n/a) DP 2 TF reserve can be released due to low threat in center (AA 4) DP 2 is Y commit one platoon of Tm AQ to Tm. B. 09 S 3 (FRAGO) Heavy enemy on AA 3, Tm A detach on platoon of tanks to Tm B immediately, move to PL Y. 10 Companies move to occupy along PL Y. 11 12 Source – Brigade FSO RFS to Bde FSO for FASCAM at target north of TAI n. S 2 checks positions of scouts for Ops 5 to 10 Kms north of PL Y. Scouts move as needed

Vignette 4 – Decision Point 3 [Request Bde Reserve] IB Company Size forces 234 3 234 1 235 AA 5 TAI Z 1 AA 3 Company Size forces PL Y AA 5 a AA 4 AA 6 c Main Effort(ME) AA 3 NAI PL Y Tm. A 3 -66=1 -22 1 4 ID X C X D Co. C … Res Tm. B PL 3 -66=1 -22 AA 4 Blocking Positions INTEL Variation A: Heavy threat across sector slowed by Bde artillery and air strikes. Company units of 3 different Bns on all 3 AAs Enemy can be blocked along PL Y 238 Regt lead units not committed Weather is clear and observation unhindered. Bde & Div are destroying DAG/RAG DP 1 N … Res Request Bde Reserve ? Y N Request FASCAM/CAS Go to DP 4 AA 5 c Tm. A (-) Tm. B (+) 1 4 ID X C X D Co. C 2 Co Co 1 -66 Brigade Reserve • Lead Bn of 238 regt sighted by UAV INTEL moving toward AA 5. • Major 2 Bn threat on AA 5 a & 5 c. • Pressure continues on AA’s 3 & 4. DP 1 DP 3 TAI Z Main Effort(ME) PL • • • AA 5 1 -238 3 -234 IB TAI X TAI Y ll Variation B: Major enemy reserve force is is committed. Y DP 2 NA DP 3 Request Bde Reserve ? N Go to DP 4 Y

Vignette 4 A Time Line Sequence # Timing Source – Task Force Units 01 H+9 Scouts report that Bde Recon to north have been sighting increased enemy movement on AA’s 3, 4 &5. 02 Source - Task Force TOC/Staff/Cdr Source – Brigade S 2 requests (RFI) intel assessment by Bde S 2. 03 Bde S 2 provides INTSUM to the effect that the 230 Mech Bde is moving south in the 3 -66 AR (AA’s 1&2), indications are that the 234 th Bde will cross with a Bn each on AA 3 and AA 4. 1 CD pressure on the 235 th Bde will likely lead to at least one Bn on AA 5 a. No indicators on commitment of enemy division reserve (238 th Bde) 04 S 2 relays INTSUM to TOC and companies. 05 S 3 assesses company progress and status on battle positions along PL Y. 06 Bde S 3 reports that massive air strikes and attack helicopter sorties have slowed enemy attack along IB. 07 S 2 informs Cdr that PIR indications on lead Bn indicate equal threat across front. Major reserve unit remains uncommitted. 08 Cdr triggers DP criteria: DP 1 (neutral) DP 2 (neutral); DP 3 (attacks are slowed and TF can handle current threat using artillery and air) 09 S 3 coordinates with FSO on FASCAM targets on AA 3 and AA 5 a, air strikes on AA 3&4. 10 FSO passes requests (RFS) to Bde FSO. 11 S 2 assess scout location for moves.

Vignette 4 B Time Line Sequence # Timing Source – Task Force Units 01 H+10 Companies & Scouts report enemy attack slowed by air strikes north of PL Y. Companies are in BPs on along PL Y. Tm A has detached one platoon to Tm B in west. 02 Source - Task Force TOC/Staff/Cdr S 2 passes SALT to Bde S 2 & TOC. S 2 RFI to Bde S 2 for intel on 238 th Bde. 03 Bde S 2 responds that recent UAV sightings show logistic re-supply points at highway 36 in Gatesville. C 2 elements have moved south of IB and a full bn (believed to be 1 -235) is moving on AA 5. 04 S 2 passessment to TOC and Cdr that indications are that the enemy division has committed the reserve 238 Bde in a push south and SW along AA 5, 5 a and 5 c. Cdr is alerted to trigger for DP 3. 05 S 3 informs companies to hold positions along PL Y and be prepared to defend. 06 Source – Brigade Companies report units in BP’s. Scouts priority is on AA 5 a and 5 c. S 2 checks positions and moves if necessary. 07 Cdr triggers DPs: Dp 1 (Y ME is now Co. C); DP 2 (n/a, TF reserve with Tm B); DP 3 (Y major threat above TF ability) 08 Cdr/S 3 RFS that Bde commit 1 -66 AR to block enemy on AA 5 c and reinforce Tm A in center with at least 1 company. 09 FSO changes priority of fires to Co C. Request CAS and attack helicopters 10 Cdr considers DP 4

Future Work • Model Multiple Battalions • Simulating Higher-Level Decision-Making and Situation Assessment, i. e. Command Control (C 2) • More Generic and Flexible Knowledge • Increase Comprehensiveness and Robustness of Knowledge (Handle more missions/situations) • Modeling Multi-Agent Teamwork Through Reasoning About Beliefs and Shared Goals