Trench Gothic The Computer Visualisation of a Disturbing

Trench Gothic: The Computer Visualisation of a Disturbing Great War Artwork Derek J. SMITH, C. Eng. , C. I. T. P. High Tower Consultants Limited International Software Products, Toronto Cardiff Metropolitan University (Retired) smithsrisca@btinternet. com http: //www. smithsrisca. co. uk

A Presentation to the BCS EVA Conference, 2014 BCS HQ, London Wednesday 9 th July 2014

ABOUT THE AUTHOR • During the 1980 s Derek Smith worked for British Telecom, Cardiff, where he specialised in the design and operation of very large CA IDMS "semantic network" databases. • Between 1991 and 2010 he taught psycholinguistics and neuropsychology to the Speech and Language Therapy students at Cardiff Metropolitan University. • He is currently working with International Software Products, Toronto, on "Project Konrad", an artificial consciousness project using a CA IDMS platform.

WHY WE ARE HERE TODAY Here is a critically acclaimed painting. In a moment you will find out if you love it or hate it. But you probably won’t know why. In fact, there is no single science to explain such moments of artistic appreciation. Francis Bacon "Portrait of Lucien Freud" [ONE OF THREE] (1952)

PLAN OF THE PRESENTATION • PART 1 - INTRODUCTION [5 mins] • PART 2 - THE MIND AS A REAL-TIME CONTROL SYSTEM [4 mins] • PART 3 – KONRAD, THE TECHNICALITIES [6 mins] • CONCLUSIONS AND QUESTIONS [2 + 3 mins]

PART 1 INTRODUCTION A CRASH COURSE IN VISUAL PERCEPTION Why vision evolved, how the eye feeds information to the visual areas of the brain, and what it feels like.

THE VERTEBRATE NERVOUS SYSTEM HOW IT ALL BEGAN This is a Pikaia, a wormlike creature from 530 MYA. Its nerve cord coordinates the pulsed contraction and relaxation of its muscle segments. HEAD TAIL Creatures like Pikaia are the evolutionary ancestors of all modern vertebrates, including humans. | ----------- 50 mm ---------- |

THE VERTEBRATE NERVOUS SYSTEM HOW IT ALL BEGAN As new animals evolved, this nerve cord gradually thickened at the head end to form a brain. Visual information was processed in an area known as the "optic tectum" [solid blue]. The surface layer, or "cortex", of the "cerebrum" [light blue] provided additional general intelligence when called for.

THE VERTEBRATE NERVOUS SYSTEM HOW IT ALL BEGAN As evolution continued, brains didn’t just become larger and more powerful, but … … many functions of the optic tectum were taken over by the cerebral cortex.

THE VERTEBRATE NERVOUS SYSTEM HOW IT ALL BEGAN The underlying structure of all these nervous systems is the same. Vision just one cortical specialism amongst many. SMELL AND TASTE CONSCIOUSNESS, COMMAND, AND CONTROL HABIT, INSTINCT, AND EMOTION BALANCE AND BODILY SENSES REFLEXES VISION AND HEARING INSTRUCTIONS TO MUSCLES

THE VERTEBRATE NERVOUS SYSTEM HOW IT ALL BEGAN Note that all this processing is multi-layered. Much totally unconscious. In fact we only “know” the world at 2 nd/3 rd hand! SMELL AND TASTE KNOWING HABIT, INSTINCT, AND EMOTION BALANCE AND BODILY SENSES REFLEXES VISION AND HEARING INSTRUCTIONS TO MUSCLES

THE VERTEBRATE NERVOUS SYSTEM HOW IT ALL BEGAN Whenever vision and emotion cooccur we perceive both the world AND WHAT IT IS DOING TO US! Which is why art is so fascinating … SMELL AND TASTE KNOWING HABIT, INSTINCT, AND EMOTION BALANCE AND BODILY SENSES REFLEXES VISION AND HEARING INSTRUCTIONS TO MUSCLES

DISTURBING ART ROMANTIC GOTHIC FROM ca. 1781 Henry Fuseli “The Nightmare" (1781) DARK CHARACTERS DARK THEMES

DISTURBING ART MODERN GOTHIC DISTURBING ART IS OFTEN BASED ON CONFLICTING EMOTIONS, AS SHOWN HERE. POSITIVE EMOTION FOR THE CHILD BUT NEGATIVE EMOTION FOR THE SETTING Zhang Peng "Untitled" (ca. 2010)

DISTURBING ART TRENCH GOTHIC, 1914 -1918 George Grosz “The Hero" (1933) EVOKES NEGATIVE EMOTIONS ASSOCIATED WITH WAR AND VIOLENCE TYPICALLY SATIRICAL IRONY OF TITLING, ETC.

ART AS FELT EMOTION THE FUNDAMENTAL PROBLEM OF AESTHETICS SUBLIME EMOTION FELT EMOTION SENSATION

ART AS FELT EMOTION THE FUNDAMENTAL PROBLEM OF AESTHETICS OUR OWN RESEARCH IS TRYING TO SOLVE THE FUNDAMENTAL PROBLEM OF AESTHETICS USING COMPUTER SOFTWARE TO “GO THROUGH THE MOTIONS” OF A MIND APPRECIATING ART. OR TO PUT IT ANOTHER WAY …

ART AS FELT EMOTION … WHAT MIGHT A ROBOT MAKE OF THIS? Albin Egger-Lienz “Den Namenlosen“ (1916)

PART 2 THE MIND AS A REALTIME CONTROL SYSTEM COGNITION AS AN INTERMITTENT CYCLICAL PROCESS From brain to mind and back again.

THE “HIGHER COGNITIVE FUNCTIONS” • Here’s a textbook view of cortical modularity. • Mapped 1861 to 1937 and hardly improved since. • Most areas known by what happens when they are damaged.

A HIERARCHICAL ALTERNATIVE ? ? ? CORTICAL LEVEL HIGHER COGNITION AUTONOMOUS WILL DIRECTED ATTENTION CONCEPTS SECONDARY SENSORY ANALYSIS FIGURE-GROUND / DRAMATIC GIST PRIMARY SENSORY ANALYSIS SENSORY INPUT SUBCORTICAL LEVEL EMOTIONAL STATES DRIVES AND INSTINCTS REFLEX LEVEL WILLED BEHAVIOURS MOTOR SCHEMA MANAGEMENT MOVEMENT UNITS LOWER MOTOR SUBROUTINES MUSCLE OUTPUT

A HIERARCHICAL ALTERNATIVE ? ? ? CORTICAL LEVEL HIGHER COGNITION AUTONOMOUS WILL DIRECTED ATTENTION CONCEPTS SECONDARY SENSORY ANALYSIS FIGURE-GROUND / DRAMATIC GIST PRIMARY SENSORY ANALYSIS SENSORY INPUT SUBCORTICAL LEVEL EMOTIONAL STATES DRIVES AND INSTINCTS REFLEX LEVEL WILLED BEHAVIOURS MOTOR SCHEMA MANAGEMENT MOVEMENT UNITS LOWER MOTOR SUBROUTINES MUSCLE OUTPUT

THE NEXT DIAGRAM SHOWS HOW FAR SCIENCE HAS GOT / NOT GOT WITH PROGRAMMING THE MIND AFTER 2000 YEARS OF TRYING. NOTE VERY CAREFULLY WHERE THE PROBLEMS REMAIN. ESPECIALLY THE PROBLEMS OF FELT EMOTION AND CONSCIOUS EXPERIENCE

CONCEPTUAL AND ALLEGORICAL ART CHESS AND SIMILAR PROBLEM SOLVING UNDERSTANDING THINKING FELT EMOTION AUTONOMY AND SELF-REFERENCED WILL AND CONSCIOUS EXPERIENCE ? ? ? CORTICAL LEVEL HIGHER COGNITION AUTONOMOUS WILL DIRECTED ATTENTION SIMPLE MACHINE EMOTIONAL STATES DRIVES AND INSTINCTS TRANSLATION CONCEPTS SENTENCE ANALYSIS SECONDARY SENSORY ANALYSIS FIGURE-GROUND / DRAMATIC GIST PATTERN RECOGNITION VOICE RECOGNITION PRIMARY SENSORY ANALYSIS SENSORY INPUT WILLED BEHAVIOURS SUBCORTICAL LEVEL SIMPLE BIONICS ARTIFICIAL RETINA INSTALLATION ART SENTENCE SYNTHESIS MOVEMENT UNITS REFLEX LEVEL EYES MOTOR SCHEMA MANAGEMENT VOICE LOWER MOTOR SUBROUTINES VOICE SYNTHESIS MUSCLE OUTPUT HAND MECHATRONICS PERFORMANCE ART

PART 3 INTRODUCING KONRAD, THE TECHNICALITIES TOWARD A SOFTWARE MIND Data model; Database Schema; Processing Suite; The Processing Cycle

INTRODUCING PROJECT KONRAD EXECUTIVE SUMMARY • Konrad models the end-to-end flow of biological cognition, with especial emphasis on the semantic network nature of the mind's long-term memory system. • It models a memory network with a memory network (unlike rival AI systems). Mental Associations

INTRODUCING PROJECT KONRAD THE LOGICAL DATA MODEL • As is normal for all databases, a Relational Data Analysis exercise produced a Logical Data Model, which was then used to define a set-structured Database Schema. • More than 250 mental entity types were identified during the Data Analysis. The resulting "Bachman Diagram" is accordingly far too big for this screen, but it may be studied at leisure at http: //www. smithsrisca. co. uk/PPTs/konrad-bachman. ppt.

INTRODUCING PROJECT KONRAD THE DESIGN PHILOSOPHY • Fortunately, internal similarities and repetitions in the real world allowed the 250 logical entity types to be abstracted down to only seven different physical record types. • One processing module, four different types of module contents, one bill of materials record, and one domaining superchief. • Here’s the Database Schema …

INTRODUCING PROJECT KONRAD THE CA IDMS DATABASE SCHEMA DATABASE AREA 2 A REALM OF FUNCTIONALLY SPECIFIED INFORMATION PROCESSORS, AND THEIR ASSOCIATED INFORMATION TYPES. • Processing Module (FDPX) AREA 2 FDPX-REC Functionally Discrete Processor FDPXs MAINTAIN MANY LTMs <NO AM> • STM, MTM, LTM, and Instinct • LTM "Bill of Materials" and "Superchief" to cope with memories made up of other memories. • Here’s how it works … AREA 2 MTEV-REC Medium-Term Event AREA 2 KML-REC Innate Read-Only Memory AREA 2 LTM-REC Long-Term Memory Primary Trace LTMR LINKS LTMs <NO AM> FDPXs RECEIVE MANY STEVs <NO AM> MTEVs CONSOLIDATE INTO MANY LTMs <NO AM> LTM OCCURS IN LTMRs <NO AM> LTMs ARE CLUSTERED UNDER LTMSs <NO AM> AREA 2 LTMR-REC Long-Term Memory Recursive Analysis AREA 2 STEV-REC Short-Term Event AREA 2 LTMS-REC Long-Term Memory Superchief

INTRODUCING PROJECT KONRAD THE DESIGN PHILOSOPHY • The Processing Module (FDPX) and Long-Term Memory (LTM) records are two of the most versatile records in the physical design. • 21 "occurrences" of the FDPX-REC are identified, containing between them a total of 36 functionally (but not physiologically) different types of LTM-REC. • These 21 modules are the building blocks of Konrad's machine mind, and "animal spirits" of an electronic sort flow between them.

KONRAD’S DATA MODEL PROPOSITIONAL ANALYSIS MODULE [LOGICAL PPAN-REC] SCENARIO EVALUATION MODULE [LOGICAL SCEV-REC] TV 22473 MTEV(P PNC) MTEV(B PNC) BACKS SKT) BACKS UNIT TACKE BACKS TACKE PROPOSITIONAL D PROPOSITIONAL TACKE D TRUTHE D SELF MEMORY OBJECT MEMORY TRUTHE MES [LOGICAL NB: PROCESSES TO THE RIGHT OF THIS LINE DELIVER CYCLE LOCOMOTOR (N-1) POSTURAL OUTPUT IF MATCHES TRUE NOT YET IN USE DRAA-REC TRUE{<sememe 1><sememe 2>{{S TAMP 07 ELSE IF MATCHES FALSE DRAA-REC TV 2247 TRUTHEM FALS{<sememe 1><sememe 2>{{S 4 ETAMP 07 TV 224 STEV( PRAXEME ELSE 54 DRAA) LTM(PPNM) RETURN TESTEMEPPSM-REC] POBM-REC] DRAA-REC STEV TRANS KEY TRUTHEM LTM(ACTM) PROPOSITIONAL TRUTH MEMORY NULL{<sememe 1><sememe 2>{{S (DRA LTM(PFMM) MITTE E TAMP 07 DRAQ-REC PROPOSITIONAL FRAME MEMORY PSYCHOLOGICAL ACT MEMORY Q) TRUTHEMES D ONWARD TESTEME{<sememe 1><sememe 2 TRAN DRAMEMESDRAMATIC ANALYSIS MODULE PPNMTRUTHEMES KEY >{{STAMP 05 [LOGICAL DRAN-REC] RECTRUTHEME{? ? ? ? PFMM-REC ACTM-REC SMIT EMES DRAMEME{<sememe 1><se LONG TRUTHEME TED SEMEME meme 2> TEST TV 22453 EMES TV 22453 MTEV(IS TV 22457 MTEV(IS TRUTHE MTEV(IS TD) MTEV(B TV 224 TD) TV 22458 TD) BSKS-REC ME TD) BACKS SKP) 44 BACKS CONCEPTUAL MEMORY MODULE ONWARD STEV(A BACKS SEMEME{sememe{{TSTAMP BACKS TACKE BACKS STEV TACKE KEY FORMEMECTO) TACKE BSKP-REC 04 TACKE ISTD-REC [LOGICAL TACKE D TACKE (SEMCONM-REC] D DRAMEME TRANS D PRAXEME{praxeme{{TSTAMP 08 D TESTEME{<sememe 1><sememe BEHAVIOURAL RELEASE D DRAME D O) DRAME ACTO-REC PRAXEM ONWARD MITTED DRAME 2>{{STAMP 05 TACTICAL LTM(SEMM) MODULE DRAME ACTION MODULE MES PRAXE TRAN MES E- PRAXEME{praxeme{{TSTAMP 08 EKEY PRAXE MES TV 2244 MES SMIT [LOGICAL TTAC-REC] [LOGICAL BREL-REC] ACTEME TV 2244 SEMANTIC MEMORY DOEME MES 3 TV 2244 TED ONWARD 3 ONWARD SEMEMES MTEV( 3 SEME KEY MTEV( KEY SEMM-REC BSKS) MTEV( MES TV 22463 BSKS) SEMEME{sememe TV 22464 TV 22463 BACK BSKS) TV 22464 TV 22463 MTEV(F BACK TV 22464 STEV(P BSKS-REC TV 22483 MTEV(F STACK BACK ACTEM STEV(P MTEV(F TV 22483 TVS) STACK STEV(P SQO) SEMEME{sememe{{TSTAMP TV 22483 MTEV(B TVS) ED STACK ESQO) LTM(TTAM) TVS) MTEV(B BACKS ED SQO) TRANS 04 FORMEM MTEV(B RLB) BACKS SEME ED DOEM TRANS BACKS RLB) TACKE SEME TRANS MITTED EPROCEDURAL SEQUENCE MEMORY RLB) BUFFER MES SEME E MITTED FTVS-REC TACKE PSQO-REC TACKE BUFFER D MES SEMEME MITTED ACTEM LTM(BRLM) BUFFER ED D MES PRAXEMES ACTEME{acteme{{TSTAMP 0 ONWA ACTEME{acteme{{TSTAMP 0 TV 224 D ED ACTEM ES ONWARD MEMORY MODULE ED DOEME ACTEM BSKF-REC PERCEPTUAL RD ES 9 CINGULATE MEMORY TTAM-REC ACTEM DOEME ES BOARDE ES 9 KEY 34 S ES SEMEME{sememe{{TSTAMP [LOGICAL KEY PEMM-REC] PRAXEME{praxeme STEV ES S DUMMY DOEME MES 03 (FRM DRAMEM MAPO-REC TV 22484 O) E BOARDEME{retineme{{TST PRECA LTM(FRMM) STEV(E TRAN ONWARD AMP 02 UTIONA TV 2243 VISUAL FORM MEMORY XEC) TV 2243 SMIT KEY RY MAPX-REC TV 2243 3 ACTEM 3 TED FORMEMES INTERRUPT{TV 22426{{STA 3 MTEV( ES FOR NEURON MODULE UPPER MOTOR MTEV( FOR UPT MP 02 MTEV( BSKF) EXECUT FRMM-REC [LOGICAL MOT 1 -REC] BSKF) MEM TV 22425 TV 22426 (AS BSKF) BACK ION TACTICAL TRACKING MODULE BACK ES VFIGURE{retineme STEV(M LTM(SEQM) NECESS EMOTIONAL EGO MODULE BACK STACK APO) [LOGICAL TTRK-REC] APX) ARY) SEQUENTIAL FORM MEMORY STACK ED [LOGICAL EMOT-REC] ED TRANS CYCLE ED FORM MITTED INTERR FORM EMES TV 22483 LTM(EPIM) EMES RETI BOARD UPT TV 22483 EMES TV 22493 MTEV(B NEM EMES EPISODIC MEMORY MTEV(B RLB) TO FOLLOW E RLB) LTM(SSQM) EPISODES SKM) BUFFER AS LTM(MAPM) BUFFER VISION BACKS SEQUENCE MEMORY ED MUSCLE ON ED COGNITIVE MAP MEMORY TACKE MUSCLEMES DOEME HEARING WA TO FOLLOW DOEME RETI S D BOARDEMES THALAMORD S TOUCH NEM TV 22494 MUSCL CORTICAL KEY TV 2242 MAPM-REC E STEV(S TV 2242 EMES PROJECTION 4 TV 2242 BOARDEME{retineme AS SQO) 4 EXTRA-PYRAMIDAL S MTEV( 4 ENHANCE ON UNIT MTEV( MOTOR (3 RD FIGB) MTEV( FIGUREWA MUSCU FIGB) TRACT SENSORY BACK FIGB) GROUND PYRAMIDAL TV 2241 RD LAR BACK FIGB-REC NEURON) STACK BACK RESOLUTI BASAL MOTOR MODULE MOTOR 4 KEY CONTR STACK 3 SNT-REC BOARDEME{retineme{ ED STACK ON TRACT ACTION ED retineme{TSTAMP 01 STEV( {TSTAMP 02 [LOGICAL BMOT-REC] BOAR ED THALAMIC 3 SNT) TRANSCRIPTION MODULE BOAR DEME BOAR TRANS DEME [LOGICAL TSP 2 -REC] S DEME UNIT MOTOR SCHEMA MEMORY MITTE S TV 2241 S [LOGICAL SCHM-REC] TV 2241 D LTM(TSP 2) 3 TV 2241 3 RETIN THALAMIC MEMORY MTEV( 3 MTEV( EMES[DUMMY] CORTICO-SPINAL VFIG) MTEV( VFIG) LOW DIENCEPHALIC ATTENTIONAL MODULE BACK VFIG) TRACT MODULE VFIG-REC BACK LOW DIENCEPHALIC LORENZIAN MODULE STACK BACK [LOGICAL DAT 1 -REC] EXTRA-PYRAMIDAL [LOGICAL retineme{TSTAMP 01 STACK ED STACK [LOGICAL LRNZ-REC] MOTOR INITIA ED COSP-REC] RETIN ED TRACT TING PRIMITIVE KLEINIAN OBJECT MEMORY RETIN EMES RETIN RETI EMES [LOGICAL PKOM-REC] EMES HORM INSTI NEME ONAL NCTS AS HIGH BRAINSTEM MOTOR MODULE PREINPU PYRAMIDAL ACTIVA T [LOGICAL BSMO-REC] MOTOR MEDIAL KEY BRAINSTEM ATTENTIONAL MODULE TION TRACT LEMNISCUS LOOP (2 ND PROPOSITIONAL SELF AND WORLD ACTS SPEECH ACTS INNENSTAND • Here’s as much as we can safely fit onto a single sheet of A 4. OBJEKTIV COMPONENTS "MISSION MANAGEMENT" • There is a reader-friendly copy of this diagram in your Conference Pack. Further copies can be downloaded from THE BIG BOARD SENSORY NEURON) http: //www. smithsrisca. co. uk/PPTs/konrad-latestcartesian. ppt UNIT MOTOR SKILL MEMORY [LOGICAL SKLM-REC] [LOGICAL BSAT-REC] RETIN EMES OBJECTUM MEDULLARY SENSORY TRANSCRIPTION MODULE [LOGICAL TSP 1 -REC] [GRACILE AND CUNEATE NUCLEI, ETC. ] SPINAL (LOWER MOTOR NEURON) MOTOR MODULE [LOGICAL MOT 2 -REC] FAST PERIPHERAL GANGLIA MODULE REFLEXES AND [LOGICAL PGNG-REC] “FINAL SERVOCOMMON ASSISTANC TRANSDUCTION MODULE PATHWAY” E VER [LOGICAL TDXN-REC] Y FAST REFL EXE S SPINAL/CR ANIAL AFFERENT SENSORY TRACTS SENSORY SYSTEMS EFFECTOR SYSTEMS [EYES, EARS, ETC. ] GEGENSTAND

INTRODUCING PROJECT KONRAD THE ACTIVATION CYCLE DATABASE AREA 2 • As each Processing Module (FDPX) is activated A REALM OF FUNCTIONALLY SPECIFIED INFORMATION PROCESSORS, AND THEIR ASSOCIATED INFORMATION TYPES. AREA 2 FDPX-REC Functionally Discrete Processor • Input STEV accesses resident LTM to see what is appropriate • Output STEV to next FDPX (delete input STEV; keep MTEV copy of output STEV) • MTEVs pruned after parameter-set time (many secs in humans) AREA 2 MTEV-REC Medium-Term Event FDPXs MAINTAIN MANY LTMs <NO AM> AREA 2 KML-REC Innate Read-Only Memory AREA 2 LTM-REC Long-Term Memory Primary Trace LTMR LINKS LTMs <NO AM> FDPXs RECEIVE MANY STEVs <NO AM> MTEVs CONSOLIDATE INTO MANY LTMs <NO AM> LTM OCCURS IN LTMRs <NO AM> LTMs ARE CLUSTERED UNDER LTMSs <NO AM> AREA 2 LTMR-REC Long-Term Memory Recursive Analysis AREA 2 STEV-REC Short-Term Event AREA 2 LTMS-REC Long-Term Memory Superchief • Etc. , etc.

INTRODUCING PROJECT KONRAD THE PHILOSOPHERS’ ZONE PROPOSITIONAL ANALYSIS MODULE [LOGICAL PPAN-REC] SCENARIO EVALUATION MODULE [LOGICAL SCEV-REC] • To date only the 11 processing modules for the higher cognitive functions have been implemented. • I. e. , we are working in the “philosophers’ zone” of robotics. TV 22473 MTEV(P PNC) MTEV(B PNC) BACKS SKT) BACKS UNIT TACKE BACKS TACKE PROPOSITIONAL D PROPOSITIONAL TACKE D TRUTHE D SELF MEMORY OBJECT MEMORY TRUTHE MES [LOGICAL NB: PROCESSES TO THE RIGHT OF THIS LINE DELIVER CYCLE LOCOMOTOR (N-1) POSTURAL OUTPUT IF MATCHES TRUE NOT YET IN USE DRAA-REC TRUE{<sememe 1><sememe 2>{{S TAMP 07 ELSE IF MATCHES FALSE DRAA-REC TV 2247 TRUTHEM FALS{<sememe 1><sememe 2>{{S 4 ETAMP 07 TV 224 STEV( PRAXEME ELSE 54 DRAA) LTM(PPNM) RETURN TESTEMEPPSM-REC] POBM-REC] DRAA-REC STEV TRANS KEY TRUTHEM LTM(ACTM) PROPOSITIONAL TRUTH MEMORY NULL{<sememe 1><sememe 2>{{S (DRA LTM(PFMM) MITTE E TAMP 07 DRAQ-REC PROPOSITIONAL FRAME MEMORY PSYCHOLOGICAL ACT MEMORY Q) TRUTHEMES D ONWARD TESTEME{<sememe 1><sememe 2 TRAN DRAMEMESDRAMATIC ANALYSIS MODULE PPNMTRUTHEMES KEY >{{STAMP 05 [LOGICAL DRAN-REC] RECTRUTHEME{? ? ? ? PFMM-REC ACTM-REC SMIT EMES DRAMEME{<sememe 1><se LONG TRUTHEME TED SEMEME meme 2> TEST TV 22453 EMES TV 22453 MTEV(IS TV 22457 MTEV(IS TRUTHE MTEV(IS TD) MTEV(B TV 224 TD) TV 22458 TD) BSKS-REC ME TD) BACKS SKP) 44 BACKS CONCEPTUAL MEMORY MODULE ONWARD STEV(A BACKS SEMEME{sememe{{TSTAMP BACKS TACKE BACKS STEV TACKE KEY FORMEMECTO) TACKE BSKP-REC 04 TACKE ISTD-REC [LOGICAL TACKE D TACKE (SEMCONM-REC] D DRAMEME TRANS D PRAXEME{praxeme{{TSTAMP 08 D TESTEME{<sememe 1><sememe BEHAVIOURAL RELEASE D DRAME D O) DRAME ACTO-REC PRAXEM ONWARD MITTED DRAME 2>{{STAMP 05 TACTICAL LTM(SEMM) MODULE DRAME ACTION MODULE MES PRAXE TRAN MES E- PRAXEME{praxeme{{TSTAMP 08 EKEY PRAXE MES TV 2244 MES SMIT [LOGICAL TTAC-REC] [LOGICAL BREL-REC] ACTEME TV 2244 SEMANTIC MEMORY DOEME MES 3 TV 2244 TED ONWARD 3 ONWARD SEMEMES MTEV( 3 SEME KEY MTEV( KEY SEMM-REC BSKS) MTEV( MES TV 22463 BSKS) SEMEME{sememe TV 22464 TV 22463 BACK BSKS) TV 22464 TV 22463 MTEV(F BACK TV 22464 STEV(P BSKS-REC TV 22483 MTEV(F STACK BACK ACTEM STEV(P MTEV(F TV 22483 TVS) STACK STEV(P SQO) SEMEME{sememe{{TSTAMP TV 22483 MTEV(B TVS) ED STACK ESQO) LTM(TTAM) TVS) MTEV(B BACKS ED SQO) TRANS 04 FORMEM MTEV(B RLB) BACKS SEME ED DOEM TRANS BACKS RLB) TACKE SEME TRANS MITTED EPROCEDURAL SEQUENCE MEMORY RLB) BUFFER MES SEME E MITTED FTVS-REC TACKE PSQO-REC TACKE BUFFER D MES SEMEME MITTED ACTEM LTM(BRLM) BUFFER ED D MES PRAXEMES ACTEME{acteme{{TSTAMP 0 ONWA ACTEME{acteme{{TSTAMP 0 TV 224 D ED ACTEM ES ONWARD MEMORY MODULE ED DOEME ACTEM BSKF-REC PERCEPTUAL RD ES 9 CINGULATE MEMORY TTAM-REC ACTEM DOEME ES BOARDE ES 9 KEY 34 S ES SEMEME{sememe{{TSTAMP [LOGICAL KEY PEMM-REC] PRAXEME{praxeme STEV ES S DUMMY DOEME MES 03 (FRM DRAMEM MAPO-REC TV 22484 O) E BOARDEME{retineme{{TST PRECA LTM(FRMM) STEV(E TRAN ONWARD AMP 02 UTIONA TV 2243 VISUAL FORM MEMORY XEC) TV 2243 SMIT KEY RY MAPX-REC TV 2243 3 ACTEM 3 TED FORMEMES INTERRUPT{TV 22426{{STA 3 MTEV( ES FOR NEURON MODULE UPPER MOTOR MTEV( FOR UPT MP 02 MTEV( BSKF) EXECUT FRMM-REC [LOGICAL MOT 1 -REC] BSKF) MEM TV 22425 TV 22426 (AS BSKF) BACK ION TACTICAL TRACKING MODULE BACK ES VFIGURE{retineme STEV(M LTM(SEQM) NECESS EMOTIONAL EGO MODULE BACK STACK APO) [LOGICAL TTRK-REC] APX) ARY) SEQUENTIAL FORM MEMORY STACK ED [LOGICAL EMOT-REC] ED TRANS CYCLE ED FORM MITTED INTERR FORM EMES TV 22483 LTM(EPIM) EMES RETI BOARD UPT TV 22483 EMES TV 22493 MTEV(B NEM EMES EPISODIC MEMORY MTEV(B RLB) TO FOLLOW E RLB) LTM(SSQM) EPISODES SKM) BUFFER AS LTM(MAPM) BUFFER VISION BACKS SEQUENCE MEMORY ED MUSCLE ON ED COGNITIVE MAP MEMORY TACKE MUSCLEMES DOEME HEARING WA TO FOLLOW DOEME RETI S D BOARDEMES THALAMORD S TOUCH NEM TV 22494 MUSCL CORTICAL KEY TV 2242 MAPM-REC E STEV(S TV 2242 EMES PROJECTION 4 TV 2242 BOARDEME{retineme AS SQO) 4 EXTRA-PYRAMIDAL S MTEV( 4 ENHANCE ON UNIT MTEV( MOTOR (3 RD FIGB) MTEV( FIGUREWA MUSCU FIGB) TRACT SENSORY BACK FIGB) GROUND PYRAMIDAL TV 2241 RD LAR BACK FIGB-REC NEURON) STACK BACK RESOLUTI BASAL MOTOR MODULE MOTOR 4 KEY CONTR STACK 3 SNT-REC BOARDEME{retineme{ ED STACK ON TRACT ACTION ED retineme{TSTAMP 01 STEV( {TSTAMP 02 [LOGICAL BMOT-REC] BOAR ED THALAMIC 3 SNT) TRANSCRIPTION MODULE BOAR DEME BOAR TRANS DEME [LOGICAL TSP 2 -REC] S DEME UNIT MOTOR SCHEMA MEMORY MITTE S TV 2241 S [LOGICAL SCHM-REC] TV 2241 D LTM(TSP 2) 3 TV 2241 3 RETIN THALAMIC MEMORY MTEV( 3 MTEV( EMES[DUMMY] CORTICO-SPINAL VFIG) MTEV( VFIG) LOW DIENCEPHALIC ATTENTIONAL MODULE BACK VFIG) TRACT MODULE VFIG-REC BACK LOW DIENCEPHALIC LORENZIAN MODULE STACK BACK [LOGICAL DAT 1 -REC] EXTRA-PYRAMIDAL [LOGICAL retineme{TSTAMP 01 STACK ED STACK [LOGICAL LRNZ-REC] MOTOR INITIA ED COSP-REC] RETIN ED TRACT TING PRIMITIVE KLEINIAN OBJECT MEMORY RETIN EMES RETIN RETI EMES [LOGICAL PKOM-REC] EMES HORM INSTI NEME ONAL NCTS AS HIGH BRAINSTEM MOTOR MODULE PREINPU PYRAMIDAL ACTIVA T [LOGICAL BSMO-REC] MOTOR MEDIAL KEY BRAINSTEM ATTENTIONAL MODULE TION TRACT LEMNISCUS LOOP (2 ND PROPOSITIONAL SELF AND WORLD ACTS SPEECH ACTS INNENSTAND OBJEKTIV COMPONENTS "MISSION MANAGEMENT" THE BIG BOARD SENSORY NEURON) UNIT MOTOR SKILL MEMORY [LOGICAL SKLM-REC] [LOGICAL BSAT-REC] RETIN EMES OBJECTUM • In other words Konrad is a robot without a body. MEDULLARY SENSORY TRANSCRIPTION MODULE [LOGICAL TSP 1 -REC] [GRACILE AND CUNEATE NUCLEI, ETC. ] SPINAL (LOWER MOTOR NEURON) MOTOR MODULE [LOGICAL MOT 2 -REC] FAST PERIPHERAL GANGLIA MODULE REFLEXES AND [LOGICAL PGNG-REC] “FINAL SERVOCOMMON ASSISTANC TRANSDUCTION MODULE PATHWAY” E VER [LOGICAL TDXN-REC] Y FAST REFL EXE S SPINAL/CR ANIAL AFFERENT SENSORY TRACTS SENSORY SYSTEMS EFFECTOR SYSTEMS [EYES, EARS, ETC. ] GEGENSTAND

KONRAD’S COGNITIVE HIERARCHY • Here is a simplified view of the 11 sectional blocks of COBOL (no theoretical limit), with two doubled up at top right. • Short-term memory transmission between modules. • Each LTM occurrence with A-Keys and B-Keys. • Activated cyclically. INPUT

KONRAD’S PROCESSING LOOPS • Many important sub-cycles. • The four blue arrows show feedforward processing. • The two red arrows show re-entrant - or "feedback" – processing. • Simulates “efference copy” in biology. INPUT

INTRODUCING KONRAD THE ROBOT AWAITING A BODY • We also gave Konrad a simulated “will”, that is to say, a point at which its thoughts could become voluntary actions. INPUT

INTRODUCING KONRAD THE BASIC PROCESSING CYCLE • We also allowed Konrad to take its own silent verbal outputs as silent inputs. NB: YOU CAN'T “SCIENTIFICALLY” STUDY INNER SPEECH IN HUMANS BECAUSE IT IS A SELFDESTRUCTIVE PROCESS INNER SPEECH INPUT

INTRODUCING KONRAD THE BASIC PROCESSING CYCLE • It has been known since the 1950 s that the mind cycles about 7 times a second … INPUT

INTRODUCING KONRAD THE BASIC PROCESSING CYCLE • We also allowed Konrad to take inputs from its own emotional level. FEELS NASTY IS NASTY So that it can now talk about what it feels. INNER SPEECH INPUT

INTRODUCING KONRAD THE PROGRAM STRUCTURE Konrad’s Jackson Diagram runs to eight sheets of A 4. Email the author at smithsrisca@btinternet. com For a copy if interested

INTRODUCING KONRAD THE POINT OF IT ALL IF YOU WANT TO DESIGN AN AUTONOMOUS SYSTEM, YOU NEED TO VISUALISE THE ACTIVITY OF THE INNERMOST NUMSKULL!!!

INTRODUCING KONRAD THE PROCESSING SUITE THINKING AS RESEARCH DATA! THE KONRAD 2 DATABASE CA IDMS DATABASE DETAILED LOG PRINTLOG COMMANDS FILE E SP H EC - KONRAD MAIN -TO SEMIOTICS FROM MAINFRAME FILE DOWNLINE LINGUISTIC INTERFACE T EX T PC DISPLAY KINESICS MOBILE DEVICE KINESICI FILE FROM MAINFRAME DOWNLINE ROBOTIC INTERFACE PC DISPLAY SE RUN NO LANGUAGE TO RESPOND IN PROPOSITIONAL OUTPUT STREAM FR OM MA OV EC TO RS IN JCL PARAMETERS FR AM THINKING MADE VISIBLE! Specimen on next sheet … RV E MOBILE DEVICE PROPOSITIONAL SEQUENCE FILE COMING SOON INTERACTIVE USER

INTRODUCING KONRAD How Konrad processes Den Namenlosen THE PROCESSING SUITE THE KONRAD 2 DATABASE CA IDMS DATABASE ITHERE EXISTS A BATTLEFIELD THINKING OMY ACT IS NULL+ACTEME AS RESEARCH DATA! ITHERE EXISTS A PAINTING OMY ACT IS NULL+ACTEME ITHERE EXISTS A VIEWING+ARTWORK DETAILED LOG OMY ACT IS NULL+ACTEME ITHERE EXISTS A MEN IN LANDSCAPE OMY ACT IS NULL+ACTEME DOWNLINE PC DISPLAY SEMIOTICS LINGUISTIC ITHERE FILE EXISTS A NO-MAN'S-LAND INTERFACE OMY ACT IS NULL+ACTEME DOWNLINE ITHERE EXISTS A SOLDIERS, GERMAN PC DISPLAY KINESICI ROBOTIC FILE INTERFACE OMY ACT IS NULL+ACTEME FR ITHERE EXISTS A SOLDIERS, CARICA OM AI NF OMY ACT IS MNULL+ACTEME RA M ITHERE EXISTS EA SHELL HOLES MOBILE DEVICE OMY ACT IS NULL+ACTEME PROPOSITIONAL SEQUENCE ITHERE EXISTS A VISCERAL+DISQUIE FILE COMING SOON OMY ACT IS NULL+ACTEME PRINTLOG COMMANDS FILE KONRAD MAIN E SP H EC - -TO T EX T SEMIOTICS FROM MAINFRAME KINESICS MOBILE DEVICE THINKING MADE VISIBLE! RUN NO LANGUAGE TO RESPOND IN JCL PARAMETERS FROM MAINFRAME SE RV OV EC TO RS PROPOSITIONAL OUTPUT STREAM INTERACTIVE USER

IN CONCLUSION. . .

ART - A SURPRISINGLY DIFFICULT SCIENCE THE MIND WORKS CYCLICALLY, CONSTANTLY SAMPLING THE PERCEPTUAL AND EMOTIONAL WORLDS. MAIN LOOP SEVEN TIMES A SECOND INPUT

ART - A SURPRISINGLY DIFFICULT SCIENCE THE TRULY MYSTERIOUS MOMENT COMES WHEN OUR HIGHER MIND COMES TO FEEL ITS OWN EMOTIONAL RESPONSE. FEELS NASTY INNER SPEECH INPUT

ART - A SURPRISINGLY DIFFICULT SCIENCE PRINTED OUTPUT GIVES US SOME IDEA WHAT NEEDS TO BE MOVED, FROM WHERE TO WHERE, AND IN WHAT ORDER. WE SEE THE BRAIN IN SLOW MOTION, COMPLETE WITH EVERY LONG- AND SHORT-TERM MEMORY ACCESS AND THE ACTIVATION KEYS USED. INPUT

CALL FOR COLLABORATION CONTACT THE AUTHOR smithsrisca@btinternet. com IF YOU THINK KONRAD MIGHT BE ABLE TO HELP YOUR RESEARCH OR ARTISTIC PRACTICE

THE END DATABASE AREA 2 A REALM OF FUNCTIONALLY SPECIFIED INFORMATION PROCESSORS, AND THEIR ASSOCIATED INFORMATION TYPES. AREA 2 FDPX-REC Functionally Discrete Processor AREA 2 MTEV-REC Medium-Term Event FDPXs MAINTAIN MANY LTMs <NO AM> AREA 2 KML-REC Innate Read-Only Memory AREA 2 LTM-REC Long-Term Memory Primary Trace LTMR LINKS LTMs <NO AM> FDPXs RECEIVE MANY STEVs <NO AM> MTEVs CONSOLIDATE INTO MANY LTMs <NO AM> LTM OCCURS IN LTMRs <NO AM> FEELS NASTY IS NASTY LTMs ARE CLUSTERED UNDER LTMSs <NO AM> INNER SPEECH AREA 2 LTMR-REC Long-Term Memory Recursive Analysis AREA 2 STEV-REC Short-Term Event AREA 2 LTMS-REC Long-Term Memory Superchief INPUT

STILL THE END THINKING AS RESEARCH DATA! THE KONRAD 2 DATABASE CA IDMS DATABASE DETAILED LOG PRINTLOG COMMANDS FILE E SP H EC - KONRAD MAIN -TO SEMIOTICS FROM MAINFRAME FILE DOWNLINE LINGUISTIC INTERFACE T EX T PC DISPLAY KINESICS MOBILE DEVICE KINESICI FILE FROM MAINFRAME DOWNLINE ROBOTIC INTERFACE PC DISPLAY SE RUN NO LANGUAGE TO RESPOND IN PROPOSITIONAL OUTPUT STREAM FR OM MA OV EC TO RS IN JCL PARAMETERS FR AM THINKING MADE VISIBLE! Specimen on next sheet … RV E MOBILE DEVICE PROPOSITIONAL SEQUENCE FILE COMING SOON INTERACTIVE USER

Copyright Notice: This material was written and published in Wales by Derek J. Smith, CEO of High Tower Consultants Limited, Chief Designer on the Konrad artificial consciousness project, and Editor of the Smithsrisca series of cognitive science study resources. It forms part of a multifile e-learning resource, and subject only to acknowledging Derek J. Smith's rights under international copyright law to be identified as author may be freely downloaded and printed off in single complete copies solely for the purposes of private study and/or review. Commercial exploitation rights are reserved. The remote hyperlinks have been selected for the academic appropriacy of their contents; they were free of offensive and litigious content when selected, and will be periodically checked to have remained so. Prior scholarship is acknowledged throughout, and precise references may be obtained from the author if needed. Internet images have been used in good faith on the understanding that they were in the public domain when imported. Copyright © 2014, High Tower Consultants Limited. Publication was by Power. Point presentation on 9 th July 2014. This online version comes to you for follow-up private study.