11 th Early Fall School of Semiotics SEMIOTICS

11 th Early Fall School of Semiotics “SEMIOTICS AND GENRE” September 10 -16, 2005, Sozopol, Bulgaria Visual semiotics and space cognition: on the dynamics of two dimensional representations of space and action Wolfgang Wildgen 1

Part I: Picture versus text n The distinction between picture and text involves a set of basic semiotic challenges. First, pictures are linked in their production to the motricity of hands, in their receipt by the eye and the visual cortex. Language in its basic form, spoken language, is linked in its production to the motricity of the human vocal apparatus (from the vocal cords to the lips) and in its perception to the ear and the auditory cortex. The dynamics of these four subsystems and moreover the coordination of the pairs of subsystems in production and reception define the base line of any comparison of picture and text. 2

At least two levels that must be separated: n the evolutionary basic distinction between a mode of manual/visual and a mode of phonetic/auditory communication, n the application of manually based techniques to materials (with color or luminosity differences) and media (canvas, paper, glass, etc. ) applying specific instruments (crayon, paint brush, chisel etc. ) is basic for products of the visual arts. This applies also to writing. As a consequence, pictures refer to a highly developed culture of materials, techniques and media 3

The linearity of language? A first confrontation with pictures Unidirectional process Dependence on past or future steps of the process Garden path and reanalysis Major deviations of the unidirectional linearity of language. 4

Fractal patterns (between d=0 und d=2 Cantor-set (d < 1) Sierpinki-triangle (d < 2) 5

From one dimensional language to two dimensional pictures Language ends Silence Language starts Virtual dynamics of “silence” in communication dynamics of corners dynamics of sub-squares Rotational dynamics (45 o) Virtual dynamics of a square (diagonal, horizontal/perpendi cular and spiral force-lines). 6

The flat structure of the atom “gold” Historical mandalas as a demonstration of the multiplicity of dynamical and symmetrical structures in a circular space 7

Steady increase in the number of corners (and therefore of implicit dynamic fields) with d (dimension) n n n two end points in a line segment four corners in a square eight corners in a cube sixteen corners in a four dimensional cube 32, 64, 128 … corners if we increase further the dimensionality of the cube 8

Implicit force fields and the organization of content n n n In producing a picture these force-fields are relevant. A strong preference is given to rectangular frames which are near to the ideal (the square) but introduce a basic asymmetry. If we take the painting the “Last Supper” of Leonardo da Vinci (cf. Wildgen 2002, 2004 b and 2004 a: chapter 6), the prominent table of the supper fills the basic horizontal line and Christ marks the intersection with a vertical line of symmetry. 9

Part II: Geometry and Dynamics in the Art of Leonardo da Vinci was born in 1452 in Vinci near Florence. He made the first steps of his career in Florence, where he worked under Verrocchio, became master in his workshop and in 1477 independent master. In 1482 Leonardo asked Ludovico Sforza in Milan for an employment. He stayed in Milan until 1499, when Milan was taken by the French troupes. Leonardo left Milan and returned to Florence. In 1506 Leonardo was invited to Milan by the French governor, Charles d’ Amboise, and worked there until 1513. He left Milan because of the pestilence and went to Rome and left Rome invited by François I, king of France, together with his pupils Melzi and Salai. From 1516 until his death in 1519 Leonardo lived in the Castel Cloux near Amboise in France. 10

The two basic pillars of Leonardo’s semiotics of art are: 1. (linear, of color, vanishing); we shall deal with it under the topic of geometry. 2. Dynamics (force, weight, counterpoise, balance, movement, percussion, etc. ). 11

“Last Supper” by Leonardo da Vinci (Milan) 12

Force-fields in the “Last Supper” . . Eigene DateienPräsentationenNarrative Struktur und visuelle Interpretation. ppt 13

n n As this example shows, all three force fields we analyzed in the case of a void frame are used to organize specific contents (surfaces, figures, persons in space) in Leonardo’s mural painting. The head (ear) of Jesus is at the center of all force fields. The sub centers of the groups of apostles lie in the intersections between the horizontal axis and the symmetric spiral which end at Jesus’ head (ear). The rectangle of the whole mural painting breaks the symmetry of the (ideal) square. The perspective generates a subdivision of the background space into three equal zones. In the central zone are situated: Jesus, John (at the right of Jesus), and Thomas, James Major (at the left of Jesus); Judas is already outside of this field although he has the second position at the right of Jesus. Peter and Philip are at the intersections of these fields. [1] 14

Basic content complexes organized in Leonardo’s painting n n The table in the fore ground. The perspective of the dining room, the windows, the landscape visible through the window, the subdivision of the background into three equal sub fields. The arrangement of 12 apostles (grouped by 4 x 3) on both sides of Jesus. The gestures (body poses) and glances of Jesus and his apostles superimpose a further dynamical structure. 15

The geometrical scheme is that of a pyramid with the angel on the second (visible) side of it. The front side has on its vertex the face of the Virgin, on its edges, the Jesusbaby at the right and St. John Baptist as baby on the left (above the baseline of Jesus and the angel). 16

Mary hold John protect Angel point adore The pyramid in the “Virgin in the Rocks”. bless Jesus 17

The hand gestures alone define five different force-lines and all four persons have different gaze-lines involving different angles of the head. All these forces imply some narrative context, i. e. , Leonardo tries to concentrate a complex story in the static configuration of one painting. Drawing-study for the pointing gesture of the angel 18

The semiotics of a figural composition A sketch for the Epiphany 19

The triangle is asymmetric as the right side is the line between the gaze of Mary and Jesus which point to the face of a kneeing Magus. This is the central force line inscribed into the triangle. 20

Levels of semiotic analysis: - The space (time) of the scene depicted (perspective, light/shadow, outfit of the scenario). - The thematic persons. These constitute a relational schema which is represented by their relative positions in space, the static relations and the movements (e. g. , the relative movement of the head in relation to the trunk, the gestures of the hands, the directions of gaze). - A narrative content related to a known episode. The scene may be identified as one moment resulting from a series of prior events and having specific (known) consequences 21

Part III: Dimensional transitions, symmetry, and transformations n n An architecture (3 -space) is represented in an illusionist painting (trompe l’œil), but one can neither enter the room nor move before it without destroying the illusion. A sculpture is represented in a mural painting; one part may be sculpted, the other painted. In a proper position against the wall, it may be difficult to grasp the difference between 3 -space and 2 space. A text describes a landscape, a building, a person either directly or as represented in a painting. A sentence contains an action scenario (in 3 -space + time) in its valence structure, e. g. , “Eve gives Adam an apple in the garden Eden”. The action in 3 -space + time is flattened to a sentence with verb and case assignments/linear order. 22

Compression of information n The technique of perspective (rediscovered in the Renaissance) codes artificially for the third dimension; gestures, glances, frozen actions code for the temporal dimension. The technique of valence patterns (control of NPs), case assignment, etc. , codes for the spatial parameters and allows their flattening into a sequence of verb (V) + subject (S) + object (O), etc. (in different orders dependent on the type of langue: SVO, SOV, VSO, etc. ). All the non spatial or non temporal dimensions are coded for by attributes/shape modifications/colors in a painting or by lexical differentiations in a sentence. 23

Symmetry and chaos controllers as guarantees for semiotic stability Group operation on a triangular star: • Identity (translation) • Rotation (120°) • Mirroring on an axis 24

Hexagonal symmetry in a snow flake 25

Spatial symmetry in language (rare) S ATOR AREPO TENET OPERA ROTA S The sower (sator), called Arepo directs (tenet) The carriage (the wheels =rotas) with care (opera) 26

Leyton‘s generative geometry and the semiotics of pictures n n „GENERATIVE GEOMETRY: A geometric object is one from which the transfor mations are recoverable; i. e. a geometric object is a memory store. ” The regularity of the base space is the presupposition for the generation of “information” on deformations, asymmetries inscribed into the (pre informative) space. 27

Translation Rotation The generation of a square and a rod via group operations 28

Generation of complexity n n By a multiplication of basic types, By an intersection or blending of different entities, e. g. curved (sphere) and straight (cube). By an approximation of living forms (plants, animals, humans) in their geometry. By the addition of decorative patterns 29

Example from architecture: the townhall in Bremen Renaissance transformation of a gothic town hall Decorative elements 30

New geometrical devices in the 20 th century Opera in Sidney, 1957 -1973, and the spherical geometry which underlies its construction 31

Conclusions n n n Dimensionality fixes the basic geometry and dynamics which govern the organization of forms. Symmetries restrict possible constructions and thus contribute to the stability of the result. Capacities for meaning generation are created by possible deviations from the symplest and most symmetric forms (Leyton‘s axiom). Natural semiosis is a process of memory generation and exploits systematically the geometry and dynamics of underlying forms. Decorative elements are inserted into the basic geometric and dynamic structure and profit from its memory function. 32

End of the presentation n n For further materials on the topic, cf. http: //www. fb 10. uni bremen. de/homepages/homepagebyid. asp? id=34 33