FRACTALS LINDENMAYER SYSTEMS. November 22, 2013 Rolf Pfeifer Rudolf M. Füchslin

Transcription

1 FRACTALS LINDENMAYER SYSTEMS November 22, 2013 Rolf Pfeifer Rudolf M. Füchslin

2 RECAP

3 HIDDEN MARKOV MODELS

4 What Letter Is Written Here?

5 What Letter Is Written Here?

6 What Letter Is Written Here?

7 The Idea Behind Hidden Markov Models First letter: Maybe a, maybe q Second letter: Maybe r or v or u Take the most probable combination as a guess!

8 Hidden Markov Models Sometimes, you don t see the states, but only a mapping of the states. A main task is then to derive, from the visible mapped sequence of states, the actual underlying sequence of hidden states.

9 HMM: A Fundamental Question What you see are the observables. But what are the actual states behind the observables? What is the most probable sequence of states leading to a given sequence of observations?

10 The Viterbi-Algorithm We are looking for indices M 1,M 2,...M T, such that P(q M1,...q MT ) = P max,t is maximal. 1. Initialization 2. Recursion (1 t T-1) () i 1 ( i) 0 1 b i i k 1 ( j) max( ( i) a ) b t 1 t i j j k i t ( j) i : ( i) a max. t 1 t i j 1 3. Termination 4. Backtracking P max, T max( ( i)) q q : ( i) max. max, T i T M T t t 1 Mt 1 ( )

11 Efficiency of the Viterbi Algorithm The brute force approach takes O(TN T ) steps. This is even for N = 2 and T = 100 difficult to do. The Viterbi algorithm in contrast takes only O(TN 2 ) which is easy to do with todays computational means.

12 Applications of HMM Analysis of handwriting. Speech analysis. Construction of models for prediction. Only few processes are really Markov processes (neither writing nor speech is), but often, models based on Markov processes are good approximations.

13 END RECAP

14 FRACTALS

15 Natural Geometry Geometry in text books Geometry in nature

16 Fractals: Informal Definition Termed coined by Benoit Mandelbrot Geometry without smoothness Structure on all scales (detail persists when zoomed arbitrarily) Geometrical objects generally with non-integer dimension Self-similarity (contains infinite copies of itself)

17 Fractals in the Human Body Kidney Lung Cortical surface (?)

18 The Length of Borders Lewis Fry Richardson: Probability of war between two adjacent countries proportional to length of border? Checking the theory required gathering data about border lengths. Surprising finding: There are strongly varying numbers in the literature.

19 The Border of Great Britain

20 The Border of Great Britain The closer you look, the longer the border. And the growth doesn t stop!

21 A Slightly Different View on Dimension

22 One-Dimensional Objects 1 N c1 : Diameter of disk N : Number of disks c : Constant 1

23 Two-dimensional Objects N? : Diameter of disk N c 2 : Number of disks : Constant

24 Two-dimensional Objects c2 N : Diameter of disk N c : Number of disks : Constant

25 Definition of the Fractal Dimension D 1 N c : Diameter of disk N : Number of disks c : Constant D: Hausdorff Dimension The number of disks necessary for covering a structure grows with shrinking λ. D log( N ( )) log( c) log( N ( )) log( N( )) lim lim lim log( ) log( ) log( )

26 Example: The Sierpinski Triangle Construction of the Sierpinski-triangle A Sierpinski triangle contains a whole copy of itself in its parts.

27 Example: The Sierpinski Triangle Construction of the Sierpinski-triangle D log( N( )) lim 0 log( )

28 Example: The Sierpinski Triangle Hausdorff Dimension: D n log(3 ) log(3) lim n 1 log( ) log(2) n 2 Area of Sierpinski triangle A N lim n 1 n n Boundary length of ST: n 1 L 3KN lim3k3 n 2 n 2

29 Example: Cantor Dust Take out the middle third! D log( N ( )) lim 0 log( )

30 Example: Cantor Dust Take out the middle third! L D lim n log(2 ) log(2) 1 log(3) log( ) 3 n n 1 lim(no elements = 2 ) (length element = ) n n 3 n

31 Example: The Mandelbrot Set

32 Example: The Mandelbrot Set 2 n 1 n z z c z 0, c C n 1 n n x x y a y x y b 2 n 1 n n z x iy, c a ib

33 The Mandelbrot Set

34 Three-Dimensional L-Systems

35 Compressibility The Mandelbrot looks complex. The algorithm describing the Mandelbrot-set is very short. Procedures generating fractal structures give a very compressed form of storing complex-looking shapes. Directly storing these pictures is actually impossible. 2 n 1 n z z c z 0, c C 0

36 Self-Similarity and Scale-Invariance When each piece of a shape is geometrically similar to the whole, both the shape and the cascade that generate it are called self-similar. (B. Mandelbrot) Contains infinite copies of itself Scaling/Scale = The value measured for a property does not depend on the resolution at which it is measured Two types of invariance: - Geometrical - Statistical

37 Fractals in Reality Strict self-similarity is mostly found in mathematical examples. Statistical interpretation of self-similarity: If a part of system can be zoomed up, and this part shows the same statistical properties as the whole system, one speaks of self-similarity. In reverse (and more important), if coarse-graining does not change the statistical properties of a system, one speaks of self-similarity.

38 Non-Fractal Random distribution of spheres with uniform radius.

39 Fractal Random distribution of spheres with varying random radius (power law distribution).

40 Self-Similarity and Coarse-Graining or Coarse graining = formation of blocks with averaged properties

41 Self-Similarity in Reality ρ= 0.55 ρ= 0.5 SELF SIMILARITY ρ= 0.6 ρ= 0.7 Physically important in the description of phase transition.

42 Fractal Dimension of Time Series Univ. Zürich: G. Wieser, P. F. Meier, Y. Shen, HR. Moser. R. Füchslin EEG EEG during epileptic seizure Some statistical measures such as the fractal correlation dimension D2 decrease shortly before and during an epiliptic seizure. D2 can be used as a diagnostic measure.

43 Random Numbers Question: Is a random number self similar?

44 LINDENMAYER-SYSTEMS: STUDYING DEVELOPMENT USING FORMAL LANGUAGES

45 A Real Puzzle Nature is full of well-structured objects. These objects are not assembled using global control and a blue-print, but emerge from local behavior. External control Self-organization

46 Self-Assembly is Powerful, but. Even if self-assembly processes may lead to non-trivial and finite structures with global shape and mesoscopic pattern induced by microscopic interactions, it is not the way how nature works. Paul. W. Rothemund

47 Developmental Representation vs. Blueprint All higher living organism develop from a fertilized egg (a zygote) into their adult form. This process is, at least to a large degree, controlled by their respective genome. Is it that the genome contains a sort of "blueprint" of the organism?

48 Developmental Representation vs. Blueprint All higher living organism develop from a fertilized egg (a zygote) into their adult form. This process is, at least to a large degree, controlled by their respective genome. It is NOT TRUE that the genome contains a sort of "blueprint" of the organism. Rather, the genome contains instructions which lead to molecules that in the interaction with the environment lead to organisms.

49 Developmental Representation vs. Blueprint Developmental process is influence by: An initial seed. The (probably time-dependent) interactions of the building blocks of a body The environment and the physical and chemical laws ruling this environment. Developmental representations are iterative in the sense that they tell you how to proceed if there is already something there.

50 Developmental Representation vs. Blueprint The genome does not contain all the information it needs to build your body. Development requires embodiment! Instructions for construction = Developmental representation + Laws of the environment

51 Formal Languages Are Not Enough How to describe development by a formal system? Problem: The languages we know do not necessarily lead to globally structured outcomes with repetitive patterns. Reason: External decision of location where a replacement rule is applied.

52 On Growth and Form: L-Systems The patterns observed in multicellular algae are the result of developmental processes Mathematical formalism introduced in 1968 by Aristid Lindenmayer. Productions are rewriting rules which state how new symbols (or cells) can be produced from old symbols (or cells)

53 L-Systems / Rewriting Systems Lindenmayer systems belong to the general class of parallel grammars or parallel rewriting systems. Difference to grammars as we know them: In a parallel rewriting system, rules are applied to all possible instances simultaneously. L-systems are subsets of languages. Most practical L-systems are related to context-free languages. Context-free grammars suit the emulation of maturation and division. Context-free language A A V, ( V )

54 The Cantor Set as an L-System Non-Terminals (variables): AB, Terminals (constants) : none Start : A Rules : A B ABA BBB

55 The Cantor Set as an L-System Non-Terminals (variables): AB, Terminals (constants) : none Start : A Rules : A B ABA BBB 1. A 2. ABA 3. ABABBBABA 4. ABABBBABABBBBBBBBBABABBBABA 5....

56 Anabaena Catenula

57 A Bio-Inspired L-System Anabeana catenula: Two types of polar cells, photosynthesis and nitorgen fixation Variables : A, A, B, B Constants : none Start : A Rules : A AB A BA B A B A

58 Visualization: Turtle Graphics + - F Move forward by distance F Rotate by angle δ Rotate by angle -δ Bracket notation: [ : Store position and direction ] : Go back to position and direction of matching [

59 Visualization; Turtle Graphics Simple system: Axiom (Start): F Rule: F F[-F][+F] Angle: 30

60 More Plants

61 Professional Visualization

62 Generalizations?

63 Generalizations Stochasticity Contex sensitive rules Delay times Reaction-diffusion systems

64 Homology of Structure

65 Potential Advantages of Development Compact description Supports symmetry Supports modularity Supports reuse of mechanisms in different contexts. Supports scalability Decentralized control by self-orgnaization and parallelism. Turns out to be robust Enables adaptivity Change of structure can be achieved by small changes. Change of structure by change of timing (heterochrony). Evolvability