MCB419 logo  


Office hours:
5229 Beckman Institute
Mon 12-2
Quiz 2 ANS KEY


Please bring a laptop to every class session. If this is a problem, talk to Prof. Nelson.

Week 1: introduction; evolution of intelligence

Tue, Jan 15

Topics: intro to the course, intro to p5js
Slides: PowerPoint 1
Readings: none

Thu, Jan 17

Topics: emergence of life; more p5js
Readings: Hawking S (1994) Life in the Universe
Timeline of evolutionary history of life
Learn X in Y minutes; X = javascript
Learn X in Y minutes; X = html
Sketches: House, Ball_1, Bouncing Ball
Week 2: Modeling organisms as physical objects; object-oriented programming

Tue, Jan 22

Topics: p5js tutorial, objects, arrays
Readings: none
Videos: TED talk: Martin Hanczyc, The line between life and not-life
FYI: NEWS: No signs of alien life? Maybe they're all extinct.
Chopra and Lineweaver (2016) The Case for a Gaian Bottleneck: The Biology of Habitability.

Thu, Jan 24

Topics: simple foraging example
Readings: none
Videos: none
Sample code: Multiple Balls
Week 3: behavior without a nervous system, bacterial chemotaxis

Tue, Jan 29

Topics: Topics: single-cell intelligence; kinesis and taxis
Slides: PowerPoint 3
Readings: Dusenbery DB (1996) Life at Small Scale. Scientific American Library. Chapter 1, Invisible Organisms, pp 2-17 (16 pp). microbes, food chains, hunting vs farming
Zupanc GKH (2004) Behavioral Neurobiology: An Integrative Approach. Oxford Press. 80-88 (9 pp) classification of orienting movements; orienting behavior without a nervous system
Sketches: TBA

Thu, Jan 31

Topics: Topics: bacterial chemotaxis; run-tumble behavior
Slides: PowerPoint 4
Readings: Jurica MS, Stoddard BL (1998) Mind your Bs and Rs: Bacterial Chemotaxis, signal transduction, and protein recognition" Structure 6:809-813 (5 pp) bacterial chemotaxis, coupling sensors to effectors
Videos: Bacterial chemotaxis
Week 4: sensory information processing

Tue, Feb 5

Topics: obstacle avoidance in paramecia; electrical signaling; emergence of multicellular organisms; Braitenberg vehicles;
Slides: PowerPoint 5
Readings: Braitenberg V (1984) Vehicles: Experiments in Synthetic Psychology. MIT Press. pp. 1-14 (14 pp) Braitenberg Vehicles
Videos: Paramecium caudatum
Plot lib: mplot.js
Participation: array stats template ... solution
Sketch: Simple paramecium, Lowpass filter demo

Thu, Feb 7

Topics: Dusenbery: What is information?;
Cariani: Information relationships (syntactic, semantic, pragmatic)
Slides: PowerPoint 6
Readings: Dusenbery DB (1996) Information is where you find it. Biol. Bull. 191:124-128 (5 pp) Information from a biological perspective; genome (evolutionary times), memory (lifetime), sensory (current state).
Cariani P. (1991) Some epistemological implications of devices which construct their own sensors and effectors. In: Varela F, Bourgine P eds. Towards a practice of autonomous systems. Cambridge, MA: MIT Press, 484-493 (10 pp) Information relationships (syntactic, semantic, pragmatic)
Quiz: Paper-based quiz (multiple-choice) over javascript and p5js programming
Week 5: Braitenberg vehicles (continued)

Tue, Feb 12

Topics: Programming quiz wrap-up;
New javascript constructs;
HW04 help session
Videos: Braitenberg Vehicles

Thu, Feb 14

Topics: HW05 overview
Week 6: natural selection, genetic algorithms

Tue, Feb 19

Topics: evolutionary computation, genetic algorithms
Readings: Shiffman, Chapter 9 - Evolution of Code, Sections 9.1-9.8
Videos: Shiffman, 9.1 Evolutionary Computing(20:00) (Watch FIRST 20 minutes)
Sample code: Shakespeare GA_demo
Gene-based wander controller

Thu, Feb 21

Topics: evolutionary computation, genetic algorithms
Readings: Shiffman, Chapter 9 - Evolution of Code, Sections 9.9-9.13
Videos: Shiffman, 9.1 Evolutionary Computing(20:00) (Watch LAST 20 minutes)

Week 7: emergence of animals and nervous systems

Tue, Feb 26

Topics: emergence of animals and nervous systems, intro to C. elegans
Readings: Ferree TC, Lockery SR (1999) Computational rules for chemotaxis in the nematode C. elegans. J Comput Neurosci 6:263-277 (15 pp)
Videos: A brief introduction to C. elegans (2:11)
Slides: PowerPoint 7

Thu, Feb 28

Topics: area-restricted search in C. elegans, neuromodulation
Readings: Hills T, Brockie PJ, Maricq AV (2004) Dopamine and glutamate control area-restricted search behavior in Caenorhabditis elegans. J Neurosci 24:1217-1225 (9 pp)
Code: RC filters
Slides: PowerPoint 8
Week 8: Cambrian explosion, insect brains, vertebrate brains

Tue, Mar 5

Topics: Cambrian explosion, insect brains
Readings: Beer R, Chiel J, Sterling L (1991) An artificial insect. American Scientist, 79:444-452 (9 pp)
Videos: none
Slides: PowerPoint 09

Thu, Mar 7

Topics: vertebrate brains, toad visuomotor behaviors, prey capture
Readings: Carew TJ (2000) Behavioral Neurobiology, Chapter 4, Feature Analysis in Toads. 95-119 (25 pp)
Videos: Neuroethology of Toads (Part 1: Behavior)
Neuroethology of Toads (Part 2: Neural Basis)
Slides: PowerPoint 10
Week 9: Midterm Exam

Tue, Mar 12

Topics: Review session for midterm exam
Slides: Midterm Review

Thu, Mar 14

Midterm Exam

Week 10: spike-based models, vertebrate visuomotor circuits

Tue, Mar 26

Topics: threshold logic, integrate-and-fire models, lamprey model I
Readings: Braitenberg V (1984) Vehicles: Experiments in Synthetic Psychology. pp. 15-25 (11 pp)
Videos: Visually Guided Locomotion in Lamprey
Slides: PowerPoint 11
Demo: Demo: Braitenberg spiking model
Exercise: Threshold Logic_template (threshold-logic programming)

Thu, Mar 28

Topics: lamprey model continued, place-code to rate-code conversion
Readings: Kamali Sarvestani I, Kozlov A, Harischandra N, Grillner S, Ekeberg O (2012) A computational model of visually guided locomotion in lamprey. Biol. Cybern Nov 2012 (16 pp)
Videos: none
Slides: none
Week 11: Associative learning

Tue, Apr 2

Topics: learning and memory, honeybee foraging, proboscis extension reflex (PER)
Slides: PowerPoint 15
Readings: Carew TJ (2000) Behavioral Neurobiology, Chapter 9, Associative Learning in Honeybees. 271-300 (30 pp)

Thu, Apr 4

Topics: neural basis of PER, associative learning models, delta rule
Slides: PowerPoint 16
Readings: Montague PR, Dayan P, Person C, Sejnowski TJ (1995) Bee foraging in uncertain environments using predictive Hebbian learning. Nature 377:725-728 (4 pp)
Demo: Bee two-choice demo
Week 12: Spatial navigation, memory systems, reinforcement learning

Tue, Apr 9

Topics: spatial navigation, desert ants; intro to reinforcement learning
Slides: PowerPoint 17
Readings: Wehner R (2003) Desert ant navigation: how miniature brains solve complex tasks. J. Comp. Physiol. A 189: 579-588 (10 pp).

Thu, Apr 11

Topics: Memory systems; Reinforcement learning; Q-learning algorithm
Slides: PowerPoint 19
Readings: (1) Squire LR (2004) Memory systems of the brain: A brief history and current perspective. Neurobiol Learn Mem 82:171-177 (7 pp.)
(2) Clayton NS, Bussey TJ, Dickinson A (2003) Can animals recall the past and plan for the future? Nat Rev Neurosci 4:685-691 (7 pp.)
Week 13: Communication between agents, Midterm #2

Tue, Apr 16

Topics: Agent communication, ant pheromone trails
Slides: PowerPoint 21

Thu, Apr 18

Midterm Exam #2

Week 14: neural networks, learning algorithms, Q-learning

Tu, Apr 23

Topics: Neural networks, supervised learning, classification, regression
Readings: OPTIONAL: Hacker's guide to Neural Networks
Slides: PowerPoint 20
Demos: p5js perceptron demo

Thu, Apr 25

Topics: Q-learning with neural nets
Readings: Mnih V, et al. (2015) Human Level Control Through Deep Reinforcement Learning. Nature 518, 539-533.
Video: Inside DeepMind
Demo: ConvNetJS: Deep Q Learning Demo
Week 15: Semester wrap-up

Tue, Apr 30

Semester wrap-up
Quiz #2 (neural networks)

Thu, May 02


Mark E. Nelson, University of Illinois at Urbana-Champaign, 2005-2019.