MCB419 logo  


Please bring a laptop to every class session. If this is a problem, talk to Prof. Nelson.

Week 1: introduction; evolution of intelligence

Tue, Jan 16

Topics: intro to the course; emergence of life; evolution of intelligence; intro to p5js
Readings: Hawking S (1994) Life in the Universe
Timeline of evolutionary history of life (focus on Hadeon and Archean Eons for this week)
Slides: PowerPoint 1
Sketches: House, Ball_1
Videos: Hello p5js (~5 minutes)

Thu, Jan 18

Topics: hands-on p5js tutorial; graphics, random noise, random walks.
Readings: Shiffman D (2012) Introduction, The Nature of Code, Sections I.1-I.5
(NOTE: examples in Shiffman's book are written in Processing, not p5js; the code structure is very similar, but the syntax is different).
Sketches: Bouncing Ball
Examples: Nature of Code, Introduction
Week 2: Modeling organisms as physical objects; object-oriented programming

Tue, Jan 23

Topics: p5js tutorial, objects, arrays
Readings: Shiffman D (2012) Introduction, Sections I.6-I.7
FYI: TED talk: Martin Hanczyc, The line between life and not-life
NEWS: No signs of alien life? Maybe they're all extinct.
Chopra and Lineweaver (2016) The Case for a Gaian Bottleneck: The Biology of Habitability.

Thu, Jan 25

Topics: week03 homework assignment, simple foraging example
Readings: none
Videos: none
Sample code: Estimating pi
Homework: week03_hw_template (foraging efficiency vs. noise)
(due Tu Jan 30, 9:00 PM)
Week 3: behavior without a nervous system, bacterial chemotaxis

Tue, Jan 30

Topics: Topics: single-cell intelligence; kinesis and taxis
Slides: PowerPoint 3
Readings: Dusenbery DB (1996) Life at Small Scale. Scientific American Library. Chapter 1, Invisible Organisms, pp 2-17 (16 pp). microbes, food chains, hunting vs farming
Zupanc GKH (2004) Behavioral Neurobiology: An Integrative Approach. Oxford Press. 80-88 (9 pp) classification of orienting movements; orienting behavior without a nervous system
Sketches: Shrinking Balls
Homework: Week 03 homework due by 9:00 PM (foraging efficiency)

Thu, Feb 1

Topics: Topics: bacterial chemotaxis; run-tumble behavior
Slides: PowerPoint 4
Readings: Jurica MS, Stoddard BL (1998) Mind your Bs and Rs: Bacterial Chemotaxis, signal transduction, and protein recognition" Structure 6:809-813 (5 pp) bacterial chemotaxis, coupling sensors to effectors
Videos: Bacterial chemotaxis
Homework: week04_hw_template (kinesis strategies)
(due Tu Feb 6, 9:00 PM)
Week 4: sensory information processing

Tue, Feb 6

Topics: obstacle avoidance in paramecia; electrical signaling; emergence of multicellular organisms; Braitenberg vehicles;
Slides: PowerPoint 5
Readings: Braitenberg V (1984) Vehicles: Experiments in Synthetic Psychology. MIT Press. pp. 1-14 (14 pp) Braitenberg Vehicles
Videos: Paramecium caudatum
Office hours: Doodle Poll
Sketch: Simple paramecium, Lowpass filter demo
Homework: Week 04 homework due today by 9:00 PM (kinesis strategies)

Thu, Feb 8

Topics: Dusenbery: What is information?;
Cariani: Information relationships (syntactic, semantic, pragmatic)
Slides: PowerPoint 6
Readings: Dusenbery DB (1996) Information is where you find it. Biol. Bull. 191:124-128 (5 pp) Information from a biological perspective; genome (evolutionary times), memory (lifetime), sensory (current state).
Cariani P. (1991) Some epistemological implications of devices which construct their own sensors and effectors. In: Varela F, Bourgine P eds. Towards a practice of autonomous systems. Cambridge, MA: MIT Press, 484-493 (10 pp) Information relationships (syntactic, semantic, pragmatic)
Videos: Braitenberg Vehicles
Quiz: Paper-based quiz (multiple-choice, true-false, short-answer) over movement strategies: kinesis, taxis, Braitenberg vehicles.
Homework: week05_hw_template (Braitenberg vehicles)
(due Tu Feb 13, 9:00 PM)
Week 5: natural selection, genetic algorithms

Tue, Feb 13

Topics: evolutionary computation, genetic algorithms
Readings: Shiffman, Chapter 9 - Evolution of Code, Sections 9.1-9.8
Videos: Shiffman, 9.1 Evolutionary Computing(20:00) (Watch FIRST 20 minutes)
Sample code: Shakespeare GA_demo
Gene-based wander controller
Homework: Week 05 homework due today by 9:00 PM (Braitenberg vehicles)

Thu, Feb 15

Topics: evolutionary computation, genetic algorithms
Readings: Shiffman, Chapter 9 - Evolution of Code, Sections 9.9-9.13
Videos: Shiffman, 9.1 Evolutionary Computing(20:00) (Watch LAST 20 minutes)
Homework: week06_hw_template (Evolve Braitenberg)
(due Tu Feb 20, 9:00 PM)

Week 6: emergence of animals and nervous systems

Tue, Feb 20

Topics: emergence of animals and nervous systems, intro to C. elegans
Readings: Ferree TC, Lockery SR (1999) Computational rules for chemotaxis in the nematode C. elegans. J Comput Neurosci 6:263-277 (15 pp)
Videos: A brief introduction to C. elegans (2:11)
Slides: PowerPoint 7
Homework: Week 06 homework due by 9:00 PM (GAs / evolving Brait controllers)

Thu, Feb 22

Topics: area-restricted search in C. elegans, neuromodulation
Readings: Hills T, Brockie PJ, Maricq AV (2004) Dopamine and glutamate control area-restricted search behavior in Caenorhabditis elegans. J Neurosci 24:1217-1225 (9 pp)
Code: RC filters
Slides: PowerPoint 8
Homework: week07_hw_template (Evolve C. elegans)
(due Tu Feb 27, 9:00 PM)
Week 7: Cambrian explosion, insect brains, vertebrate brains

Tue, Feb 27

Topics: Cambrian explosion, insect brains
Readings: Beer R, Chiel J, Sterling L (1991) An artificial insect. American Scientist, 79:444-452 (9 pp)
Videos: none
Slides: PowerPoint 09
Homework: Week 07 homework due by 9:00 PM (evolving worm controllers)

Thu, Mar 1

Topics: vertebrate brains, toad visuomotor behaviors, prey capture
Readings: Carew TJ (2000) Behavioral Neurobiology, Chapter 4, Feature Analysis in Toads. 95-119 (25 pp)
Videos: Neuroethology of Toads (Part 1: Behavior)
Neuroethology of Toads (Part 2: Neural Basis)
Slides: PowerPoint 10
Homework: week08_hw_template (action selection / FSM / ARS)
(due Tu Mar 6, 9:00 PM)
Week 8: spike-based models, vertebrate visuomotor circuits

Tue, Mar 6

Topics: threshold logic, integrate-and-fire models, lamprey model I
Readings: Braitenberg V (1984) Vehicles: Experiments in Synthetic Psychology. pp. 15-25 (11 pp)
Videos: Visually Guided Locomotion in Lamprey
Slides: PowerPoint 11
Demo: Demo: Braitenberg spiking model
Exercise: Threshold Logic_template (threshold-logic programming)
Homework: Week 08 homework due by 9:00 PM (action selection / FSM / ARS)

Thu, Mar 8

Topics: lamprey model continued, place-code to rate-code conversion
Readings: Kamali Sarvestani I, Kozlov A, Harischandra N, Grillner S, Ekeberg O (2012) A computational model of visually guided locomotion in lamprey. Biol. Cybern Nov 2012 (16 pp)
Videos: none
Slides: none
HW: week09_hw_template (lamprey place-code to rate-code conversion)
(due Tu Mar 13, 9:00 PM)
Week 9: Midterm Exam

Tue, Mar 13

Topics: Review session for midterm exam
Slides: Midterm Review
Homework: Week 09 homework due by 9:00 PM (lamprey place- to rate-code)

Thu, Mar 15

Midterm Exam

Enjoy your SPRING BREAK!
Week 10: Associative learning

Tue, Mar 27

Topics: learning and memory, honeybee foraging, proboscis extension reflex (PER)
Slides: PowerPoint 15
Readings: Carew TJ (2000) Behavioral Neurobiology, Chapter 9, Associative Learning in Honeybees. 271-300 (30 pp)

Thu, Mar 29

Topics: neural basis of PER, associative learning models, delta rule
Slides: PowerPoint 16
Readings: Montague PR, Dayan P, Person C, Sejnowski TJ (1995) Bee foraging in uncertain environments using predictive Hebbian learning. Nature 377:725-728 (4 pp)
Demo: Bee two-choice demo
HW: week11_hw_template (bee-inspired foraging)
(due Tu Apr 3, 9:00 PM)
Week 11: Spatial navigation, memory systems, reinforcement learning

Tue, Apr 3

Topics: spatial navigation, desert ants; intro to reinforcement learning
Slides: PowerPoint 17
Readings: Wehner R (2003) Desert ant navigation: how miniature brains solve complex tasks. J. Comp. Physiol. A 189: 579-588 (10 pp).

Thu, Apr 5

Topics: Memory systems; Reinforcement learning; SARSA algorithm
Slides: PowerPoint 19
Readings: (1) Squire LR (2004) Memory systems of the brain: A brief history and current perspective. Neurobiol Learn Mem 82:171-177 (7 pp.)
(2) Clayton NS, Bussey TJ, Dickinson A (2003) Can animals recall the past and plan for the future? Nat Rev Neurosci 4:685-691 (7 pp.)
Homework: week12_hw_template (Q-learning, grid world)
(due Tu Apr 10, 9:00 PM)
Week 12: Neural Networks, Q-learning with neural nets

Tue, Apr 10

Topics: Neural networks, supervised learning, classification, regression
Readings: Hacker's guide to Neural Networks
Slides: PowerPoint 20
Demos: ConvNetJS

Thu, Apr 12

Topics: Q-learning with neural nets
Readings: Mnih V, et al. (2015) Human Level Control Through Deep Reinforcement Learning. Nature 518, 539-533.
Video: Inside DeepMind
Demo: ConvNetJS: Deep Q Learning Demo
Homework: week13_hw_template (Q-learning with neural nets)
(due Tu Apr 17, 9:00 PM)
human-playable version

Week 13: Communication between agents, Final project overview

Tue, Apr 17

Topics: Agent communication, ant pheromone trails, discussion of final projects
Slides: PowerPoint 21
JS Demo: Ant foraging

Thu, Apr 19

Topics: Discussion and sign-off on project ideas.
Homework: draft proposal template
(due Tu Apr 24, 9:00 PM... CANNOT USE LATE DAYS)
Project Guidelines
Week 14: Final project work week

Tue, Apr 24

Office hours consulting for final project.
Click here to schedule

Project proposals due by 9:00 PM

Thu, Apr 26

Office hours consulting for final project.
Click here to schedule

Week 15: Final project presentations

Tue, May 01

Semester wrap-up and discussion; last-minute project questions
Final project submission due by 9:00 PM

Thu, May 03


Mark E. Nelson, University of Illinois at Urbana-Champaign, 2005-2016.