Computational Cognitive Science at New York University

Computational cognitive science studies the computational basis of learning, thought, and intelligence. New York University offers one of the top worldwide environments for training in this area. The purpose of this page is to give an overview of some of the resources available at NYU for prospective MA or Phd students. In addition, this page can be useful for NYU undergraduates interested in getting involved in research.

What is computational cognitive science?

We often think of our intelligence as one factor that distinguishes us from other animals. Humans write songs, build complex technologies, and communicate with language. However, when we attempt to more specifically define what makes us unique in this sense we often are forced to realize that there is intelligence in systems besides humans. Certainly animals show certain types of intelligent behavior (e.g., simple problem solving, complex and adaptive movements). In addition, we increasingly interact with artificial systems like our smartphone or computer which display elements of intelligence as well (e.g., understanding spoken language, planning out the best way to get home, etc...).

intersections of fields

Computational cognitive science is the interdisciplinary study of intelligence that recognizes that intelligence is a property of many sufficiently complex systems. The key insight that unites this field of study is the idea that intelligence is best described in terms of computational systems (i.e., computer algorithms or programs). As a result, this field of study brings together many disparate fields interested in computation including computer science, data science, neuroscience, linguistics, psychology, and philosophy.

Some computational cognitive scientists emphasize the design of new intelligent computer systems (artificial intelligence) that may operate on principles different from the way biological intelligence works. Others work to understand how biological brains enable intelligence (e.g., how do our neurons support our ability to understand language?). Still others seek to understand the relationships between these different types of intelligence in a kind of "comparative psychology" (e.g., we have learned a lot about humans by studying animals, we can derive similar insights by comparing humans and artificial intelligence algorithms.)

Research in computational cognitive science thus lies at the intersection of technological engineering and the social sciences and humanities. Researchers in this area attempt to understand what makes us human by leveraging cutting edge developments in technology. Looking forward, computational cognitive science is likely to transform not only what we know about ourselves but also the kinds of future technologies that will inhabit our cities, homes, offices, pockets, and even bodies.

Key NYU Faculty

Cognitive science is a highly interdisciplinary field and faculty research which touches on these topics is spread across multiple university departments and units. Here is a convenient listing of a few researchers working in this area along with a brief description of their research interests:

  • Ned Block (Philosophy) - foundations of neuroscience and cognitive science, relationship between perception and cognition
  • Sam Bowman (Linguistics/Center for Data Science) - natural language processing, deep learning
  • David Chalmers (Philosophy) - philosophy of mind (especially consciousness), foundations of cognitive science, philosophy of language
  • Kyunghyun Cho (Computer Science/Center for Data Science) - machine learning, natural language processing, deep learning (also research scientist at Facebook AI in NYC)
  • Ernest Davis (Computer Science) - commonsense understanding in human and artificial intelligence, physical reasoning
  • Moira Dillon (Psychology) - cognitive development, spatial cognition, simulation vs. rule-based reasoning, human and artificial intelligence
  • Rob Fergus (Computer Science) - machine learning and computer vision (also research scientist at Facebook AI in NYC)
  • Todd Gureckis (Psychology) - computational cognitive science, intersection of human/machine learning, active/self-directed learning, categorization, decision making
  • Catherine Hartley (Psychology) - computational models of decision making and learning, developmental cognitive neuroscience
  • David Heeger (Psychology/Center for Neural Science) - computational models of attention, perception, working memory, navigation, motor control
  • Mark Ho (Psychology) - computational theories of reinforcement learning, planning, social reasoning, and decision making
  • Brenden Lake (Psychology/Center for Data Science) - computational cognitive modeling, human and machine learning, concept learning
  • Tal Linzen (Linguistics/Center for Data Science) - computational models of human language acquisition and processing; evaluating and improving linguistic generalization in artificial intelligence systems
  • Yann LeCun (Computer Science/Center for Data Science) - machine learning, computer vision, Director of AI research at Facebook in NYC
  • Zhong-Lin Lu (Center for Neural Science/Psychology, NYU Shanghai) - computational brain models for perception and cognition, computational and psychophysics studies of perception, attention, perceptual learning, applications of hierarchical Bayesian models in adaptive testing, psychophysics, and brain networks
  • Weiji Ma (Psychology/Center for Neural Science)- computational neuroscience, working memory, decision making, perception, higher cognition, fMRI
  • Marcelo Mattar (Psychology)- reinforcement learning in biological and artificial systems, planning, memory, computational neuroscience, cognitive neuroscience
  • Liina Pylkkänen (Linguistics/Psychology) - neural bases of language, particularly syntatic and semantic processing
  • Bob Rehder (Psychology) - causal learning, categorization, reasoning
  • Christina Savin (Center for Neural Science/Center for Data Science) - using tools from machine learning to figure out how learning and memory happen at the level of neural circuits
  • Eero Simoncelli (Center for Neural Science/Center for Data Science)- computer vision, computational approach to visual neuroscience
  • Julian Togelius (CSE, Tandon School of Engineering) - artificial intelligence, evolutionary computation, games as AI testbeds
  • Noga Zaslavsky (Psychology) - computational approaches to language, learning, and reasoning. Information theory, neural networks.

What resources make NYU a particularly great place to study computational cognitive science?

NYU is a leading university for studying cognitive psychology, machine learning, AI, and neuroscience. Computational cognitive science sits at the interface of these fields, creating an extraordinary community for training in this area. The following groups and resources at NYU are reflective of this interdisciplinary synergy:

In addition to these academic resources, New York City is an excellent place to for exploring relationships with industry research. Many of the faculty listed above have affiliations with major AI research labs in the city. There is a vibrant startup culture in New York City and students often have the opportunity to do internships with local companies prior to graduation.

What are some of the course offerings relevant at NYU?

There are a wide variety of courses at NYU which offer training in computational methods, behavioral science, big data analytics, neuroscience techniques and philosophy. However there are a couple of courses in particular that give a sense of the opportunities:

In addition to these academic resources, New York City is an excellent place to for exploring relationships with industry research. Many of the faculty listed above have affiliations with major AI research labs in the city. There is a vibrant startup culture in New York City and students often have the opportunity to do internships with local companies prior to graduation.

Course offerings at nearby universities

Students at NYU are also often able to enroll in classes at Columbia University where faculty such as David Blei and Andrew Gelman teach courses on advanced statistical methods and computational modeling.

How to get involved - F.A.Q.

If you are interesting in studying these topics at NYU here are the answers to some frequently asked questions.

I am an undergraduate at NYU, how to do I get involved in this research?

Most of the faculty listed above involve undergraduates in their research. One approach is to reach out to a professor working in an area that interests you via email. There may be paid or unpaid research projects you can help with even early in your undergraduate career. In fact, starting to get involved in undergraduate research early (e.g., sophomore year) can help you build the knowledge and skills to later apply to graduate school.

It is also useful to think about what types of classes to take as an undergraduate which will help build your knowledge and skills. You might consider talking with a professor about the types of courses they recommend. At minimum, students working this area will benefit from experience with computer programming classes, as well as fundamental mathematical courses such as linear algebra, combinatorics, and signal processing.

How do I apply to NYU's graduate school to study this topic?

While there is no "cognitive science" graduate program at NYU, interested candidates can apply through the following programs: Ph.D. Program in Cognition and Perception (deadline is Dec. 1, 2017), the Ph.D. program in Data Science (deadline is Dec. 18, 2017), or the Ph.D. program in neural science (deadline is Dec. 1, 2017). University policy dictates that you may only apply to one program at a time, and we suggest that you choose carefully! If you have question you might reach out to a faculty member most related to your interests and get their advice.

What is the NYU graduate funding situation like?

It depends a bit on the program that you apply to. Detailed questions about this should be referred to the individual program you apply to (see the links above). At the present time, students accepted through the Center for Data Science, the Center for Neural Science, or Psychology are usually offered five years of guaranteed support including a stipend and tuition costs (see here for the details from GSAS). In addition, first year students are usually offered subsidized student housing in Manhattan close to the university.