Computational cognitive science studies the computational basis of learning, thought, and intelligence. New York University offers one of the top worldwide environments for training in this area. The purpose of this page is to give an overview of some of the resources available at NYU for prospective MA or Phd students. In addition, this page can be useful for NYU undergraduates interested in getting involved in research.
We often think of our intelligence as one factor that distinguishes us from other animals. Humans write songs, build complex technologies, and communicate with language. However, when we attempt to more specifically define what makes us unique in this sense we often are forced to realize that there is intelligence in systems besides humans. Certainly animals show certain types of intelligent behavior (e.g., simple problem solving, complex and adaptive movements). In addition, we increasingly interact with artificial systems like our smartphone or computer which display elements of intelligence as well (e.g., understanding spoken language, planning out the best way to get home, etc...).
Computational cognitive science is the interdisciplinary study of intelligence that recognizes that intelligence is a property of many sufficiently complex systems. The key insight that unites this field of study is the idea that intelligence is best described in terms of computational systems (i.e., computer algorithms or programs). As a result, this field of study brings together many disparate fields interested in computation including computer science, data science, neuroscience, linguistics, psychology, and philosophy.
Some computational cognitive scientists emphasize the design of new intelligent computer systems (artificial intelligence) that may operate on principles different from the way biological intelligence works. Others work to understand how biological brains enable intelligence (e.g., how do our neurons support our ability to understand language?). Still others seek to understand the relationships between these different types of intelligence in a kind of "comparative psychology" (e.g., we have learned a lot about humans by studying animals, we can derive similar insights by comparing humans and artificial intelligence algorithms.)
Research in computational cognitive science thus lies at the intersection of technological engineering and the social sciences and humanities. Researchers in this area attempt to understand what makes us human by leveraging cutting edge developments in technology. Looking forward, computational cognitive science is likely to transform not only what we know about ourselves but also the kinds of future technologies that will inhabit our cities, homes, offices, pockets, and even bodies.
People can learn a new concept from just one or a handful of examples, whereas standard AI algorithms require a lot more data. A single example of a new visual concept (red box) can be enough information for a person to grasp the boundaries of the concept and generalize in a rich variety of ways (e.g., classification, generation, parsing). We are developing new computational models to capture these remarkable human learning abilities, combining the strengths of Bayesian program learning and deep generative neural networks.
In the OMNI project (funded by NSF) we have been trying to develop Bayesian models that can decode the mnemonic status of individual items in memory using fMRI (i.e.,predict what you do or do not know without asking you). We then attempt to use that information to devise optimal ways to improve people’s memory using the models.
In the project Latent Structure Learning for Natural Language (funded by Samsung), we are developing methods to train a parser to produce hierarchical structures for sentences that optimally support sentence understanding, rather than training it to reproduce expert-annotated treebank data.
Planning sequences of actions is an important cognitive function, but is complicated by the vast number of possibilities in the decision tree. We use a simple tic-tac-toe-like game combined with AI-inspired computational models to investigate how humans meet this challenge. Fig. shows example board position in the experimental game, with overlaid the eye trajectory of the player with the black pieces. A larger circle means a longer fixation. The open circle indicates the player's eventual move.
Cognitive science is a highly interdisciplinary field and faculty research which touches on these topics is spread across multiple university departments and units. Here is a convenient listing of a few researchers working in this area along with a brief description of their research interests:
NYU is a leading university for studying cognitive psychology, machine learning, AI, and neuroscience. Computational cognitive science sits at the interface of these fields, creating an extraordinary community for training in this area. The following groups and resources at NYU are reflective of this interdisciplinary synergy:
There are a wide variety of courses at NYU which offer training in computational methods, behavioral science, big data analytics, neuroscience techniques and philosophy. However there are a couple of courses in particular that give a sense of the opportunities:
If you are interesting in studying these topics at NYU here are the answers to some frequently asked questions.
Most of the faculty listed above involve undergraduates in their research. One approach is to reach out to a professor working in an area that interests you via email. There may be paid or unpaid research projects you can help with even early in your undergraduate career. In fact, starting to get involved in undergraduate research early (e.g., sophomore year) can help you build the knowledge and skills to later apply to graduate school.
It is also useful to think about what types of classes to take as an undergraduate which will help build your knowledge and skills. You might consider talking with a professor about the types of courses they recommend. At minimum, students working this area will benefit from experience with computer programming classes, as well as fundamental mathematical courses such as linear algebra, combinatorics, and signal processing.
While there is no "cognitive science" graduate program at NYU, interested candidates can apply through the following programs: Ph.D. Program in Cognition and Perception (deadline is Dec. 1, 2017), the Ph.D. program in Data Science (deadline is Dec. 18, 2017), or the Ph.D. program in neural science (deadline is Dec. 1, 2017). University policy dictates that you may only apply to one program at a time, and we suggest that you choose carefully! If you have question you might reach out to a faculty member most related to your interests and get their advice.
It depends a bit on the program that you apply to. Detailed questions about this should be referred to the individual program you apply to (see the links above). At the present time, students accepted through the Center for Data Science, the Center for Neural Science, or Psychology are usually offered five years of guaranteed support including a stipend and tuition costs (see here for the details from GSAS). In addition, first year students are usually offered subsidized student housing in Manhattan close to the university.