MissionWe aim to build truly intelligent systems that are able to interact with and reason about their native environment in order to solve an open-ended set of tasks. Our systems are deeply inspired by evolutionary principles such as self-organisation, selection and emergent functionality, and are therefore adaptive by design. We adopt a hybrid approach that integrates symbolic and subsymbolic AI techniques, combining their strengths to achieve general, accurate and interpretable models. We focus in particular on tasks that require human language-like communication, involving advanced perception, reasoning and learning skills. We investigate fundamental research questions that have a tight connection to real-world problems.
ExpertiseThe EHAI team has extensive and unique expertise in the domains of emergent communication and computational construction grammar.
Which mechanisms does a population of agents need for constructing conceptual and linguistic structures that are adequate for interacting with, reasoning about and acting in their native environment?
Computational Construction Grammar
How can a machine learn the most basic function of natural language, namely that of mapping between rich meaning representations and expressive linguistic utterances?
Featured projectsA selection of exciting research projects that showcase our expertise and provide insight into our long-term research program.
Computational Construction Grammar: A Practical Introduction
We are working on an introductory textbook that explains in a step-by-step manner how construction grammars can be computationally implemented. The book is at the same time an ideal textbook for courses on construction grammar or computational linguistics, and an indispensable resource for construction grammar researchers who would like to run their analyses on corpora.
Grounded Concept Learning
This project investigates how autonomous agents can distill meaningful concepts and words from continuous streams of perceptual data. The concepts are constructed through task-based communicative interactions and reflect properties of the world that are relevant for the task. The agents either learn the conceptual system of an existing natural language, or construct their own conceptual system and language.
Semantic Frame Extractor
The semantic frame extractor combines dependency parsing with computational construction grammar to extract semantic frames from text corpora. We have applied the newly developed method to a corpus of English newspaper articles, in order to study expressed causal relations in the climate change debate.
Visual Question Answering
In this project, we apply our language technologies to the problem of visual question answering. The task requires to understand a natural language question, reason about its relation to a given image and answer the question. We adopt a hybrid and modular approach that parses the question into a procedural semantic representation and executes it on the image.
We extend the insights from our visual question answering approach for the visual dialog task. Here, the goal is to answer a series of questions that often refer to each other. To keep track of what has been said, we develop techniques to store and represent the dialog history in a transparent way. The history is integrated in an executable semantic representation, such that together with the image, the answer is found.
Selected PublicationsThese publications are representative of the research carried out by the EHAI team. An exhaustive list can be found at the team members' research pages.
DemosThe following web demonstrations offer more insight into the techniques and methods we develop.
Visual Question Answering (VQA)
A hybrid AI system for VQA that makes use of computational construction grammar and executable meaning representations.View demo ›
Grounded Colour Naming Game
Demonstration of the Babel software toolkit with a grounded colour naming game experiment using the new robot interface package.View demo ›
SoftwareThe EHAI team co-develops a number of software tools that are available to the research community.
Babel ToolkitA flexible toolkit for implementing and running agent-based experiments on emergent communication
Fluid Construction GrammarA fully operational processing system for construction grammars
PenelopeAn open modular software platform for the data-driven analysis of opinion dynamics in online textual media aimed at social scientists
Paul Van Eecke
Postdoctoral researcher and lecturer
PhD researcher and teaching assistant
Jeroen Van Soest