![Thumbnail](/bitstream/handle/20.500.11850/443741/2020.coling-main.490.pdf.jpg?sequence=6&isAllowed=y)
Open access
Date
2020Type
- Conference Paper
ETH Bibliography
yes
Altmetrics
Abstract
Knowledge bases (KBs) are essential for many downstream NLP tasks, yet their prime shortcoming is that they are often incomplete. State-of-the-art frameworks for KB completion often lack sufficient accuracy to work fully automated without human supervision. As a remedy, we propose : a novel interactive framework for KB completion from text based on a question answering pipeline. Our framework is tailored to the specific needs of a human-in-the-loop paradigm: (i) We generate facts that are aligned with text snippets and are thus immediately verifiable by humans. (ii) Our system is designed such that it continuously learns during the KB completion task and, therefore, significantly improves its performance upon initial zero- and few-shot relations over time. (iii) We only trigger human interactions when there is enough information for a correct prediction. Therefore, we train our system with negative examples and a fold-option if there is no answer. Our framework yields a favorable performance: it achieves a hit@1 ratio of 29.7% for initially unseen relations, upon which it gradually improves to 46.2%. Show more
Permanent link
https://doi.org/10.3929/ethz-b-000443741Publication status
publishedExternal links
Book title
Proceedings of the 28th International Conference on Computational LinguisticsPages / Article No.
Publisher
International Committee on Computational LinguisticsEvent
Organisational unit
09623 - Feuerriegel, Stefan (ehemalig) / Feuerriegel, Stefan (former)
Notes
Due to the Corona virus (COVID-19) the conference was conducted virtually.More
Show all metadata
ETH Bibliography
yes
Altmetrics