Cheap Facts and Counter-Facts

Rui Wang, Chris Callison-Burch

In: Proceedings of NAACL-HLT 2010 Workshop on Amazon Mechanical Turk. NAACL-HLT Workshop on Amazon Mechanical Turk (AMT-2010) Creating Speech and Language Data With Amazon’s Mechanical Turk befindet sich NAACL-HLT 2010 June 5-6 Los Angeles CA United States Association for Computational Linguistics 6/2010.


This paper describes our experiments of using Amazon’s Mechanical Turk to generate (counter-)facts from texts for certain named-entities. We give the human annotators a paragraph of text and a highlighted named-entity. They will write down several (counter-)facts about this named-entity in that context. The analysis of the results is performed by comparing the acquired data with the recognizing textual entailment (RTE) challenge dataset.


AMT2010.pdf (pdf, 94 KB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence