SweFraCas 1.0
type: Dataset
description: I. IDENTIFYING INFORMATION Title* SweFracas v1.0 Subtitle A Swedish version of the Fracas inference/entailment dataset Created by* Lars Borin (lars.borin@gu.se) Publisher(s)* Språkbanken Text (sb-info@svenska.gu.se) Link(s) / permanent identifier(s)* https://spraakbanken.gu.se/en/resources/swefracas License(s)* CC BY 4.0 Abstract* A textual inference/entailment problem set, derived from FraCas. The original English Fracas [1] was converted to html and edited by Bill MacCartney [2], and then automatically translated to Swedish by Peter Ljunglöf and Magdalena Siverbo [3]. The current tabular form of the set was created by Aleksandrs Berdicevskis by merging the Swedish and English versions and removing some of the problems. Finally, Lars Borin went through all the translations, correcting and Swedifying them manually. As a result, many translations are rather liberal and diverge noticeably from the English original Funded by* Vinnova (grant no. 2020-02523) Cite as Related datasets Part of the SuperLim collection (https://spraakbanken.gu.se/en/resources/superlim). See also Abstract II. USAGE Key applications Machine Learning, Inference, Entailment, Evaluation of language models, Diagnostics Intended task(s)/usage(s) (1) Evaluate models on the following task: given the question and the premises, choose the suitable answer (Ja 'Yes'; Nej 'No'; Vet ej 'Don't know'; Jo 'Positive answer to a negated question') Recommended evaluation measures (1) R4 (Matthews correlation coefficient) Dataset function(s) Testing Recommended split(s) Test data only III. DATA Primary data* Text Language* Swedish Dataset in numbers* 305 problems Nature of the content* Inference problems, where a question has to be answered, given a number of promises Format* Tab-separated, five columns: "id" -- unique integer id of the problem; "original_id" -- the id of the corresponding problem in the original dataset "attribute" -- which attribute does the row within the problem contain: "premiss" (premise), "…
creative work status: completed
  type: DefinedTerm
  in defined term set: http://publications.europa.eu/resource/authority/dataset-status
  term code: COMPLETED
creator: Språkbanken Text
date modified: 2021-06-15
date published: 2024-01-01
language: Swedish
keywords: Natural Language Processing
  type: DefinedTerm
  term code: 10208
keywords: Language Technology (Computational Linguistics)
keywords: corpus
license: https://creativecommons.org/licenses/by/4.0/
publisher: University of Gothenburg
version: 0

PropertyValue
property ID: DOI
value: 10.23695/GFWN-QK37

PropertyValue
property ID: slug
value: swefracas-1-0

Språkbanken Text
type: Organization

Swedish
type: Language
alternate name: swe

University of Gothenburg
type: Organization