Results Archive

This page reports the experiments did by users and the results they obtained. This allows other users to replicate those experiments under the same condition or avoid doing the experiments that have already been done.

Users that would like to share their results with the other EOP users can either upload their results into this page directly (a GitHub account is needed) or they can contact the EOP members by the provided mailing lists.

Please note that some of the experiments reported below might have been done using a previous version of the EOP. That is for those experiments whose configuration files can be used also with the current release of the EOP and whose results do not change. The only thing that people should check before using the distributed configuration files is that they refer to the correct version of the file of the resources (e.g., eop-resources-X.Y.Z) available with the current EOP release (e.g., EOP-X.Y.Z) and in case change them accordingly.

Experiments List:

EDA	Data	Lang	Lexical Resources	Results	Exp

BIUTEE
	RTE-3	EN	WN,CV		link

EDITS
	RTE-3	DE		0.61250	link
	RTE-3	DE	WN	0.61250	link
	RTE-3	EN		0.62000	link
	RTE-3	EN	WN	0.63625	link
	RTE-3	IT		0.62625	link
	RTE-3	IT	WN	0.61625	link

TIE
	RTE-3	DE	DS,DBPos,TP,TPPos,TS	0.62875	link
	RTE-3	DE	GNPos,DBPos,TP,TPPos,TS	0.63125	link
	RTE-3	DE	GNPos,DS,DBPos,TP,TPPos,TS	0.63125	link
	RTE-3	EN	VO,TP,TPPos,TS	0.64000	link
	RTE-3	EN	WN,TP,TPPos,TS	0.65250	link
	RTE-3	EN	WN,VO,TP,TPPos,TS	0.64625	link

CV: CatVar, WN: WordNet, WP: Wikipedia, VO: VerbOcean, GNPos: GermaNet with POS tags, DS: DewakDistributional, DBPos: DerivBase with POS tags, TP: TreePattern, TPPos: TreePattern with POS tags, TS: TreeSkeleton

BIUTEE EDA

**EXPERIMENT:** B1

Configuration ID: BIUTEE_WordNet_CatVar_EN

Data Set: RTE-3
Language: EN
Lexical Resources: WN, CV
Preprocessing:
Results(Accuracy): ----

Author name: Omer Levy
Affiliation: Bar-Ilan University
Contact:

Download the configuration file, model and results

EditDistance EDA

**EXPERIMENT:** E1

Configuration ID: EditDistanceEDA_DE

Data Set: RTE-3
Language: DE
Lexical Resources: none
Preprocessing: TreeTagger
Results(Accuracy): 0.61250

Author name: Roberto Zanoli
Affiliation: Fondazione Bruno Kessler (FBK)
Contact Information: zanoli [at] fbk.eu

Download the configuration file, model and results

**EXPERIMENT:** E2

Configuration ID: EditDistanceEDA_DE_WordNet

Data Set: RTE-3
Language: DE
Lexical Resources: WN
Preprocessing: TreeTagger
Results(Accuracy): 0.61250

Author name: Roberto Zanoli
Affiliation: Fondazione Bruno Kessler (FBK)
Contact Information: zanoli [at] fbk.eu

Download the configuration file, model and results

**EXPERIMENT:** E3

Configuration ID: EditDistanceEDA_EN

Data Set: RTE-3
Language: EN
Lexical Resources: none
Preprocessing: TreeTagger
Results(Accuracy): 0.62000

Author name: Roberto Zanoli
Affiliation: Fondazione Bruno Kessler (FBK)
Contact Information: zanoli [at] fbk.eu

Download the configuration file, model and results

**EXPERIMENT:** E4

Configuration ID: EditDistanceEDA_EN_WordNet

Data Set: RTE-3
Language: EN
Lexical Resources: WN
Preprocessing: TreeTagger
Results(Accuracy): 0.63625

Author name: Roberto Zanoli
Affiliation: Fondazione Bruno Kessler (FBK)
Contact Information: zanoli [at] fbk.eu

Download the configuration file, model and results

**EXPERIMENT:** E5

Configuration ID: EditDistanceEDA_IT

Data Set: RTE-3
Language: IT
Lexical Resources: none
Preprocessing: TextPro
Results(Accuracy): 0.62625

Author name: Roberto Zanoli
Affiliation: Fondazione Bruno Kessler (FBK)
Contact Information: zanoli [at] fbk.eu

Download the configuration file, model and results

**EXPERIMENT:** E6

Configuration ID: EditDistanceEDA_IT_WordNet

Data Set: RTE-3
Language: IT
Lexical Resources: WN
Preprocessing: TextPro
Results(Accuracy): 0.61625

Author name: Roberto Zanoli
Affiliation: Fondazione Bruno Kessler (FBK)
Contact Information: zanoli [at] fbk.eu

Download the configuration file, model and results

TIE EDA

**EXPERIMENT:** T1

Configuration ID: MaxEntClassificationEDA_Base+DS+DBPos+TP+TPPos+TS_DE

Data Set: RTE-3
Language: DE
Lexical Resources: DS,DBPos,TP,TPPos,TS
Preprocessing: MaltParserDE
Results(Accuracy): 0.62875