Supervised systems
Output from all the systems available in the accompanying material.
Training corpus: SemCor
System |
Senseval-2 |
Senseval-3 |
SemEval-07 |
SemEval-13 |
SemEval-15 |
ALL
|
IMS |
70.9 |
69.3 |
61.3 |
65.3 |
69.5 |
68.4 |
IMS+emb |
71.0 |
69.3 |
60.9 |
67.3 |
71.3 |
69.1 |
IMS-s+emb |
72.2 |
70.4 |
62.6 |
65.9 |
71.5 |
69.6 |
Context2Vec |
71.8 |
69.1 |
61.3 |
65.6 |
71.9 |
69.0 |
MFS |
65.6 |
66.0 |
54.5 |
63.8 |
67.1 |
64.8 |
Ceiling |
91.0 |
94.5 |
93.8 |
88.6 |
90.4 |
91.5 |
Training corpus: SemCor + OMSTI
System |
Senseval-2 |
Senseval-3 |
SemEval-07 |
SemEval-13 |
SemEval-15 |
ALL
|
IMS |
72.8 |
69.2 |
60.0 |
65.0 |
69.3 |
68.8 |
IMS+emb |
70.8 |
68.9 |
58.5 |
66.3 |
69.7 |
68.3 |
IMS-s+emb |
73.3 |
69.6 |
61.1 |
66.7 |
70.4 |
69.7 |
Context2Vec |
72.3 |
68.2 |
61.5 |
67.2 |
71.7 |
69.4 |
MFS |
66.5 |
60.4 |
52.3 |
62.6 |
64.2 |
62.9 |
Ceiling |
91.5 |
94.9 |
94.7 |
89.6 |
91.1 |
92.1 |
Knowledge-based systems
System |
Senseval-2 |
Senseval-3 |
SemEval-07 |
SemEval-13 |
SemEval-15 |
ALL
|
Lesk |
50.6 |
44.5 |
32.0 |
53.6 |
51.0 |
48.7 |
Lesk+emb |
63.0 |
63.7 |
56.7 |
66.2 |
64.6 |
63.7 |
UKB |
56.0 |
51.7 |
39.0 |
53.6 |
55.2 |
53.2 |
UKB-g |
60.6 |
54.1 |
42.0 |
59.0 |
61.2 |
57.5 |
UKB-g* |
68.8
|
66.1
|
53.0
|
68.8
|
70.3
|
67.3 |
Babelfy |
67.0 |
63.5 |
51.6 |
66.4
|
70.3 |
65.5 |
WN 1st sense |
66.8 |
66.2 |
55.2 |
63.0 |
67.8 |
65.2 |
|
|