Test metrics

Metrics

Example labels

• test_libri_labels

number	unit	id
0	< pad >	0
1	< eos >	1
2	< sos >	2
3	< blank >	3
4		4
5	A	5
6	B	6
7	C	7
8	D	8
9	E	9
10	F	10

• test_aishell_labels

number	unit	id
0	< pad >	0
1	< eos >	1
2	< sos >	2
3	< blank >	3
4		4
5	在	5
6	是	6
7	中	7
8	了	8
9	人	9
10	上	10

• test_kspon_labels

number	unit	id
0	< pad >	0
1	< eos >	1
2	< sos >	2
3	< blank >	3
4		4
5	.	5
6	그	6
7	이	7
8	는	8
9	아	9
10	가	10

targets = torch.LongTensor([
    [6, 6, 4, 6, 5, 1, 0, 0],
    [6, 6, 4, 6, 5, 1, 0, 0],
    [6, 6, 4, 6, 5, 1, 0, 0],
])
y_hats = torch.LongTensor([
    [9, 5, 4, 6, 5, 5, 1, 0, 0],
    [5, 7, 4, 6, 7, 7, 1, 0, 0],
    [6, 6, 4, 6, 5, 5, 1, 0, 0],
])

CharacterErrorRate

dist, length = 3, 4
dist, length = 4, 4
dist, length = 1, 4

cer = total_dist / total_length = 8 / 12 = 0.666

WordErrorRate

dist, length = 2, 2
dist, length = 2, 2
dist, length = 1, 2

wer = total_dist / total_length = 5 / 6 = 0.833