Skip to content

README.md

Latest commit

 

History

History
115 lines (91 loc) · 6.39 KB

README.md

File metadata and controls

115 lines (91 loc) · 6.39 KB

[English] LibriSpeech

I. Small + SentencePiece 1k

Category Description
Config small.yml.j2
Tensorflow 2.18.0
Device Google Cloud TPUs v4-8
Mixed Precision strict
Global Batch Size 4 * 4 * 8 = 128 (as 4 TPUs, 8 Gradient Accumulation Steps)
Max Epochs 300
Pretrained Link

Config:

{% import "examples/datasets/librispeech/sentencepiece/sp.yml.j2" as decoder_config with context %}
{{decoder_config}}
{% import "examples/models/transducer/conformer/small.yml.j2" as config with context %}
{{config}}

Results:

Epoch Dataset decoding wer cer mer wil wip
157 test-clean greedy 0.062918 0.025361 0.062527 0.109992 0.890007
157 test-other greedy 0.142616 0.066839 0.140610 0.239201 0.760798

II. Small + Streaming + SentencePiece 1k

Category Description
Config small-streaming.yml.j2
Tensorflow 2.18.0
Device Google Cloud TPUs v4-8
Mixed Precision strict
Global Batch Size 4 * 4 * 8 = 128 (as 4 TPUs, 8 Gradient Accumulation Steps)
Max Epochs 300
Pretrained Link

Config:

{% import "examples/datasets/librispeech/sentencepiece/sp.yml.j2" as decoder_config with context %}
{{decoder_config}}
{% import "examples/models/transducer/conformer/small-streaming.yml.j2" as config with context %}
{{config}}

Results:

Epoch Dataset decoding wer cer mer wil wip
45 test-clean greedy 0.0797322 0.0312862 0.0790049 0.137228 0.862772
45 test-other greedy 0.211872 0.104173 0.207305 0.341269 0.658731

[Vietnamese] VietBud500

I. Small + Streaming + SentencePiece 1k

Category Description
Config small-streaming.yml.j2
Tensorflow 2.18.0
Device Google Cloud TPUs v4-8
Mixed Precision strict
Global Batch Size 8 * 4 * 8 = 256 (as 4 TPUs, 8 Gradient Accumulation Steps)
Max Epochs 300
Pretrained Link

Config:

{% import "examples/datasets/vietbud500/sentencepiece/sp.yml.j2" as decoder_config with context %}
{{decoder_config}}
{% import "examples/models/transducer/conformer/small-streaming.yml.j2" as config with context %}
{{config}}

Tensorboard:


Epoch Loss
Batch Loss
Learning Rate

Results:

Epoch decoding wer cer mer wil wip
52 greedy 0.053723 0.034548 0.05362 0.086421 0.913579