File size: 6,433 Bytes
73175eb
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
---
license: cc-by-4.0
language: [en, de, fr, es, it, pt, ru, uk, hr, sl, lv, lt, et, fi, sv, da, nl, pl, cs, sk, hu, ro, bg, el, mt]
pipeline_tag: automatic-speech-recognition
tags: [parakeet, tdt, speech-recognition]
---

# Moondream Parakeet Ultra

A post-trained version of [parakeet-tdt-0.6b-v3](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v3). Same
architecture, same tokenizer, same 0.6B parameters in full precision. It is better than the original on every
benchmark group below, by a wide margin on the 25-language FLEURS set, in background noise and on long-form audio,
and it runs faster than the original does in NeMo.

| | parakeet-tdt-0.6b-v3 | parakeet-ultra |
|---|---|---|
| Open ASR Leaderboard, 7 English sets (WER %) | 6.26 | **5.80** |
| FLEURS, 25 languages (WER %) | 11.62 | **9.55** |
| Business speech, AA-WER style (WER %) | 6.15 | **5.79** |
| Background noise, 9 MUSAN conditions (WER %) | 6.72 | **5.82** |
| TED-LIUM long-form (WER %) | 2.71 | **1.94** |

Its sibling [Parakeet Redux](https://huggingface.co/moondream/parakeet-redux) is the ternary version of the same
architecture, 178 MB, built for CPUs and Apple silicon. Read the
[release post](https://moondream.ai/blog/introducing-parakeet-redux-and-ultra) for the story behind both models.

## Usage

Run it with [Photon](https://moondream.ai/photon). Every accuracy number on this page is Photon on an NVIDIA GPU.

```python
# pip install moondream
import moondream as md

with md.photon("moondream/parakeet-ultra") as speech:
    result = speech.transcribe(audio="speech.wav")
    print(result["text"])

    # timestamps="segment": one entry per sentence, with its start
    # and end in seconds; "word" adds the start and end of every word
    result = speech.transcribe(audio="speech.wav", timestamps="word")
    for segment in result["segments"]:
        print(segment["start"], segment["end"], segment["text"])
        for word in segment["words"]:
            print(word["start"], word["end"], word["word"])
```

## Performance

Real-time factor: seconds of audio transcribed per second of wall clock, higher is faster. One NVIDIA B200, 128
requests in flight, the same files on both sides; NeMo 3.0 runs the original checkpoint with its own transcribe
call at batch 128, Photon runs parakeet-ultra.

| | NeMo, parakeet-tdt-0.6b-v3 | Photon, parakeet-ultra |
|---|---|---|
| LibriSpeech test-clean, 2,620 utterances, 5.4 hours | 6,005× | **9,743×** |
| AMI test, 12,643 utterances, 8.7 hours | 4,394× | **6,688×** |

## Benchmarks

Word error rate in percent, lower is better. Both models are scored on the same files with the Open ASR
Leaderboard's own pipeline as of September 2026 (its normalizers and compound-merging alignment, with the FLEURS
references prepared as the leaderboard's text column is). parakeet-ultra runs in Photon on an NVIDIA GPU, the
original in NeMo in bf16.

### Open ASR Leaderboard

The seven English test sets of the Hugging Face Open ASR Leaderboard: audiobooks (LibriSpeech), meetings (AMI),
earnings calls (Earnings-22), podcasts and YouTube (GigaSpeech), financial calls (SPGISpeech) and parliament
(VoxPopuli).

| set | parakeet-tdt-0.6b-v3 | parakeet-ultra |
|---|---|---|
| LibriSpeech test-clean | 1.52 | 1.41 |
| LibriSpeech test-other | 3.13 | 2.98 |
| AMI | 10.86 | 9.77 |
| Earnings-22 | 10.75 | 9.76 |
| GigaSpeech | 8.05 | 7.71 |
| SPGISpeech | 3.63 | 3.34 |
| VoxPopuli | 5.88 | 5.65 |
| **average** | **6.26** | **5.80** |

### FLEURS

The FLEURS test split: read Wikipedia sentences, a few hundred per language, for all 25 languages the model
supports.

| language | parakeet-tdt-0.6b-v3 | parakeet-ultra |
|---|---|---|
| Bulgarian | 11.90 | 10.09 |
| Croatian | 10.93 | 9.65 |
| Czech | 10.85 | 9.97 |
| Danish | 16.78 | 14.31 |
| Dutch | 6.18 | 5.46 |
| English | 4.25 | 3.55 |
| Estonian | 13.23 | 9.69 |
| Finnish | 11.05 | 9.19 |
| French | 4.81 | 4.32 |
| German | 4.13 | 3.61 |
| Greek | 35.71 | 32.25 |
| Hungarian | 13.65 | 10.76 |
| Italian | 2.61 | 2.00 |
| Latvian | 21.38 | 15.95 |
| Lithuanian | 21.09 | 16.36 |
| Maltese | 19.13 | 14.92 |
| Polish | 6.70 | 5.54 |
| Portuguese | 4.65 | 3.96 |
| Romanian | 11.54 | 9.18 |
| Russian | 5.91 | 5.21 |
| Slovak | 9.46 | 7.03 |
| Slovene | 21.76 | 16.64 |
| Spanish | 3.12 | 2.72 |
| Swedish | 13.75 | 11.57 |
| Ukrainian | 5.94 | 4.75 |
| **average** | **11.62** | **9.55** |

### Business speech (AA-WER style)

The AMI and VoxPopuli test sets with the Artificial Analysis cleaning applied, and Earnings-22 scored in 30-second
chunks joined per call, the way the AA-WER benchmark does it.

| set | parakeet-tdt-0.6b-v3 | parakeet-ultra |
|---|---|---|
| AMI (cleaned) | 9.52 | 8.48 |
| VoxPopuli (cleaned) | 3.02 | 3.10 |
| Earnings-22, 30-second chunks | 5.90 | 5.78 |
| **average** | **6.15** | **5.79** |

### Background noise

The clean sets with MUSAN noise (the half of the corpus not used for training) mixed in at a fixed signal-to-noise
ratio; 0 dB means the noise is as loud as the speech.

| set | parakeet-tdt-0.6b-v3 | parakeet-ultra |
|---|---|---|
| LibriSpeech test-other, 10 dB | 4.12 | 3.87 |
| LibriSpeech test-other, 5 dB | 5.49 | 5.10 |
| LibriSpeech test-other, 0 dB | 9.06 | 8.31 |
| FLEURS German, 10 dB | 5.78 | 4.98 |
| FLEURS German, 5 dB | 8.07 | 6.91 |
| FLEURS German, 0 dB | 14.45 | 12.08 |
| FLEURS Spanish, 10 dB | 3.99 | 3.13 |
| FLEURS Spanish, 5 dB | 4.12 | 3.38 |
| FLEURS Spanish, 0 dB | 5.44 | 4.64 |
| **average** | **6.72** | **5.82** |

### Long-form

Eleven complete TED-LIUM 3 talks of 10-20 minutes each. parakeet-ultra transcribes them through Photon, whose
segmenter cuts each talk at pauses found by the model's VAD head into segments of at most 30 seconds; the original
runs NeMo's own long-audio path.

| set | parakeet-tdt-0.6b-v3 | parakeet-ultra |
|---|---|---|
| TED-LIUM 3, 11 full talks of 10-20 minutes | 2.71 | 1.94 |

## Notes

- Based on [parakeet-tdt-0.6b-v3](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v3) by NVIDIA. Languages,
  tokenizer and output conventions (punctuation, casing, numerals) are the original's.
- Runs with [Photon](https://moondream.ai/photon).
- Long audio is segmented by the model itself: the weights carry a small voice-activity head on the encoder's
  subsampler, and Photon uses it to cut recordings at pauses into segments of at most 30 seconds. No external VAD
  model is needed.
- License is CC-BY-4.0, same as the original.