File size: 14,784 Bytes
8cf63df
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
2022-06-06 16:35:01,084 INFO [streaming_decode.py:640] Decoding started
2022-06-06 16:35:01,084 INFO [streaming_decode.py:646] Device: cuda:0
2022-06-06 16:35:01,087 INFO [streaming_decode.py:660] {'best_train_loss': inf, 'best_valid_loss': inf, 'best_train_epoch': -1, 'best_valid_epoch': -1, 'batch_idx_train': 0, 'log_interval': 50, 'reset_interval': 200, 'valid_interval': 3000, 'feature_dim': 80, 'subsampling_factor': 4, 'encoder_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'cnn_module_kernel': 31, 'num_encoder_layers': 12, 'decoder_dim': 512, 'joiner_dim': 512, 'model_warm_step': 3000, 'env_info': {'k2-version': '1.15.1', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'f8d2dba06c000ffee36aab5b66f24e7c9809f116', 'k2-git-date': 'Thu Apr 21 12:20:34 2022', 'lhotse-version': '1.1.0', 'torch-version': '1.10.0+cu102', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'streaming-conformer', 'icefall-git-sha1': '3aacf75-dirty', 'icefall-git-date': 'Mon Jun 6 06:46:40 2022', 'icefall-path': '/ceph-kw/kangwei/code/icefall_reworked2', 'k2-path': '/ceph-hw/kangwei/code/k2_release/k2/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-hw/kangwei/dev_tools/anaconda3/envs/rnnt2/lib/python3.8/site-packages/lhotse-1.1.0-py3.8.egg/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0602204318-5799c545db-hhjfr', 'IP address': '10.177.24.137'}, 'epoch': 29, 'iter': 0, 'avg': 6, 'use_averaged_model': False, 'exp_dir': PosixPath('streaming_pruned_transducer_stateless4/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'greedy_search', 'beam': 4, 'max_contexts': 4, 'max_states': 32, 'context_size': 2, 'dynamic_chunk_training': False, 'short_chunk_size': 25, 'num_left_chunks': 4, 'causal_convolution': True, 'decode_chunk_size': 16, 'left_context': 64, 'right_context': 2, 'num_decode_streams': 1000, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 200.0, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('streaming_pruned_transducer_stateless4/exp/streaming/greedy_search'), 'suffix': 'epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
2022-06-06 16:35:01,087 INFO [streaming_decode.py:662] About to create model
2022-06-06 16:35:01,504 INFO [streaming_decode.py:691] averaging ['streaming_pruned_transducer_stateless4/exp/epoch-24.pt', 'streaming_pruned_transducer_stateless4/exp/epoch-25.pt', 'streaming_pruned_transducer_stateless4/exp/epoch-26.pt', 'streaming_pruned_transducer_stateless4/exp/epoch-27.pt', 'streaming_pruned_transducer_stateless4/exp/epoch-28.pt', 'streaming_pruned_transducer_stateless4/exp/epoch-29.pt']
2022-06-06 16:35:13,122 INFO [streaming_decode.py:751] Number of model parameters: 78648040
2022-06-06 16:35:13,122 INFO [asr_datamodule.py:422] About to get test-clean cuts
2022-06-06 16:35:13,240 INFO [asr_datamodule.py:427] About to get test-other cuts
2022-06-06 16:35:13,569 INFO [streaming_decode.py:537] Cuts processed until now is 0.
2022-06-06 16:35:13,935 INFO [streaming_decode.py:537] Cuts processed until now is 50.
2022-06-06 16:35:14,192 INFO [streaming_decode.py:537] Cuts processed until now is 100.
2022-06-06 16:35:14,466 INFO [streaming_decode.py:537] Cuts processed until now is 150.
2022-06-06 16:35:14,818 INFO [streaming_decode.py:537] Cuts processed until now is 200.
2022-06-06 16:35:15,089 INFO [streaming_decode.py:537] Cuts processed until now is 250.
2022-06-06 16:35:15,451 INFO [streaming_decode.py:537] Cuts processed until now is 300.
2022-06-06 16:35:15,827 INFO [streaming_decode.py:537] Cuts processed until now is 350.
2022-06-06 16:35:16,109 INFO [streaming_decode.py:537] Cuts processed until now is 400.
2022-06-06 16:35:16,389 INFO [streaming_decode.py:537] Cuts processed until now is 450.
2022-06-06 16:35:16,666 INFO [streaming_decode.py:537] Cuts processed until now is 500.
2022-06-06 16:35:16,985 INFO [streaming_decode.py:537] Cuts processed until now is 550.
2022-06-06 16:35:17,322 INFO [streaming_decode.py:537] Cuts processed until now is 600.
2022-06-06 16:35:17,671 INFO [streaming_decode.py:537] Cuts processed until now is 650.
2022-06-06 16:35:17,952 INFO [streaming_decode.py:537] Cuts processed until now is 700.
2022-06-06 16:35:18,302 INFO [streaming_decode.py:537] Cuts processed until now is 750.
2022-06-06 16:35:18,639 INFO [streaming_decode.py:537] Cuts processed until now is 800.
2022-06-06 16:35:18,901 INFO [streaming_decode.py:537] Cuts processed until now is 850.
2022-06-06 16:35:19,193 INFO [streaming_decode.py:537] Cuts processed until now is 900.
2022-06-06 16:35:19,502 INFO [streaming_decode.py:537] Cuts processed until now is 950.
2022-06-06 16:35:21,789 INFO [streaming_decode.py:537] Cuts processed until now is 1000.
2022-06-06 16:35:22,691 INFO [streaming_decode.py:537] Cuts processed until now is 1050.
2022-06-06 16:35:23,658 INFO [streaming_decode.py:537] Cuts processed until now is 1100.
2022-06-06 16:35:23,970 INFO [streaming_decode.py:537] Cuts processed until now is 1150.
2022-06-06 16:35:24,946 INFO [streaming_decode.py:537] Cuts processed until now is 1200.
2022-06-06 16:35:25,199 INFO [streaming_decode.py:537] Cuts processed until now is 1250.
2022-06-06 16:35:26,107 INFO [streaming_decode.py:537] Cuts processed until now is 1300.
2022-06-06 16:35:26,404 INFO [streaming_decode.py:537] Cuts processed until now is 1350.
2022-06-06 16:35:27,361 INFO [streaming_decode.py:537] Cuts processed until now is 1400.
2022-06-06 16:35:27,606 INFO [streaming_decode.py:537] Cuts processed until now is 1450.
2022-06-06 16:35:28,590 INFO [streaming_decode.py:537] Cuts processed until now is 1500.
2022-06-06 16:35:29,656 INFO [streaming_decode.py:537] Cuts processed until now is 1550.
2022-06-06 16:35:29,925 INFO [streaming_decode.py:537] Cuts processed until now is 1600.
2022-06-06 16:35:30,945 INFO [streaming_decode.py:537] Cuts processed until now is 1650.
2022-06-06 16:35:31,254 INFO [streaming_decode.py:537] Cuts processed until now is 1700.
2022-06-06 16:35:32,243 INFO [streaming_decode.py:537] Cuts processed until now is 1750.
2022-06-06 16:35:33,193 INFO [streaming_decode.py:537] Cuts processed until now is 1800.
2022-06-06 16:35:33,506 INFO [streaming_decode.py:537] Cuts processed until now is 1850.
2022-06-06 16:35:34,430 INFO [streaming_decode.py:537] Cuts processed until now is 1900.
2022-06-06 16:35:34,763 INFO [streaming_decode.py:537] Cuts processed until now is 1950.
2022-06-06 16:35:35,810 INFO [streaming_decode.py:537] Cuts processed until now is 2000.
2022-06-06 16:35:36,689 INFO [streaming_decode.py:537] Cuts processed until now is 2050.
2022-06-06 16:35:36,952 INFO [streaming_decode.py:537] Cuts processed until now is 2100.
2022-06-06 16:35:37,915 INFO [streaming_decode.py:537] Cuts processed until now is 2150.
2022-06-06 16:35:38,864 INFO [streaming_decode.py:537] Cuts processed until now is 2200.
2022-06-06 16:35:39,135 INFO [streaming_decode.py:537] Cuts processed until now is 2250.
2022-06-06 16:35:40,085 INFO [streaming_decode.py:537] Cuts processed until now is 2300.
2022-06-06 16:35:40,320 INFO [streaming_decode.py:537] Cuts processed until now is 2350.
2022-06-06 16:35:41,383 INFO [streaming_decode.py:537] Cuts processed until now is 2400.
2022-06-06 16:35:42,289 INFO [streaming_decode.py:537] Cuts processed until now is 2450.
2022-06-06 16:35:42,604 INFO [streaming_decode.py:537] Cuts processed until now is 2500.
2022-06-06 16:35:43,616 INFO [streaming_decode.py:537] Cuts processed until now is 2550.
2022-06-06 16:35:43,880 INFO [streaming_decode.py:537] Cuts processed until now is 2600.
2022-06-06 16:35:51,829 INFO [streaming_decode.py:575] The transcripts are stored in streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/recogs-test-clean-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2.txt
2022-06-06 16:35:51,902 INFO [utils.py:405] [test-clean-greedy_search] %WER 3.36% [1764 / 52576, 187 ins, 163 del, 1414 sub ]
2022-06-06 16:35:52,087 INFO [streaming_decode.py:588] Wrote detailed error stats to streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/errs-test-clean-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2.txt
2022-06-06 16:35:52,088 INFO [streaming_decode.py:605] 
For test-clean, WER of different settings are:
greedy_search	3.36	best for test-clean

2022-06-06 16:35:52,092 INFO [streaming_decode.py:537] Cuts processed until now is 0.
2022-06-06 16:35:52,336 INFO [streaming_decode.py:537] Cuts processed until now is 50.
2022-06-06 16:35:52,604 INFO [streaming_decode.py:537] Cuts processed until now is 100.
2022-06-06 16:35:52,891 INFO [streaming_decode.py:537] Cuts processed until now is 150.
2022-06-06 16:35:53,101 INFO [streaming_decode.py:537] Cuts processed until now is 200.
2022-06-06 16:35:53,335 INFO [streaming_decode.py:537] Cuts processed until now is 250.
2022-06-06 16:35:53,621 INFO [streaming_decode.py:537] Cuts processed until now is 300.
2022-06-06 16:35:53,860 INFO [streaming_decode.py:537] Cuts processed until now is 350.
2022-06-06 16:35:54,080 INFO [streaming_decode.py:537] Cuts processed until now is 400.
2022-06-06 16:35:54,385 INFO [streaming_decode.py:537] Cuts processed until now is 450.
2022-06-06 16:35:54,666 INFO [streaming_decode.py:537] Cuts processed until now is 500.
2022-06-06 16:35:54,894 INFO [streaming_decode.py:537] Cuts processed until now is 550.
2022-06-06 16:35:55,165 INFO [streaming_decode.py:537] Cuts processed until now is 600.
2022-06-06 16:35:55,432 INFO [streaming_decode.py:537] Cuts processed until now is 650.
2022-06-06 16:35:55,666 INFO [streaming_decode.py:537] Cuts processed until now is 700.
2022-06-06 16:35:55,961 INFO [streaming_decode.py:537] Cuts processed until now is 750.
2022-06-06 16:35:56,187 INFO [streaming_decode.py:537] Cuts processed until now is 800.
2022-06-06 16:35:56,438 INFO [streaming_decode.py:537] Cuts processed until now is 850.
2022-06-06 16:35:56,766 INFO [streaming_decode.py:537] Cuts processed until now is 900.
2022-06-06 16:35:57,035 INFO [streaming_decode.py:537] Cuts processed until now is 950.
2022-06-06 16:35:59,445 INFO [streaming_decode.py:537] Cuts processed until now is 1000.
2022-06-06 16:36:00,490 INFO [streaming_decode.py:537] Cuts processed until now is 1050.
2022-06-06 16:36:00,747 INFO [streaming_decode.py:537] Cuts processed until now is 1100.
2022-06-06 16:36:01,688 INFO [streaming_decode.py:537] Cuts processed until now is 1150.
2022-06-06 16:36:01,963 INFO [streaming_decode.py:537] Cuts processed until now is 1200.
2022-06-06 16:36:02,937 INFO [streaming_decode.py:537] Cuts processed until now is 1250.
2022-06-06 16:36:03,263 INFO [streaming_decode.py:537] Cuts processed until now is 1300.
2022-06-06 16:36:04,146 INFO [streaming_decode.py:537] Cuts processed until now is 1350.
2022-06-06 16:36:04,404 INFO [streaming_decode.py:537] Cuts processed until now is 1400.
2022-06-06 16:36:05,355 INFO [streaming_decode.py:537] Cuts processed until now is 1450.
2022-06-06 16:36:05,609 INFO [streaming_decode.py:537] Cuts processed until now is 1500.
2022-06-06 16:36:06,529 INFO [streaming_decode.py:537] Cuts processed until now is 1550.
2022-06-06 16:36:07,526 INFO [streaming_decode.py:537] Cuts processed until now is 1600.
2022-06-06 16:36:07,812 INFO [streaming_decode.py:537] Cuts processed until now is 1650.
2022-06-06 16:36:08,708 INFO [streaming_decode.py:537] Cuts processed until now is 1700.
2022-06-06 16:36:08,991 INFO [streaming_decode.py:537] Cuts processed until now is 1750.
2022-06-06 16:36:10,043 INFO [streaming_decode.py:537] Cuts processed until now is 1800.
2022-06-06 16:36:10,320 INFO [streaming_decode.py:537] Cuts processed until now is 1850.
2022-06-06 16:36:11,207 INFO [streaming_decode.py:537] Cuts processed until now is 1900.
2022-06-06 16:36:11,419 INFO [streaming_decode.py:537] Cuts processed until now is 1950.
2022-06-06 16:36:12,378 INFO [streaming_decode.py:537] Cuts processed until now is 2000.
2022-06-06 16:36:12,611 INFO [streaming_decode.py:537] Cuts processed until now is 2050.
2022-06-06 16:36:13,581 INFO [streaming_decode.py:537] Cuts processed until now is 2100.
2022-06-06 16:36:13,850 INFO [streaming_decode.py:537] Cuts processed until now is 2150.
2022-06-06 16:36:14,802 INFO [streaming_decode.py:537] Cuts processed until now is 2200.
2022-06-06 16:36:15,056 INFO [streaming_decode.py:537] Cuts processed until now is 2250.
2022-06-06 16:36:15,962 INFO [streaming_decode.py:537] Cuts processed until now is 2300.
2022-06-06 16:36:16,981 INFO [streaming_decode.py:537] Cuts processed until now is 2350.
2022-06-06 16:36:17,226 INFO [streaming_decode.py:537] Cuts processed until now is 2400.
2022-06-06 16:36:18,346 INFO [streaming_decode.py:537] Cuts processed until now is 2450.
2022-06-06 16:36:18,600 INFO [streaming_decode.py:537] Cuts processed until now is 2500.
2022-06-06 16:36:19,769 INFO [streaming_decode.py:537] Cuts processed until now is 2550.
2022-06-06 16:36:19,998 INFO [streaming_decode.py:537] Cuts processed until now is 2600.
2022-06-06 16:36:21,134 INFO [streaming_decode.py:537] Cuts processed until now is 2650.
2022-06-06 16:36:21,362 INFO [streaming_decode.py:537] Cuts processed until now is 2700.
2022-06-06 16:36:22,572 INFO [streaming_decode.py:537] Cuts processed until now is 2750.
2022-06-06 16:36:22,807 INFO [streaming_decode.py:537] Cuts processed until now is 2800.
2022-06-06 16:36:23,918 INFO [streaming_decode.py:537] Cuts processed until now is 2850.
2022-06-06 16:36:24,207 INFO [streaming_decode.py:537] Cuts processed until now is 2900.
2022-06-06 16:36:33,609 INFO [streaming_decode.py:575] The transcripts are stored in streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/recogs-test-other-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2.txt
2022-06-06 16:36:33,681 INFO [utils.py:405] [test-other-greedy_search] %WER 8.81% [4609 / 52343, 471 ins, 508 del, 3630 sub ]
2022-06-06 16:36:33,946 INFO [streaming_decode.py:588] Wrote detailed error stats to streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/errs-test-other-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2.txt
2022-06-06 16:36:33,947 INFO [streaming_decode.py:605] 
For test-other, WER of different settings are:
greedy_search	8.81	best for test-other

2022-06-06 16:36:33,947 INFO [streaming_decode.py:776] Done!