File size: 14,592 Bytes
8cf63df |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 |
2022-06-06 16:42:33,553 INFO [streaming_decode.py:640] Decoding started
2022-06-06 16:42:33,554 INFO [streaming_decode.py:646] Device: cuda:0
2022-06-06 16:42:33,557 INFO [streaming_decode.py:660] {'best_train_loss': inf, 'best_valid_loss': inf, 'best_train_epoch': -1, 'best_valid_epoch': -1, 'batch_idx_train': 0, 'log_interval': 50, 'reset_interval': 200, 'valid_interval': 3000, 'feature_dim': 80, 'subsampling_factor': 4, 'encoder_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'cnn_module_kernel': 31, 'num_encoder_layers': 12, 'decoder_dim': 512, 'joiner_dim': 512, 'model_warm_step': 3000, 'env_info': {'k2-version': '1.15.1', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'f8d2dba06c000ffee36aab5b66f24e7c9809f116', 'k2-git-date': 'Thu Apr 21 12:20:34 2022', 'lhotse-version': '1.1.0', 'torch-version': '1.10.0+cu102', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'streaming-conformer', 'icefall-git-sha1': '3aacf75-dirty', 'icefall-git-date': 'Mon Jun 6 06:46:40 2022', 'icefall-path': '/ceph-kw/kangwei/code/icefall_reworked2', 'k2-path': '/ceph-hw/kangwei/code/k2_release/k2/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-hw/kangwei/dev_tools/anaconda3/envs/rnnt2/lib/python3.8/site-packages/lhotse-1.1.0-py3.8.egg/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0602204318-5799c545db-hhjfr', 'IP address': '10.177.24.137'}, 'epoch': 29, 'iter': 0, 'avg': 6, 'use_averaged_model': True, 'exp_dir': PosixPath('streaming_pruned_transducer_stateless4/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'greedy_search', 'beam': 4, 'max_contexts': 4, 'max_states': 32, 'context_size': 2, 'dynamic_chunk_training': False, 'short_chunk_size': 25, 'num_left_chunks': 4, 'causal_convolution': True, 'decode_chunk_size': 16, 'left_context': 64, 'right_context': 2, 'num_decode_streams': 1000, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 200.0, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('streaming_pruned_transducer_stateless4/exp/streaming/greedy_search'), 'suffix': 'epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2-use-averaged-model', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
2022-06-06 16:42:33,557 INFO [streaming_decode.py:662] About to create model
2022-06-06 16:42:34,009 INFO [streaming_decode.py:729] Calculating the averaged model over epoch range from 23 (excluded) to 29
2022-06-06 16:42:41,063 INFO [streaming_decode.py:751] Number of model parameters: 78648040
2022-06-06 16:42:41,064 INFO [asr_datamodule.py:422] About to get test-clean cuts
2022-06-06 16:42:41,260 INFO [asr_datamodule.py:427] About to get test-other cuts
2022-06-06 16:42:41,558 INFO [streaming_decode.py:537] Cuts processed until now is 0.
2022-06-06 16:42:41,839 INFO [streaming_decode.py:537] Cuts processed until now is 50.
2022-06-06 16:42:42,130 INFO [streaming_decode.py:537] Cuts processed until now is 100.
2022-06-06 16:42:42,401 INFO [streaming_decode.py:537] Cuts processed until now is 150.
2022-06-06 16:42:42,792 INFO [streaming_decode.py:537] Cuts processed until now is 200.
2022-06-06 16:42:43,114 INFO [streaming_decode.py:537] Cuts processed until now is 250.
2022-06-06 16:42:43,435 INFO [streaming_decode.py:537] Cuts processed until now is 300.
2022-06-06 16:42:43,761 INFO [streaming_decode.py:537] Cuts processed until now is 350.
2022-06-06 16:42:44,079 INFO [streaming_decode.py:537] Cuts processed until now is 400.
2022-06-06 16:42:44,406 INFO [streaming_decode.py:537] Cuts processed until now is 450.
2022-06-06 16:42:44,691 INFO [streaming_decode.py:537] Cuts processed until now is 500.
2022-06-06 16:42:45,018 INFO [streaming_decode.py:537] Cuts processed until now is 550.
2022-06-06 16:42:45,352 INFO [streaming_decode.py:537] Cuts processed until now is 600.
2022-06-06 16:42:45,622 INFO [streaming_decode.py:537] Cuts processed until now is 650.
2022-06-06 16:42:45,888 INFO [streaming_decode.py:537] Cuts processed until now is 700.
2022-06-06 16:42:46,244 INFO [streaming_decode.py:537] Cuts processed until now is 750.
2022-06-06 16:42:46,567 INFO [streaming_decode.py:537] Cuts processed until now is 800.
2022-06-06 16:42:46,864 INFO [streaming_decode.py:537] Cuts processed until now is 850.
2022-06-06 16:42:47,160 INFO [streaming_decode.py:537] Cuts processed until now is 900.
2022-06-06 16:42:47,460 INFO [streaming_decode.py:537] Cuts processed until now is 950.
2022-06-06 16:42:49,839 INFO [streaming_decode.py:537] Cuts processed until now is 1000.
2022-06-06 16:42:50,769 INFO [streaming_decode.py:537] Cuts processed until now is 1050.
2022-06-06 16:42:51,717 INFO [streaming_decode.py:537] Cuts processed until now is 1100.
2022-06-06 16:42:52,030 INFO [streaming_decode.py:537] Cuts processed until now is 1150.
2022-06-06 16:42:53,028 INFO [streaming_decode.py:537] Cuts processed until now is 1200.
2022-06-06 16:42:53,337 INFO [streaming_decode.py:537] Cuts processed until now is 1250.
2022-06-06 16:42:54,230 INFO [streaming_decode.py:537] Cuts processed until now is 1300.
2022-06-06 16:42:54,477 INFO [streaming_decode.py:537] Cuts processed until now is 1350.
2022-06-06 16:42:55,488 INFO [streaming_decode.py:537] Cuts processed until now is 1400.
2022-06-06 16:42:55,780 INFO [streaming_decode.py:537] Cuts processed until now is 1450.
2022-06-06 16:42:56,737 INFO [streaming_decode.py:537] Cuts processed until now is 1500.
2022-06-06 16:42:57,664 INFO [streaming_decode.py:537] Cuts processed until now is 1550.
2022-06-06 16:42:57,962 INFO [streaming_decode.py:537] Cuts processed until now is 1600.
2022-06-06 16:42:58,862 INFO [streaming_decode.py:537] Cuts processed until now is 1650.
2022-06-06 16:42:59,106 INFO [streaming_decode.py:537] Cuts processed until now is 1700.
2022-06-06 16:43:00,182 INFO [streaming_decode.py:537] Cuts processed until now is 1750.
2022-06-06 16:43:01,317 INFO [streaming_decode.py:537] Cuts processed until now is 1800.
2022-06-06 16:43:01,591 INFO [streaming_decode.py:537] Cuts processed until now is 1850.
2022-06-06 16:43:02,585 INFO [streaming_decode.py:537] Cuts processed until now is 1900.
2022-06-06 16:43:02,877 INFO [streaming_decode.py:537] Cuts processed until now is 1950.
2022-06-06 16:43:03,848 INFO [streaming_decode.py:537] Cuts processed until now is 2000.
2022-06-06 16:43:04,753 INFO [streaming_decode.py:537] Cuts processed until now is 2050.
2022-06-06 16:43:05,073 INFO [streaming_decode.py:537] Cuts processed until now is 2100.
2022-06-06 16:43:06,037 INFO [streaming_decode.py:537] Cuts processed until now is 2150.
2022-06-06 16:43:07,037 INFO [streaming_decode.py:537] Cuts processed until now is 2200.
2022-06-06 16:43:07,312 INFO [streaming_decode.py:537] Cuts processed until now is 2250.
2022-06-06 16:43:08,238 INFO [streaming_decode.py:537] Cuts processed until now is 2300.
2022-06-06 16:43:08,454 INFO [streaming_decode.py:537] Cuts processed until now is 2350.
2022-06-06 16:43:09,515 INFO [streaming_decode.py:537] Cuts processed until now is 2400.
2022-06-06 16:43:10,478 INFO [streaming_decode.py:537] Cuts processed until now is 2450.
2022-06-06 16:43:10,738 INFO [streaming_decode.py:537] Cuts processed until now is 2500.
2022-06-06 16:43:11,762 INFO [streaming_decode.py:537] Cuts processed until now is 2550.
2022-06-06 16:43:12,014 INFO [streaming_decode.py:537] Cuts processed until now is 2600.
2022-06-06 16:43:20,075 INFO [streaming_decode.py:575] The transcripts are stored in streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/recogs-test-clean-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2-use-averaged-model.txt
2022-06-06 16:43:20,145 INFO [utils.py:405] [test-clean-greedy_search] %WER 3.24% [1702 / 52576, 169 ins, 154 del, 1379 sub ]
2022-06-06 16:43:20,331 INFO [streaming_decode.py:588] Wrote detailed error stats to streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/errs-test-clean-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2-use-averaged-model.txt
2022-06-06 16:43:20,332 INFO [streaming_decode.py:605]
For test-clean, WER of different settings are:
greedy_search 3.24 best for test-clean
2022-06-06 16:43:20,337 INFO [streaming_decode.py:537] Cuts processed until now is 0.
2022-06-06 16:43:20,548 INFO [streaming_decode.py:537] Cuts processed until now is 50.
2022-06-06 16:43:20,757 INFO [streaming_decode.py:537] Cuts processed until now is 100.
2022-06-06 16:43:21,033 INFO [streaming_decode.py:537] Cuts processed until now is 150.
2022-06-06 16:43:21,288 INFO [streaming_decode.py:537] Cuts processed until now is 200.
2022-06-06 16:43:21,535 INFO [streaming_decode.py:537] Cuts processed until now is 250.
2022-06-06 16:43:21,781 INFO [streaming_decode.py:537] Cuts processed until now is 300.
2022-06-06 16:43:22,008 INFO [streaming_decode.py:537] Cuts processed until now is 350.
2022-06-06 16:43:22,250 INFO [streaming_decode.py:537] Cuts processed until now is 400.
2022-06-06 16:43:22,536 INFO [streaming_decode.py:537] Cuts processed until now is 450.
2022-06-06 16:43:22,754 INFO [streaming_decode.py:537] Cuts processed until now is 500.
2022-06-06 16:43:22,989 INFO [streaming_decode.py:537] Cuts processed until now is 550.
2022-06-06 16:43:23,239 INFO [streaming_decode.py:537] Cuts processed until now is 600.
2022-06-06 16:43:23,498 INFO [streaming_decode.py:537] Cuts processed until now is 650.
2022-06-06 16:43:23,715 INFO [streaming_decode.py:537] Cuts processed until now is 700.
2022-06-06 16:43:23,986 INFO [streaming_decode.py:537] Cuts processed until now is 750.
2022-06-06 16:43:24,173 INFO [streaming_decode.py:537] Cuts processed until now is 800.
2022-06-06 16:43:24,370 INFO [streaming_decode.py:537] Cuts processed until now is 850.
2022-06-06 16:43:24,653 INFO [streaming_decode.py:537] Cuts processed until now is 900.
2022-06-06 16:43:24,935 INFO [streaming_decode.py:537] Cuts processed until now is 950.
2022-06-06 16:43:27,178 INFO [streaming_decode.py:537] Cuts processed until now is 1000.
2022-06-06 16:43:28,187 INFO [streaming_decode.py:537] Cuts processed until now is 1050.
2022-06-06 16:43:28,423 INFO [streaming_decode.py:537] Cuts processed until now is 1100.
2022-06-06 16:43:29,349 INFO [streaming_decode.py:537] Cuts processed until now is 1150.
2022-06-06 16:43:29,565 INFO [streaming_decode.py:537] Cuts processed until now is 1200.
2022-06-06 16:43:30,491 INFO [streaming_decode.py:537] Cuts processed until now is 1250.
2022-06-06 16:43:30,708 INFO [streaming_decode.py:537] Cuts processed until now is 1300.
2022-06-06 16:43:31,571 INFO [streaming_decode.py:537] Cuts processed until now is 1350.
2022-06-06 16:43:31,889 INFO [streaming_decode.py:537] Cuts processed until now is 1400.
2022-06-06 16:43:32,846 INFO [streaming_decode.py:537] Cuts processed until now is 1450.
2022-06-06 16:43:33,084 INFO [streaming_decode.py:537] Cuts processed until now is 1500.
2022-06-06 16:43:33,964 INFO [streaming_decode.py:537] Cuts processed until now is 1550.
2022-06-06 16:43:34,916 INFO [streaming_decode.py:537] Cuts processed until now is 1600.
2022-06-06 16:43:35,232 INFO [streaming_decode.py:537] Cuts processed until now is 1650.
2022-06-06 16:43:36,139 INFO [streaming_decode.py:537] Cuts processed until now is 1700.
2022-06-06 16:43:36,401 INFO [streaming_decode.py:537] Cuts processed until now is 1750.
2022-06-06 16:43:37,298 INFO [streaming_decode.py:537] Cuts processed until now is 1800.
2022-06-06 16:43:37,587 INFO [streaming_decode.py:537] Cuts processed until now is 1850.
2022-06-06 16:43:38,541 INFO [streaming_decode.py:537] Cuts processed until now is 1900.
2022-06-06 16:43:38,734 INFO [streaming_decode.py:537] Cuts processed until now is 1950.
2022-06-06 16:43:39,739 INFO [streaming_decode.py:537] Cuts processed until now is 2000.
2022-06-06 16:43:40,001 INFO [streaming_decode.py:537] Cuts processed until now is 2050.
2022-06-06 16:43:40,920 INFO [streaming_decode.py:537] Cuts processed until now is 2100.
2022-06-06 16:43:41,137 INFO [streaming_decode.py:537] Cuts processed until now is 2150.
2022-06-06 16:43:42,021 INFO [streaming_decode.py:537] Cuts processed until now is 2200.
2022-06-06 16:43:42,277 INFO [streaming_decode.py:537] Cuts processed until now is 2250.
2022-06-06 16:43:43,241 INFO [streaming_decode.py:537] Cuts processed until now is 2300.
2022-06-06 16:43:44,196 INFO [streaming_decode.py:537] Cuts processed until now is 2350.
2022-06-06 16:43:44,418 INFO [streaming_decode.py:537] Cuts processed until now is 2400.
2022-06-06 16:43:45,308 INFO [streaming_decode.py:537] Cuts processed until now is 2450.
2022-06-06 16:43:45,560 INFO [streaming_decode.py:537] Cuts processed until now is 2500.
2022-06-06 16:43:46,493 INFO [streaming_decode.py:537] Cuts processed until now is 2550.
2022-06-06 16:43:46,713 INFO [streaming_decode.py:537] Cuts processed until now is 2600.
2022-06-06 16:43:47,634 INFO [streaming_decode.py:537] Cuts processed until now is 2650.
2022-06-06 16:43:47,903 INFO [streaming_decode.py:537] Cuts processed until now is 2700.
2022-06-06 16:43:48,817 INFO [streaming_decode.py:537] Cuts processed until now is 2750.
2022-06-06 16:43:49,018 INFO [streaming_decode.py:537] Cuts processed until now is 2800.
2022-06-06 16:43:49,914 INFO [streaming_decode.py:537] Cuts processed until now is 2850.
2022-06-06 16:43:50,195 INFO [streaming_decode.py:537] Cuts processed until now is 2900.
2022-06-06 16:43:57,510 INFO [streaming_decode.py:575] The transcripts are stored in streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/recogs-test-other-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2-use-averaged-model.txt
2022-06-06 16:43:57,583 INFO [utils.py:405] [test-other-greedy_search] %WER 8.61% [4507 / 52343, 441 ins, 506 del, 3560 sub ]
2022-06-06 16:43:57,851 INFO [streaming_decode.py:588] Wrote detailed error stats to streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/errs-test-other-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2-use-averaged-model.txt
2022-06-06 16:43:57,852 INFO [streaming_decode.py:605]
For test-other, WER of different settings are:
greedy_search 8.61 best for test-other
2022-06-06 16:43:57,852 INFO [streaming_decode.py:776] Done!
|