File size: 14,592 Bytes
8cf63df |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 |
2022-06-06 16:44:01,087 INFO [streaming_decode.py:640] Decoding started
2022-06-06 16:44:01,087 INFO [streaming_decode.py:646] Device: cuda:0
2022-06-06 16:44:01,089 INFO [streaming_decode.py:660] {'best_train_loss': inf, 'best_valid_loss': inf, 'best_train_epoch': -1, 'best_valid_epoch': -1, 'batch_idx_train': 0, 'log_interval': 50, 'reset_interval': 200, 'valid_interval': 3000, 'feature_dim': 80, 'subsampling_factor': 4, 'encoder_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'cnn_module_kernel': 31, 'num_encoder_layers': 12, 'decoder_dim': 512, 'joiner_dim': 512, 'model_warm_step': 3000, 'env_info': {'k2-version': '1.15.1', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'f8d2dba06c000ffee36aab5b66f24e7c9809f116', 'k2-git-date': 'Thu Apr 21 12:20:34 2022', 'lhotse-version': '1.1.0', 'torch-version': '1.10.0+cu102', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'streaming-conformer', 'icefall-git-sha1': '3aacf75-dirty', 'icefall-git-date': 'Mon Jun 6 06:46:40 2022', 'icefall-path': '/ceph-kw/kangwei/code/icefall_reworked2', 'k2-path': '/ceph-hw/kangwei/code/k2_release/k2/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-hw/kangwei/dev_tools/anaconda3/envs/rnnt2/lib/python3.8/site-packages/lhotse-1.1.0-py3.8.egg/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0602204318-5799c545db-hhjfr', 'IP address': '10.177.24.137'}, 'epoch': 29, 'iter': 0, 'avg': 6, 'use_averaged_model': True, 'exp_dir': PosixPath('streaming_pruned_transducer_stateless4/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'greedy_search', 'beam': 4, 'max_contexts': 4, 'max_states': 32, 'context_size': 2, 'dynamic_chunk_training': False, 'short_chunk_size': 25, 'num_left_chunks': 4, 'causal_convolution': True, 'decode_chunk_size': 16, 'left_context': 64, 'right_context': 4, 'num_decode_streams': 1000, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 200.0, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('streaming_pruned_transducer_stateless4/exp/streaming/greedy_search'), 'suffix': 'epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-4-use-averaged-model', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
2022-06-06 16:44:01,090 INFO [streaming_decode.py:662] About to create model
2022-06-06 16:44:01,479 INFO [streaming_decode.py:729] Calculating the averaged model over epoch range from 23 (excluded) to 29
2022-06-06 16:44:08,423 INFO [streaming_decode.py:751] Number of model parameters: 78648040
2022-06-06 16:44:08,424 INFO [asr_datamodule.py:422] About to get test-clean cuts
2022-06-06 16:44:08,622 INFO [asr_datamodule.py:427] About to get test-other cuts
2022-06-06 16:44:08,917 INFO [streaming_decode.py:537] Cuts processed until now is 0.
2022-06-06 16:44:09,191 INFO [streaming_decode.py:537] Cuts processed until now is 50.
2022-06-06 16:44:09,490 INFO [streaming_decode.py:537] Cuts processed until now is 100.
2022-06-06 16:44:09,758 INFO [streaming_decode.py:537] Cuts processed until now is 150.
2022-06-06 16:44:10,078 INFO [streaming_decode.py:537] Cuts processed until now is 200.
2022-06-06 16:44:10,371 INFO [streaming_decode.py:537] Cuts processed until now is 250.
2022-06-06 16:44:10,671 INFO [streaming_decode.py:537] Cuts processed until now is 300.
2022-06-06 16:44:10,961 INFO [streaming_decode.py:537] Cuts processed until now is 350.
2022-06-06 16:44:11,205 INFO [streaming_decode.py:537] Cuts processed until now is 400.
2022-06-06 16:44:11,552 INFO [streaming_decode.py:537] Cuts processed until now is 450.
2022-06-06 16:44:11,859 INFO [streaming_decode.py:537] Cuts processed until now is 500.
2022-06-06 16:44:12,172 INFO [streaming_decode.py:537] Cuts processed until now is 550.
2022-06-06 16:44:12,532 INFO [streaming_decode.py:537] Cuts processed until now is 600.
2022-06-06 16:44:12,805 INFO [streaming_decode.py:537] Cuts processed until now is 650.
2022-06-06 16:44:13,117 INFO [streaming_decode.py:537] Cuts processed until now is 700.
2022-06-06 16:44:13,422 INFO [streaming_decode.py:537] Cuts processed until now is 750.
2022-06-06 16:44:13,714 INFO [streaming_decode.py:537] Cuts processed until now is 800.
2022-06-06 16:44:13,985 INFO [streaming_decode.py:537] Cuts processed until now is 850.
2022-06-06 16:44:14,238 INFO [streaming_decode.py:537] Cuts processed until now is 900.
2022-06-06 16:44:14,537 INFO [streaming_decode.py:537] Cuts processed until now is 950.
2022-06-06 16:44:17,068 INFO [streaming_decode.py:537] Cuts processed until now is 1000.
2022-06-06 16:44:18,020 INFO [streaming_decode.py:537] Cuts processed until now is 1050.
2022-06-06 16:44:18,981 INFO [streaming_decode.py:537] Cuts processed until now is 1100.
2022-06-06 16:44:19,272 INFO [streaming_decode.py:537] Cuts processed until now is 1150.
2022-06-06 16:44:20,309 INFO [streaming_decode.py:537] Cuts processed until now is 1200.
2022-06-06 16:44:20,559 INFO [streaming_decode.py:537] Cuts processed until now is 1250.
2022-06-06 16:44:21,518 INFO [streaming_decode.py:537] Cuts processed until now is 1300.
2022-06-06 16:44:21,851 INFO [streaming_decode.py:537] Cuts processed until now is 1350.
2022-06-06 16:44:22,881 INFO [streaming_decode.py:537] Cuts processed until now is 1400.
2022-06-06 16:44:23,121 INFO [streaming_decode.py:537] Cuts processed until now is 1450.
2022-06-06 16:44:24,173 INFO [streaming_decode.py:537] Cuts processed until now is 1500.
2022-06-06 16:44:25,133 INFO [streaming_decode.py:537] Cuts processed until now is 1550.
2022-06-06 16:44:25,396 INFO [streaming_decode.py:537] Cuts processed until now is 1600.
2022-06-06 16:44:26,373 INFO [streaming_decode.py:537] Cuts processed until now is 1650.
2022-06-06 16:44:26,626 INFO [streaming_decode.py:537] Cuts processed until now is 1700.
2022-06-06 16:44:27,664 INFO [streaming_decode.py:537] Cuts processed until now is 1750.
2022-06-06 16:44:28,773 INFO [streaming_decode.py:537] Cuts processed until now is 1800.
2022-06-06 16:44:29,063 INFO [streaming_decode.py:537] Cuts processed until now is 1850.
2022-06-06 16:44:30,009 INFO [streaming_decode.py:537] Cuts processed until now is 1900.
2022-06-06 16:44:30,263 INFO [streaming_decode.py:537] Cuts processed until now is 1950.
2022-06-06 16:44:31,302 INFO [streaming_decode.py:537] Cuts processed until now is 2000.
2022-06-06 16:44:32,259 INFO [streaming_decode.py:537] Cuts processed until now is 2050.
2022-06-06 16:44:32,538 INFO [streaming_decode.py:537] Cuts processed until now is 2100.
2022-06-06 16:44:33,538 INFO [streaming_decode.py:537] Cuts processed until now is 2150.
2022-06-06 16:44:34,567 INFO [streaming_decode.py:537] Cuts processed until now is 2200.
2022-06-06 16:44:34,861 INFO [streaming_decode.py:537] Cuts processed until now is 2250.
2022-06-06 16:44:35,865 INFO [streaming_decode.py:537] Cuts processed until now is 2300.
2022-06-06 16:44:36,194 INFO [streaming_decode.py:537] Cuts processed until now is 2350.
2022-06-06 16:44:37,173 INFO [streaming_decode.py:537] Cuts processed until now is 2400.
2022-06-06 16:44:38,141 INFO [streaming_decode.py:537] Cuts processed until now is 2450.
2022-06-06 16:44:38,439 INFO [streaming_decode.py:537] Cuts processed until now is 2500.
2022-06-06 16:44:39,493 INFO [streaming_decode.py:537] Cuts processed until now is 2550.
2022-06-06 16:44:39,802 INFO [streaming_decode.py:537] Cuts processed until now is 2600.
2022-06-06 16:44:48,268 INFO [streaming_decode.py:575] The transcripts are stored in streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/recogs-test-clean-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-4-use-averaged-model.txt
2022-06-06 16:44:48,338 INFO [utils.py:405] [test-clean-greedy_search] %WER 3.26% [1715 / 52576, 166 ins, 153 del, 1396 sub ]
2022-06-06 16:44:48,541 INFO [streaming_decode.py:588] Wrote detailed error stats to streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/errs-test-clean-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-4-use-averaged-model.txt
2022-06-06 16:44:48,542 INFO [streaming_decode.py:605]
For test-clean, WER of different settings are:
greedy_search 3.26 best for test-clean
2022-06-06 16:44:48,548 INFO [streaming_decode.py:537] Cuts processed until now is 0.
2022-06-06 16:44:48,825 INFO [streaming_decode.py:537] Cuts processed until now is 50.
2022-06-06 16:44:49,028 INFO [streaming_decode.py:537] Cuts processed until now is 100.
2022-06-06 16:44:49,283 INFO [streaming_decode.py:537] Cuts processed until now is 150.
2022-06-06 16:44:49,546 INFO [streaming_decode.py:537] Cuts processed until now is 200.
2022-06-06 16:44:49,826 INFO [streaming_decode.py:537] Cuts processed until now is 250.
2022-06-06 16:44:50,035 INFO [streaming_decode.py:537] Cuts processed until now is 300.
2022-06-06 16:44:50,255 INFO [streaming_decode.py:537] Cuts processed until now is 350.
2022-06-06 16:44:50,485 INFO [streaming_decode.py:537] Cuts processed until now is 400.
2022-06-06 16:44:50,705 INFO [streaming_decode.py:537] Cuts processed until now is 450.
2022-06-06 16:44:50,949 INFO [streaming_decode.py:537] Cuts processed until now is 500.
2022-06-06 16:44:51,240 INFO [streaming_decode.py:537] Cuts processed until now is 550.
2022-06-06 16:44:51,463 INFO [streaming_decode.py:537] Cuts processed until now is 600.
2022-06-06 16:44:51,720 INFO [streaming_decode.py:537] Cuts processed until now is 650.
2022-06-06 16:44:51,934 INFO [streaming_decode.py:537] Cuts processed until now is 700.
2022-06-06 16:44:52,177 INFO [streaming_decode.py:537] Cuts processed until now is 750.
2022-06-06 16:44:52,401 INFO [streaming_decode.py:537] Cuts processed until now is 800.
2022-06-06 16:44:52,614 INFO [streaming_decode.py:537] Cuts processed until now is 850.
2022-06-06 16:44:52,865 INFO [streaming_decode.py:537] Cuts processed until now is 900.
2022-06-06 16:44:53,088 INFO [streaming_decode.py:537] Cuts processed until now is 950.
2022-06-06 16:44:55,448 INFO [streaming_decode.py:537] Cuts processed until now is 1000.
2022-06-06 16:44:56,403 INFO [streaming_decode.py:537] Cuts processed until now is 1050.
2022-06-06 16:44:56,710 INFO [streaming_decode.py:537] Cuts processed until now is 1100.
2022-06-06 16:44:57,764 INFO [streaming_decode.py:537] Cuts processed until now is 1150.
2022-06-06 16:44:58,032 INFO [streaming_decode.py:537] Cuts processed until now is 1200.
2022-06-06 16:44:59,062 INFO [streaming_decode.py:537] Cuts processed until now is 1250.
2022-06-06 16:44:59,307 INFO [streaming_decode.py:537] Cuts processed until now is 1300.
2022-06-06 16:45:00,211 INFO [streaming_decode.py:537] Cuts processed until now is 1350.
2022-06-06 16:45:00,471 INFO [streaming_decode.py:537] Cuts processed until now is 1400.
2022-06-06 16:45:01,475 INFO [streaming_decode.py:537] Cuts processed until now is 1450.
2022-06-06 16:45:01,736 INFO [streaming_decode.py:537] Cuts processed until now is 1500.
2022-06-06 16:45:02,685 INFO [streaming_decode.py:537] Cuts processed until now is 1550.
2022-06-06 16:45:03,694 INFO [streaming_decode.py:537] Cuts processed until now is 1600.
2022-06-06 16:45:03,959 INFO [streaming_decode.py:537] Cuts processed until now is 1650.
2022-06-06 16:45:04,882 INFO [streaming_decode.py:537] Cuts processed until now is 1700.
2022-06-06 16:45:05,111 INFO [streaming_decode.py:537] Cuts processed until now is 1750.
2022-06-06 16:45:06,104 INFO [streaming_decode.py:537] Cuts processed until now is 1800.
2022-06-06 16:45:06,403 INFO [streaming_decode.py:537] Cuts processed until now is 1850.
2022-06-06 16:45:07,322 INFO [streaming_decode.py:537] Cuts processed until now is 1900.
2022-06-06 16:45:07,511 INFO [streaming_decode.py:537] Cuts processed until now is 1950.
2022-06-06 16:45:08,441 INFO [streaming_decode.py:537] Cuts processed until now is 2000.
2022-06-06 16:45:08,780 INFO [streaming_decode.py:537] Cuts processed until now is 2050.
2022-06-06 16:45:09,806 INFO [streaming_decode.py:537] Cuts processed until now is 2100.
2022-06-06 16:45:10,023 INFO [streaming_decode.py:537] Cuts processed until now is 2150.
2022-06-06 16:45:10,970 INFO [streaming_decode.py:537] Cuts processed until now is 2200.
2022-06-06 16:45:11,293 INFO [streaming_decode.py:537] Cuts processed until now is 2250.
2022-06-06 16:45:12,231 INFO [streaming_decode.py:537] Cuts processed until now is 2300.
2022-06-06 16:45:13,226 INFO [streaming_decode.py:537] Cuts processed until now is 2350.
2022-06-06 16:45:13,493 INFO [streaming_decode.py:537] Cuts processed until now is 2400.
2022-06-06 16:45:14,419 INFO [streaming_decode.py:537] Cuts processed until now is 2450.
2022-06-06 16:45:14,606 INFO [streaming_decode.py:537] Cuts processed until now is 2500.
2022-06-06 16:45:15,639 INFO [streaming_decode.py:537] Cuts processed until now is 2550.
2022-06-06 16:45:15,908 INFO [streaming_decode.py:537] Cuts processed until now is 2600.
2022-06-06 16:45:16,897 INFO [streaming_decode.py:537] Cuts processed until now is 2650.
2022-06-06 16:45:17,143 INFO [streaming_decode.py:537] Cuts processed until now is 2700.
2022-06-06 16:45:18,119 INFO [streaming_decode.py:537] Cuts processed until now is 2750.
2022-06-06 16:45:18,401 INFO [streaming_decode.py:537] Cuts processed until now is 2800.
2022-06-06 16:45:19,347 INFO [streaming_decode.py:537] Cuts processed until now is 2850.
2022-06-06 16:45:19,541 INFO [streaming_decode.py:537] Cuts processed until now is 2900.
2022-06-06 16:45:27,038 INFO [streaming_decode.py:575] The transcripts are stored in streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/recogs-test-other-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-4-use-averaged-model.txt
2022-06-06 16:45:27,120 INFO [utils.py:405] [test-other-greedy_search] %WER 8.44% [4419 / 52343, 428 ins, 502 del, 3489 sub ]
2022-06-06 16:45:27,312 INFO [streaming_decode.py:588] Wrote detailed error stats to streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/errs-test-other-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-4-use-averaged-model.txt
2022-06-06 16:45:27,312 INFO [streaming_decode.py:605]
For test-other, WER of different settings are:
greedy_search 8.44 best for test-other
2022-06-06 16:45:27,313 INFO [streaming_decode.py:776] Done!
|