File size: 14,784 Bytes
8cf63df |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 |
2022-06-06 16:35:01,084 INFO [streaming_decode.py:640] Decoding started
2022-06-06 16:35:01,084 INFO [streaming_decode.py:646] Device: cuda:0
2022-06-06 16:35:01,087 INFO [streaming_decode.py:660] {'best_train_loss': inf, 'best_valid_loss': inf, 'best_train_epoch': -1, 'best_valid_epoch': -1, 'batch_idx_train': 0, 'log_interval': 50, 'reset_interval': 200, 'valid_interval': 3000, 'feature_dim': 80, 'subsampling_factor': 4, 'encoder_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'cnn_module_kernel': 31, 'num_encoder_layers': 12, 'decoder_dim': 512, 'joiner_dim': 512, 'model_warm_step': 3000, 'env_info': {'k2-version': '1.15.1', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'f8d2dba06c000ffee36aab5b66f24e7c9809f116', 'k2-git-date': 'Thu Apr 21 12:20:34 2022', 'lhotse-version': '1.1.0', 'torch-version': '1.10.0+cu102', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'streaming-conformer', 'icefall-git-sha1': '3aacf75-dirty', 'icefall-git-date': 'Mon Jun 6 06:46:40 2022', 'icefall-path': '/ceph-kw/kangwei/code/icefall_reworked2', 'k2-path': '/ceph-hw/kangwei/code/k2_release/k2/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-hw/kangwei/dev_tools/anaconda3/envs/rnnt2/lib/python3.8/site-packages/lhotse-1.1.0-py3.8.egg/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0602204318-5799c545db-hhjfr', 'IP address': '10.177.24.137'}, 'epoch': 29, 'iter': 0, 'avg': 6, 'use_averaged_model': False, 'exp_dir': PosixPath('streaming_pruned_transducer_stateless4/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'greedy_search', 'beam': 4, 'max_contexts': 4, 'max_states': 32, 'context_size': 2, 'dynamic_chunk_training': False, 'short_chunk_size': 25, 'num_left_chunks': 4, 'causal_convolution': True, 'decode_chunk_size': 16, 'left_context': 64, 'right_context': 2, 'num_decode_streams': 1000, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 200.0, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('streaming_pruned_transducer_stateless4/exp/streaming/greedy_search'), 'suffix': 'epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
2022-06-06 16:35:01,087 INFO [streaming_decode.py:662] About to create model
2022-06-06 16:35:01,504 INFO [streaming_decode.py:691] averaging ['streaming_pruned_transducer_stateless4/exp/epoch-24.pt', 'streaming_pruned_transducer_stateless4/exp/epoch-25.pt', 'streaming_pruned_transducer_stateless4/exp/epoch-26.pt', 'streaming_pruned_transducer_stateless4/exp/epoch-27.pt', 'streaming_pruned_transducer_stateless4/exp/epoch-28.pt', 'streaming_pruned_transducer_stateless4/exp/epoch-29.pt']
2022-06-06 16:35:13,122 INFO [streaming_decode.py:751] Number of model parameters: 78648040
2022-06-06 16:35:13,122 INFO [asr_datamodule.py:422] About to get test-clean cuts
2022-06-06 16:35:13,240 INFO [asr_datamodule.py:427] About to get test-other cuts
2022-06-06 16:35:13,569 INFO [streaming_decode.py:537] Cuts processed until now is 0.
2022-06-06 16:35:13,935 INFO [streaming_decode.py:537] Cuts processed until now is 50.
2022-06-06 16:35:14,192 INFO [streaming_decode.py:537] Cuts processed until now is 100.
2022-06-06 16:35:14,466 INFO [streaming_decode.py:537] Cuts processed until now is 150.
2022-06-06 16:35:14,818 INFO [streaming_decode.py:537] Cuts processed until now is 200.
2022-06-06 16:35:15,089 INFO [streaming_decode.py:537] Cuts processed until now is 250.
2022-06-06 16:35:15,451 INFO [streaming_decode.py:537] Cuts processed until now is 300.
2022-06-06 16:35:15,827 INFO [streaming_decode.py:537] Cuts processed until now is 350.
2022-06-06 16:35:16,109 INFO [streaming_decode.py:537] Cuts processed until now is 400.
2022-06-06 16:35:16,389 INFO [streaming_decode.py:537] Cuts processed until now is 450.
2022-06-06 16:35:16,666 INFO [streaming_decode.py:537] Cuts processed until now is 500.
2022-06-06 16:35:16,985 INFO [streaming_decode.py:537] Cuts processed until now is 550.
2022-06-06 16:35:17,322 INFO [streaming_decode.py:537] Cuts processed until now is 600.
2022-06-06 16:35:17,671 INFO [streaming_decode.py:537] Cuts processed until now is 650.
2022-06-06 16:35:17,952 INFO [streaming_decode.py:537] Cuts processed until now is 700.
2022-06-06 16:35:18,302 INFO [streaming_decode.py:537] Cuts processed until now is 750.
2022-06-06 16:35:18,639 INFO [streaming_decode.py:537] Cuts processed until now is 800.
2022-06-06 16:35:18,901 INFO [streaming_decode.py:537] Cuts processed until now is 850.
2022-06-06 16:35:19,193 INFO [streaming_decode.py:537] Cuts processed until now is 900.
2022-06-06 16:35:19,502 INFO [streaming_decode.py:537] Cuts processed until now is 950.
2022-06-06 16:35:21,789 INFO [streaming_decode.py:537] Cuts processed until now is 1000.
2022-06-06 16:35:22,691 INFO [streaming_decode.py:537] Cuts processed until now is 1050.
2022-06-06 16:35:23,658 INFO [streaming_decode.py:537] Cuts processed until now is 1100.
2022-06-06 16:35:23,970 INFO [streaming_decode.py:537] Cuts processed until now is 1150.
2022-06-06 16:35:24,946 INFO [streaming_decode.py:537] Cuts processed until now is 1200.
2022-06-06 16:35:25,199 INFO [streaming_decode.py:537] Cuts processed until now is 1250.
2022-06-06 16:35:26,107 INFO [streaming_decode.py:537] Cuts processed until now is 1300.
2022-06-06 16:35:26,404 INFO [streaming_decode.py:537] Cuts processed until now is 1350.
2022-06-06 16:35:27,361 INFO [streaming_decode.py:537] Cuts processed until now is 1400.
2022-06-06 16:35:27,606 INFO [streaming_decode.py:537] Cuts processed until now is 1450.
2022-06-06 16:35:28,590 INFO [streaming_decode.py:537] Cuts processed until now is 1500.
2022-06-06 16:35:29,656 INFO [streaming_decode.py:537] Cuts processed until now is 1550.
2022-06-06 16:35:29,925 INFO [streaming_decode.py:537] Cuts processed until now is 1600.
2022-06-06 16:35:30,945 INFO [streaming_decode.py:537] Cuts processed until now is 1650.
2022-06-06 16:35:31,254 INFO [streaming_decode.py:537] Cuts processed until now is 1700.
2022-06-06 16:35:32,243 INFO [streaming_decode.py:537] Cuts processed until now is 1750.
2022-06-06 16:35:33,193 INFO [streaming_decode.py:537] Cuts processed until now is 1800.
2022-06-06 16:35:33,506 INFO [streaming_decode.py:537] Cuts processed until now is 1850.
2022-06-06 16:35:34,430 INFO [streaming_decode.py:537] Cuts processed until now is 1900.
2022-06-06 16:35:34,763 INFO [streaming_decode.py:537] Cuts processed until now is 1950.
2022-06-06 16:35:35,810 INFO [streaming_decode.py:537] Cuts processed until now is 2000.
2022-06-06 16:35:36,689 INFO [streaming_decode.py:537] Cuts processed until now is 2050.
2022-06-06 16:35:36,952 INFO [streaming_decode.py:537] Cuts processed until now is 2100.
2022-06-06 16:35:37,915 INFO [streaming_decode.py:537] Cuts processed until now is 2150.
2022-06-06 16:35:38,864 INFO [streaming_decode.py:537] Cuts processed until now is 2200.
2022-06-06 16:35:39,135 INFO [streaming_decode.py:537] Cuts processed until now is 2250.
2022-06-06 16:35:40,085 INFO [streaming_decode.py:537] Cuts processed until now is 2300.
2022-06-06 16:35:40,320 INFO [streaming_decode.py:537] Cuts processed until now is 2350.
2022-06-06 16:35:41,383 INFO [streaming_decode.py:537] Cuts processed until now is 2400.
2022-06-06 16:35:42,289 INFO [streaming_decode.py:537] Cuts processed until now is 2450.
2022-06-06 16:35:42,604 INFO [streaming_decode.py:537] Cuts processed until now is 2500.
2022-06-06 16:35:43,616 INFO [streaming_decode.py:537] Cuts processed until now is 2550.
2022-06-06 16:35:43,880 INFO [streaming_decode.py:537] Cuts processed until now is 2600.
2022-06-06 16:35:51,829 INFO [streaming_decode.py:575] The transcripts are stored in streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/recogs-test-clean-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2.txt
2022-06-06 16:35:51,902 INFO [utils.py:405] [test-clean-greedy_search] %WER 3.36% [1764 / 52576, 187 ins, 163 del, 1414 sub ]
2022-06-06 16:35:52,087 INFO [streaming_decode.py:588] Wrote detailed error stats to streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/errs-test-clean-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2.txt
2022-06-06 16:35:52,088 INFO [streaming_decode.py:605]
For test-clean, WER of different settings are:
greedy_search 3.36 best for test-clean
2022-06-06 16:35:52,092 INFO [streaming_decode.py:537] Cuts processed until now is 0.
2022-06-06 16:35:52,336 INFO [streaming_decode.py:537] Cuts processed until now is 50.
2022-06-06 16:35:52,604 INFO [streaming_decode.py:537] Cuts processed until now is 100.
2022-06-06 16:35:52,891 INFO [streaming_decode.py:537] Cuts processed until now is 150.
2022-06-06 16:35:53,101 INFO [streaming_decode.py:537] Cuts processed until now is 200.
2022-06-06 16:35:53,335 INFO [streaming_decode.py:537] Cuts processed until now is 250.
2022-06-06 16:35:53,621 INFO [streaming_decode.py:537] Cuts processed until now is 300.
2022-06-06 16:35:53,860 INFO [streaming_decode.py:537] Cuts processed until now is 350.
2022-06-06 16:35:54,080 INFO [streaming_decode.py:537] Cuts processed until now is 400.
2022-06-06 16:35:54,385 INFO [streaming_decode.py:537] Cuts processed until now is 450.
2022-06-06 16:35:54,666 INFO [streaming_decode.py:537] Cuts processed until now is 500.
2022-06-06 16:35:54,894 INFO [streaming_decode.py:537] Cuts processed until now is 550.
2022-06-06 16:35:55,165 INFO [streaming_decode.py:537] Cuts processed until now is 600.
2022-06-06 16:35:55,432 INFO [streaming_decode.py:537] Cuts processed until now is 650.
2022-06-06 16:35:55,666 INFO [streaming_decode.py:537] Cuts processed until now is 700.
2022-06-06 16:35:55,961 INFO [streaming_decode.py:537] Cuts processed until now is 750.
2022-06-06 16:35:56,187 INFO [streaming_decode.py:537] Cuts processed until now is 800.
2022-06-06 16:35:56,438 INFO [streaming_decode.py:537] Cuts processed until now is 850.
2022-06-06 16:35:56,766 INFO [streaming_decode.py:537] Cuts processed until now is 900.
2022-06-06 16:35:57,035 INFO [streaming_decode.py:537] Cuts processed until now is 950.
2022-06-06 16:35:59,445 INFO [streaming_decode.py:537] Cuts processed until now is 1000.
2022-06-06 16:36:00,490 INFO [streaming_decode.py:537] Cuts processed until now is 1050.
2022-06-06 16:36:00,747 INFO [streaming_decode.py:537] Cuts processed until now is 1100.
2022-06-06 16:36:01,688 INFO [streaming_decode.py:537] Cuts processed until now is 1150.
2022-06-06 16:36:01,963 INFO [streaming_decode.py:537] Cuts processed until now is 1200.
2022-06-06 16:36:02,937 INFO [streaming_decode.py:537] Cuts processed until now is 1250.
2022-06-06 16:36:03,263 INFO [streaming_decode.py:537] Cuts processed until now is 1300.
2022-06-06 16:36:04,146 INFO [streaming_decode.py:537] Cuts processed until now is 1350.
2022-06-06 16:36:04,404 INFO [streaming_decode.py:537] Cuts processed until now is 1400.
2022-06-06 16:36:05,355 INFO [streaming_decode.py:537] Cuts processed until now is 1450.
2022-06-06 16:36:05,609 INFO [streaming_decode.py:537] Cuts processed until now is 1500.
2022-06-06 16:36:06,529 INFO [streaming_decode.py:537] Cuts processed until now is 1550.
2022-06-06 16:36:07,526 INFO [streaming_decode.py:537] Cuts processed until now is 1600.
2022-06-06 16:36:07,812 INFO [streaming_decode.py:537] Cuts processed until now is 1650.
2022-06-06 16:36:08,708 INFO [streaming_decode.py:537] Cuts processed until now is 1700.
2022-06-06 16:36:08,991 INFO [streaming_decode.py:537] Cuts processed until now is 1750.
2022-06-06 16:36:10,043 INFO [streaming_decode.py:537] Cuts processed until now is 1800.
2022-06-06 16:36:10,320 INFO [streaming_decode.py:537] Cuts processed until now is 1850.
2022-06-06 16:36:11,207 INFO [streaming_decode.py:537] Cuts processed until now is 1900.
2022-06-06 16:36:11,419 INFO [streaming_decode.py:537] Cuts processed until now is 1950.
2022-06-06 16:36:12,378 INFO [streaming_decode.py:537] Cuts processed until now is 2000.
2022-06-06 16:36:12,611 INFO [streaming_decode.py:537] Cuts processed until now is 2050.
2022-06-06 16:36:13,581 INFO [streaming_decode.py:537] Cuts processed until now is 2100.
2022-06-06 16:36:13,850 INFO [streaming_decode.py:537] Cuts processed until now is 2150.
2022-06-06 16:36:14,802 INFO [streaming_decode.py:537] Cuts processed until now is 2200.
2022-06-06 16:36:15,056 INFO [streaming_decode.py:537] Cuts processed until now is 2250.
2022-06-06 16:36:15,962 INFO [streaming_decode.py:537] Cuts processed until now is 2300.
2022-06-06 16:36:16,981 INFO [streaming_decode.py:537] Cuts processed until now is 2350.
2022-06-06 16:36:17,226 INFO [streaming_decode.py:537] Cuts processed until now is 2400.
2022-06-06 16:36:18,346 INFO [streaming_decode.py:537] Cuts processed until now is 2450.
2022-06-06 16:36:18,600 INFO [streaming_decode.py:537] Cuts processed until now is 2500.
2022-06-06 16:36:19,769 INFO [streaming_decode.py:537] Cuts processed until now is 2550.
2022-06-06 16:36:19,998 INFO [streaming_decode.py:537] Cuts processed until now is 2600.
2022-06-06 16:36:21,134 INFO [streaming_decode.py:537] Cuts processed until now is 2650.
2022-06-06 16:36:21,362 INFO [streaming_decode.py:537] Cuts processed until now is 2700.
2022-06-06 16:36:22,572 INFO [streaming_decode.py:537] Cuts processed until now is 2750.
2022-06-06 16:36:22,807 INFO [streaming_decode.py:537] Cuts processed until now is 2800.
2022-06-06 16:36:23,918 INFO [streaming_decode.py:537] Cuts processed until now is 2850.
2022-06-06 16:36:24,207 INFO [streaming_decode.py:537] Cuts processed until now is 2900.
2022-06-06 16:36:33,609 INFO [streaming_decode.py:575] The transcripts are stored in streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/recogs-test-other-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2.txt
2022-06-06 16:36:33,681 INFO [utils.py:405] [test-other-greedy_search] %WER 8.81% [4609 / 52343, 471 ins, 508 del, 3630 sub ]
2022-06-06 16:36:33,946 INFO [streaming_decode.py:588] Wrote detailed error stats to streaming_pruned_transducer_stateless4/exp/streaming/greedy_search/errs-test-other-greedy_search-epoch-29-avg-6-streaming-chunk-size-16-left-context-64-right-context-2.txt
2022-06-06 16:36:33,947 INFO [streaming_decode.py:605]
For test-other, WER of different settings are:
greedy_search 8.81 best for test-other
2022-06-06 16:36:33,947 INFO [streaming_decode.py:776] Done!
|