Spaces:
Runtime error
Runtime error
### 2023 幎 10 æ 6 æ¥æŽæ° | |
ãªã¢ã«ã¿ã€ã 声å€æã®ããã®ã€ã³ã¿ãŒãã§ãŒã¹ go-realtime-gui.bat/gui_v1.py ãäœæããŸããïŒå®éã«ã¯æ¢ã«ååšããŠããŸããïŒãä»åã®ã¢ããããŒãã§ã¯ããªã¢ã«ã¿ã€ã 声å€æã®ããã©ãŒãã³ã¹ãéç¹çã«æé©åããŸããã0813 çãšã®æ¯èŒïŒ | |
- 1. ã€ã³ã¿ãŒãã§ãŒã¹æäœã®æé©åïŒãã©ã¡ãŒã¿ã®ãããæŽæ°ïŒãã©ã¡ãŒã¿èª¿æŽæã«äžæããŠåèµ·åããå¿ èŠããªãïŒãã¬ã€ãžãŒããŒãã¢ãã«ïŒæ¢ã«ããŒããããã¢ãã«ã¯åããŒãããå¿ èŠããªãïŒãé³éå åãã©ã¡ãŒã¿è¿œå ïŒé³éãå ¥åãªãŒãã£ãªã«è¿ã¥ããïŒ | |
- 2. å èµãã€ãºãªãã¯ã·ã§ã³å¹æãšé床ã®æé©å | |
- 3. æšè«é床ã®å€§å¹ ãªæé©å | |
å ¥åºåããã€ã¹ã¯åãã¿ã€ããéžæããå¿ èŠããããŸããäŸãã°ãäž¡æ¹ãšã MME ã¿ã€ããéžæããŸãã | |
1006 ããŒãžã§ã³ã®å šäœçãªæŽæ°ã¯ïŒ | |
- 1. rmvpe é³å£°ãããæœåºã¢ã«ãŽãªãºã ã®å¹æãããã«åäžãç¹ã«ç·æ§ã®äœé³éšåã§å€§ããªæ¹å | |
- 2. æšè«ã€ã³ã¿ãŒãã§ãŒã¹ã¬ã€ã¢ãŠãã®æé©å | |
### 2023 幎 8 æ 13 æ¥æŽæ° | |
1-éåžžã®ãã°ä¿®æ£ | |
- ä¿åé »åºŠãšç·ã©ãŠã³ãæ°ã®æå°å€ã 1 ã«å€æŽãç·ã©ãŠã³ãæ°ã®æå°å€ã 2 ã«å€æŽ | |
- pretrain ã¢ãã«ãªãã§ã®ãã¬ãŒãã³ã°ãšã©ãŒãä¿®æ£ | |
- 䌎å¥ãšããŒã«ã«ã®åé¢å®äºåŸã® VRAM ã¯ãªã¢ | |
- faiss ä¿åãã¹ã絶察ãã¹ããçžå¯Ÿãã¹ã«å€æŽ | |
- ãã¹ã«ç©ºçœãå«ãŸããå Žåã®ãµããŒãïŒãã¬ãŒãã³ã°ã»ããã®ãã¹+å®éšåããµããŒãããããšã©ãŒã«ãªããªãïŒ | |
- filelist ã®åŒ·å¶ç㪠utf8 ãšã³ã³ãŒãã£ã³ã°ããã£ã³ã»ã« | |
- ãªã¢ã«ã¿ã€ã 声å€æäžã«ã€ã³ããã¯ã¹ãæå¹ã«ããããšã«ãã CPU ã®å€§å¹ ãªäœ¿çšåé¡ã解決 | |
2-éèŠãªã¢ããããŒã | |
- çŸåšæã匷åãªãªãŒãã³ãœãŒã¹ã®äººéã®å£°ã®ãããæœåºã¢ãã« RMVPE ããã¬ãŒãã³ã°ããRVC ã®ãã¬ãŒãã³ã°ããªãã©ã€ã³/ãªã¢ã«ã¿ã€ã æšè«ã«äœ¿çšãpytorch/onnx/DirectML ããµããŒã | |
- pytorch-dml ãéã㊠A ã«ãŒããš I ã«ãŒãã®ãµããŒã | |
ïŒ1ïŒãªã¢ã«ã¿ã€ã 声å€æïŒ2ïŒæšè«ïŒ3ïŒããŒã«ã«ãšäŒŽå¥ã®åé¢ïŒ4ïŒãã¬ãŒãã³ã°ã¯ãŸã ãµããŒããããŠããããCPU ã§ã®ãã¬ãŒãã³ã°ã«åãæ¿ãããŸããonnx_dml ãéã㊠rmvpe_gpu ã®æšè«ããµããŒã | |
### 2023 幎 6 æ 18 æ¥æŽæ° | |
- v2 ã« 32k ãš 48k ã® 2 ã€ã®æ°ããäºåãã¬ãŒãã³ã°ã¢ãã«ãè¿œå | |
- é f0 ã¢ãã«ã®æšè«ãšã©ãŒãä¿®æ£ | |
- 1 æéãè¶ ãããã¬ãŒãã³ã°ã»ããã®ã€ã³ããã¯ã¹æ§ç¯ãã§ãŒãºã§ã¯ãèªåçã« kmeans ã§ç¹åŸŽãçž®å°ããã€ã³ããã¯ã¹ã®ãã¬ãŒãã³ã°ãå éããæ€çŽ¢ã«è¿œå | |
- 人éã®å£°ãã®ã¿ãŒã«å€æããããã¡ãã®ãªããžããªãæ·»ä» | |
- ããŒã¿åŠçã§ç°åžžå€ã¹ã©ã€ã¹ãé€å€ | |
- onnx ãšã¯ã¹ããŒããªãã·ã§ã³ã¿ã | |
倱æããå®éšïŒ | |
- ~~ç¹åŸŽæ€çŽ¢ã«æé次å ãè¿œå ïŒãã¡ãå¹æããªã~~ | |
- ~~ç¹åŸŽæ€çŽ¢ã« PCAR 次å åæžãªãã·ã§ã³ãè¿œå ïŒãã¡ã倧ããªããŒã¿ã¯ kmeans ã§ããŒã¿éãæžãããå°ããããŒã¿ã¯æ¬¡å åæžã®æéãç¯çŽãããããã³ã°ã®æéãããé·ã~~ | |
- ~~onnx æšè«ã®ãµããŒãïŒæšè«ã®ã¿ã®å°ããªå§çž®ããã±ãŒãžä»ãïŒïŒãã¡ãnsf ã®çæã«ã¯ pytorch ãå¿ èŠ~~ | |
- ~~ãã¬ãŒãã³ã°äžã«é³å£°ããžã§ã³ããŒãeqããã€ãºãªã©ã§å ¥åãã©ã³ãã ã«å¢åŒ·ïŒãã¡ãå¹æããªã~~ | |
- ~~å°å声ç åšã®æ¥ç¶èª¿æ»ïŒãã¡ãå¹æãæªå~~ | |
todolistïŒ | |
- ~~ãã¬ãŒãã³ã°ã»ããã®é³å£°ãããèªèã« crepe ããµããŒãïŒæ¢ã« RMVPE ã«çœ®ãæããããŠããããäžèŠ~~ | |
- ~~å€ããã»ã¹ harvest æšè«ïŒæ¢ã« RMVPE ã«çœ®ãæããããŠããããäžèŠ~~ | |
- ~~crepe ã®ç²ŸåºŠãµããŒããš RVC-config ã®åæïŒæ¢ã« RMVPE ã«çœ®ãæããããŠããããäžèŠãããããµããŒãããã«ã¯ torchcrepe ã©ã€ãã©ãªãåæããå¿ èŠããããé¢å~~ | |
- F0 ãšãã£ã¿ãšã®é£æº | |
### 2023 幎 5 æ 28 æ¥æŽæ° | |
- v2 ã® jupyter notebook ãè¿œå ãéåœèªã® changelog ãè¿œå ãããã€ãã®ç°å¢äŸåé¢ä¿ãè¿œå | |
- åŒåžãæž èŸ é³ãæ¯é³ã®ä¿è·ã¢ãŒããè¿œå | |
- crepe-full æšè«ããµããŒã | |
- UVR5 人éã®å£°ãšäŒŽå¥ã®åé¢ã« 3 ã€ã®é 延é€å»ã¢ãã«ãš MDX-Net ã®æ··åé€å»ã¢ãã«ãè¿œå ãHP3 人声æœåºã¢ãã«ãè¿œå | |
- ã€ã³ããã¯ã¹åã«ããŒãžã§ã³ãšå®éšåãè¿œå | |
- 人éã®å£°ãšäŒŽå¥ã®åé¢ãæšè«ã®ããããšã¯ã¹ããŒãã«ãªãŒãã£ãªãšã¯ã¹ããŒããã©ãŒããããªãã·ã§ã³ãè¿œå | |
- 32k ã¢ãã«ã®ãã¬ãŒãã³ã°ãå»æ¢ | |
### 2023 幎 5 æ 13 æ¥æŽæ° | |
- ã¯ã³ã¯ãªãã¯ããã±ãŒãžå ã®å€ãããŒãžã§ã³ã® runtime å ã® lib.infer_pack ãš uvr5_pack ã®æ®éªžãã¯ãªã¢ | |
- ãã¬ãŒãã³ã°ã»ããã®äºååŠçã®æ¬äŒŒãã«ãããã»ã¹ãã°ãä¿®æ£ | |
- harvest ã«ããé³å£°ãããèªèã§ç¡å£°é³çŸè±¡ã匱ããããã«äžéå€ãã£ã«ã¿ãŒãè¿œå ãäžéå€ãã£ã«ã¿ãŒã®ååŸã調æŽå¯èœ | |
- é³å£°ãšã¯ã¹ããŒãã«ãã¹ãããã»ã¹ãªãµã³ããªã³ã°ãè¿œå | |
- ãã¬ãŒãã³ã°æã® n_cpu ããã»ã¹æ°ããF0 æœåºã®ã¿èª¿æŽããããããŒã¿äºååŠçãš F0 æœåºã®èª¿æŽãã«å€æŽ | |
- logs ãã©ã«ãäžã® index ãã¹ãèªåæ€åºããããããããŠã³ãªã¹ãæ©èœãæäŸ | |
- ã¿ãããŒãžã«ããããã質åããè¿œå ïŒãŸã㯠github-rvc-wiki ãåç §ïŒ | |
- åããã¹ã®å ¥åé³å£°æšè«ã«é³å£°ããããã£ãã·ã¥ãè¿œå ïŒçšéïŒharvest é³å£°ãããæœåºã䜿çšãããšãå šäœã®ãã€ãã©ã€ã³ãé·ãç¹°ãè¿ãããé³å£°ãããæœåºããã»ã¹ãçµéšãããã£ãã·ã¥ã䜿çšããªãå Žåãç°ãªãé³è²ãã€ã³ããã¯ã¹ãé³å£°ãããäžéå€ãã£ã«ã¿ãŒååŸãã©ã¡ãŒã¿ãŒããã¹ããããŠãŒã¶ãŒã¯ãæåã®ãã¹ãåŸã®åŸ æ©çµæãéåžžã«èŠçã«ãªããŸãïŒ | |
### 2023 幎 5 æ 14 æ¥æŽæ° | |
- é³éãšã³ãããŒãã®ã¢ã©ã€ã¡ã³ãå ¥åããã¯ã¹ïŒãå ¥åãç¡é³ã§åºåãããããªãã€ãºãã®åé¡ãç·©åããããšãã§ããŸããå ¥åé³å£°ã®èæ¯ãã€ãºã倧ããå Žåã¯ããªã³ã«ããªãããšããå§ãããŸããããã©ã«ãã§ã¯ãªãïŒ1 ãšããŠæ±ãããïŒïŒ | |
- æå®ãããé »åºŠã§æœåºãããå°åã¢ãã«ãä¿åããæ©èœããµããŒãïŒç°ãªããšããã¯ã§ã®æšè«å¹æãè©Šããããããã¹ãŠã®å€§ããªãã§ãã¯ãã€ã³ããä¿åããŠæåã§å°åã¢ãã«ãæœåºããã®ãé¢åãªå Žåããã®æ©èœã¯éåžžã«äŸ¿å©ã§ãïŒ | |
- ã·ã¹ãã å šäœã®ãããã·ãéãããŠããå Žåã«ãã©ãŠã¶ã®æ¥ç¶ãšã©ãŒãçºçããåé¡ãç°å¢å€æ°ã®èšå®ã§è§£æ±º | |
- v2 äºåèšç·Žã¢ãã«ããµããŒãïŒçŸåšããã¹ãã®ããã« 40k ããŒãžã§ã³ã®ã¿ãå ¬éãããŠãããä»ã® 2 ã€ã®ãµã³ããªã³ã°ã¬ãŒãã¯ãŸã å®å šã«èšç·ŽãããŠããŸããïŒ | |
- æšè«åã« 1 ãè¶ ããé倧ãªé³éãå¶é | |
- ããŒã¿äºååŠçãã©ã¡ãŒã¿ãŒãåŸ®èª¿æŽ | |
### 2023 幎 4 æ 9 æ¥æŽæ° | |
- ãã¬ãŒãã³ã°ãã©ã¡ãŒã¿ãŒãä¿®æ£ããGPU ã®å¹³åå©çšçãåäžããããA100 ã¯æé« 25ïŒ ããçŽ 90ïŒ ã«ãV100 㯠50ïŒ ããçŽ 90ïŒ ã«ã2060S 㯠60ïŒ ããçŽ 85ïŒ ã«ãP40 㯠25ïŒ ããçŽ 95ïŒ ã«åäžãããã¬ãŒãã³ã°é床ãå€§å¹ ã«åäž | |
- ãã©ã¡ãŒã¿ãŒãä¿®æ£ïŒå šäœã® batch_size ãåã«ãŒãã® batch_size ã«å€æŽ | |
- total_epoch ãä¿®æ£ïŒæ倧å¶é 100 ãã 1000 ã«è§£é€; ããã©ã«ã 10 ããããã©ã«ã 20 ã«åŒãäžã | |
- ckpt æœåºæã«é³å£°ãããã®æç¡ã誀ã£ãŠèªèããæšè«ãç°åžžã«ãªãåé¡ãä¿®æ£ | |
- åæ£ãã¬ãŒãã³ã°ã§åã©ã³ã¯ã ckpt ã 1 åãã€ä¿åããåé¡ãä¿®æ£ | |
- ç¹åŸŽæœåºã§ nan ç¹åŸŽããã£ã«ã¿ãªã³ã° | |
- å ¥åãç¡é³ã§åºåãã©ã³ãã ãªåé³ãŸãã¯ãã€ãºã«ãªãåé¡ãä¿®æ£ïŒæ§ããŒãžã§ã³ã®ã¢ãã«ã¯ãã¬ãŒãã³ã°ã»ãããäœãçŽããŠåãã¬ãŒãã³ã°ããå¿ èŠããããŸãïŒ | |
### 2023 幎 4 æ 16 æ¥æŽæ° | |
- ããŒã«ã«ãªã¢ã«ã¿ã€ã é³å£°å€æãã GUI ãæ°èšãgo-realtime-gui.bat ãããã«ã¯ãªãã¯ã§èµ·å | |
- ãã¬ãŒãã³ã°ãšæšè«ã§ 50Hz 以äžã®åšæ³¢æ°åž¯ããã£ã«ã¿ãªã³ã° | |
- ãã¬ãŒãã³ã°ãšæšè«ã®é³å£°ãããæœåº pyworld ã®æäœé³å£°ããããããã©ã«ãã® 80 ãã 50 ã«äžãã50-80hz ã®ç·æ§äœé³å£°ãç¡å£°ã«ãªããªãããã« | |
- WebUI ãã·ã¹ãã ã®å°åã«åºã¥ããŠèšèªãå€æŽããæ©èœããµããŒãïŒçŸåšãµããŒããããŠããã®ã¯ en_USãja_JPãzh_CNãzh_HKãzh_SGãzh_TWããµããŒããããŠããªãå Žåã¯ããã©ã«ã㧠en_US ã«ãªããŸãïŒ | |
- äžéšã®ã°ã©ãã£ãã¯ã«ãŒãã®èªèãä¿®æ£ïŒäŸãã° V100-16G ã®èªè倱æãP4 ã®èªè倱æïŒ | |
### 2023 幎 4 æ 28 æ¥æŽæ° | |
- faiss ã€ã³ããã¯ã¹èšå®ãã¢ããã°ã¬ãŒãããé床ãéããå質ãé«ããªããŸãã | |
- total_npy äŸåããã£ã³ã»ã«ããä»åŸã®ã¢ãã«å ±æã§ã¯ total_npy ã®èšå ¥ã¯äžèŠ | |
- 16 ã·ãªãŒãºã®å¶éã解é€ã4G ã¡ã¢ãª GPU ã« 4G ã®æšè«èšå®ãæäŸ | |
- äžéšã®ãªãŒãã£ãªåœ¢åŒã§ UVR5 ã®äººå£°äŒŽå¥åé¢ã®ãã°ãä¿®æ£ | |
- ãªã¢ã«ã¿ã€ã é³å£°å€æãã gui ã« 40k 以å€ã®ã¢ãã«ãšåŠ¥åã®ãªãé³å£°ãããã¢ãã«ã®ãµããŒããè¿œå | |
### ä»åŸã®èšç»ïŒ | |
æ©èœïŒ | |
- è€æ°äººã®ãã¬ãŒãã³ã°ã¿ãã®ãµããŒãïŒæ倧 4 äººïŒ | |
åºå±€ã¢ãã«ïŒ | |
- åŒåž wav ããã¬ãŒãã³ã°ã»ããã«è¿œå ããåŒåžãé³å£°å€æã®é»åé³ã®åé¡ãä¿®æ£ | |
- æ声ãã¬ãŒãã³ã°ã»ãããè¿œå ããåºå±€ã¢ãã«ããã¬ãŒãã³ã°ããŠãããå°æ¥çã«ã¯å ¬éããäºå®ã§ã | |