PMAlpha

Sleeping

Sergidev commited on Jul 18

Commit

0c6d9a6

•

1 Parent(s): c19f609

Update modules/pmbl.py

Files changed (1) hide show

modules/pmbl.py CHANGED Viewed

@@ -110,8 +110,8 @@ class PMBL:
             temperature=0.7,
             stop=["</s>", "\nUser:", "\nuser:", "\nSystem:", "\nsystem:"],
             echo=False,
-            stream=True
-            use_flash_attn=True
             mlock=True,
         )

             temperature=0.7,
             stop=["</s>", "\nUser:", "\nuser:", "\nSystem:", "\nsystem:"],
             echo=False,
+            stream=True,
+            use_flash_attn=True,
             mlock=True,
         )