Habana
jwieczorekhabana commited on
Commit
6e1e0c0
1 Parent(s): 5184fd0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -15,13 +15,12 @@ This model only contains the `GaudiConfig` file for running the [Swin Transforme
15
  This enables to specify:
16
  - `use_fused_adam`: whether to use Habana's custom AdamW implementation
17
  - `use_fused_clip_norm`: whether to use Habana's fused gradient norm clipping operator
18
- - `disable_autocast`: whether to disable autocast; this parameter takes precedence over --bf16 flag and is temporary as some scripts produce nan values.
19
- In those cases this parameter is already present in huggingface topology Habana gaudi_config.json.
20
 
21
  ## Usage
22
 
23
  The model is instantiated the same way as in the Transformers library.
24
- The only difference is that there are a few new training arguments specific to HPUs.
25
  This model is supported only in mixed precision training with bf16 type.
26
 
27
  [Here](https://github.com/huggingface/optimum-habana/blob/main/examples/image-classification/run_image_classification.py) is an image classification example script to fine-tune a model. You can run it with Swin with the following command:
 
15
  This enables to specify:
16
  - `use_fused_adam`: whether to use Habana's custom AdamW implementation
17
  - `use_fused_clip_norm`: whether to use Habana's fused gradient norm clipping operator
18
+ - `use_torch_autocast`: whether to use Torch Autocast for managing mixed precision
 
19
 
20
  ## Usage
21
 
22
  The model is instantiated the same way as in the Transformers library.
23
+ The only difference is that there are a few new training arguments specific to HPUs.\
24
  This model is supported only in mixed precision training with bf16 type.
25
 
26
  [Here](https://github.com/huggingface/optimum-habana/blob/main/examples/image-classification/run_image_classification.py) is an image classification example script to fine-tune a model. You can run it with Swin with the following command: