robvanderg commited on
Commit
2e54511
1 Parent(s): 142ad0f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -20,4 +20,6 @@ tte = baseEmbeddings.embeddings.token_type_embeddings.weight.clone().detach()
20
  baseEmbeddings.embeddings.token_type_embeddings.weight[0,:] = tte[1,:]
21
  ```
22
 
23
- More details and other varieties can be found in the repo: https://bitbucket.org/robvanderg/segmentembeds/
 
 
 
20
  baseEmbeddings.embeddings.token_type_embeddings.weight[0,:] = tte[1,:]
21
  ```
22
 
23
+ More details and other varieties can be found in the repo: https://bitbucket.org/robvanderg/segmentembeds/
24
+
25
+ Note that when using this model on a single sentence task (or word-level task), the results would be similar as just using `token_type_id=1` for all tokens.