maulairfani commited on
Commit
3f7aa21
1 Parent(s): 9b9551c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -52
README.md CHANGED
@@ -1,61 +1,24 @@
1
- ---
2
- license: mit
3
- base_model: indobenchmark/indobert-large-p2
4
- tags:
5
- - generated_from_trainer
6
- model-index:
7
- - name: Indonesian-LegalBERT-lite
8
- results: []
9
- ---
10
 
11
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
- should probably proofread and complete it, then remove this comment. -->
13
 
14
- # Indonesian-LegalBERT-lite
15
 
16
- This model is a fine-tuned version of [indobenchmark/indobert-large-p2](https://huggingface.co/indobenchmark/indobert-large-p2) on an unknown dataset.
17
- It achieves the following results on the evaluation set:
18
- - Loss: 1.4760
19
 
20
- ## Model description
21
 
22
- More information needed
23
 
24
- ## Intended uses & limitations
 
25
 
26
- More information needed
 
 
 
 
 
27
 
28
- ## Training and evaluation data
29
 
30
- More information needed
31
-
32
- ## Training procedure
33
-
34
- ### Training hyperparameters
35
-
36
- The following hyperparameters were used during training:
37
- - learning_rate: 2e-05
38
- - train_batch_size: 128
39
- - eval_batch_size: 128
40
- - seed: 42
41
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
- - lr_scheduler_type: linear
43
- - num_epochs: 5
44
-
45
- ### Training results
46
-
47
- | Training Loss | Epoch | Step | Validation Loss |
48
- |:-------------:|:-----:|:-----:|:---------------:|
49
- | 2.4828 | 1.0 | 2266 | 1.7891 |
50
- | 1.6374 | 2.0 | 4532 | 1.6163 |
51
- | 1.499 | 3.0 | 6798 | 1.5313 |
52
- | 1.4269 | 4.0 | 9064 | 1.4926 |
53
- | 1.3913 | 5.0 | 11330 | 1.4768 |
54
-
55
-
56
- ### Framework versions
57
-
58
- - Transformers 4.31.0
59
- - Pytorch 2.0.1+cu118
60
- - Datasets 2.14.0
61
- - Tokenizers 0.13.3
 
1
+ # Model Card for Indo-LegalBERT
 
 
 
 
 
 
 
 
2
 
3
+ <!-- Provide a quick summary of what the model is/does. [Optional] -->
4
+ Adaptasi IndoBERT pada korpus hukum sebesar 10.000 dokumen yang terdiri dari dokumen peraturan perundang-undangan Indonesia. Model ini memungkinkan penerapannya di berbagai downstream task di bidang hukum seperti klasifikasi dokumen hukum, menemukenali ketidakselarasan peraturan perundang-undangan, dan masih banyak lagi!
5
 
 
6
 
 
 
 
7
 
8
+ # Model Details
9
 
10
+ ## Model Description
11
 
12
+ <!-- Provide a longer summary of what this model is/does. -->
13
+ Adaptasi IndoBERT pada korpus hukum sebesar 10.000 dokumen yang terdiri dari dokumen peraturan perundang-undangan Indonesia. Model ini memungkinkan penerapannya di berbagai downstream task di bidang hukum seperti klasifikasi dokumen hukum, menemukenali ketidakselarasan peraturan perundang-undangan, dan masih banyak lagi!
14
 
15
+ - **Developed by:** Maula Irfani, Netri Alia Rahmi, Edric Boby Tri Raharjo
16
+ - **Model type:** Language model
17
+ - **Language(s) (NLP):** id
18
+ - **License:** mit
19
+ - **Parent Model:** More information needed
20
+ - **Resources for more information:** More information needed
21
 
22
+ # How to Get Started with the Model
23
 
24
+ Use the code below to get started with the model.