File size: 528 Bytes
328c85b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38

---

base_model: esm3-open 

library_name: esm3

---



# Model Card for Model-Demo-1.4B
<slot name='description'>

## Task type
Protein-level Classification

## Model input type
AA Sequence

## ESM3 Model config

- **base_model:** esm3-open
- **model_type:** ESM3 Fine-tuning
- **task_type:** Protein-level Classification

## Training config

- **optimizer:**
  - **class:** AdamW
  - **betas:** (0.9, 0.98)
  - **weight_decay:** 0.01
- **learning rate:** 0.0005
- **epoch:** 5
- **batch size:** 1
- **precision:** 16-mixed