Model-SafeTensors
/

trurl-2-7b

Text Generation

Model card Files Files and versions

AgaMiko commited on Sep 18, 2023

Commit

a1eeec4

·

1 Parent(s): bbaa539

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -36,8 +36,9 @@ This is the repository for the 7b fine-tuned model, optimized for dialogue use c
 ||Training Data|Params|Content Length|Num. Samples|Num. Tokens|start LR|
 |---|---|---|---|---|---|---|
-|Trurl 2|*A new mix of private and publicly available online data*|7B|4k|970k|1.7b|2.0 x 10<sup>-5</sup>|
-|Trurl 2|*A new mix of private and publicly available online data*|13B|4k|970k|1.7b|2.0 x 10<sup>-5</sup>|
 ## Training data

 ||Training Data|Params|Content Length|Num. Samples|Num. Tokens|start LR|
 |---|---|---|---|---|---|---|
+|Trurl 2|*A new mix of private and publicly available online data without MMLU*|7B|4k|855k|1.19b|2.0 x 10<sup>-5</sup>|
+|Trurl 2|*A new mix of private and publicly available online data with MMLU*|13B|4k|970k|1.7b|2.0 x 10<sup>-5</sup>|
+|Trurl 2 Academic|*A new mix of private and publicly available online data without MMLU*|13B|4k|855k|1.19b|2.0 x 10<sup>-5</sup>|
 ## Training data