initial tuned 4k context length model (#84)

- add 4k context length model (43013a8f5eccffac1f83ec7d00e94b9ecb218380)

Co-authored-by: Haiping Wu <haipingwu@users.noreply.huggingface.co>
This commit is contained in:
ai-modelscope
2024-12-09 20:15:35 +08:00
parent 41c72b788b
commit c7a3388824
3 changed files with 4 additions and 3 deletions

1
.gitattributes vendored
View File

@ -34,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
*bin filter=lfs diff=lfs merge=lfs -text
pytorch_model.bin filter=lfs diff=lfs merge=lfs -text

View File

@ -46,7 +46,7 @@
"LABEL_1": 1,
"LABEL_2": 2
},
"max_position_embeddings": 1024,
"max_position_embeddings": 4096,
"no_repeat_ngram_size": 3,
"normalize_before": false,
"num_hidden_layers": 12,

BIN
pytorch_model.bin (Stored with Git LFS)

Binary file not shown.