ai-models/Index-1.9B-32K
2
0
Fork 0
mirror of https://www.modelscope.cn/IndexTeam/Index-1.9B-32K.git synced 2026-04-02 22:02:52 +08:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
changyeyu
2024-09-10 08:54:54 +00:00
parent f48accdc42
commit f2193af184
1 changed files with 0 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
README.md
View File

@ -5,12 +5,7 @@
</div> </div>
<div style="text-align: center;">
[Switch to English](README.md) | [切换到中文](README_zh.md)
</div>
# Introduction
## Model Overview ## Model Overview
Index-1.9B-32K is a language model with only 1.9 billion parameters, yet it supports a context length of 32K (meaning this extremely small model can read documents of over 35,000 words in one go). The model has undergone Continue Pre-Training and Supervised Fine-Tuning (SFT) specifically for texts longer than 32K tokens, based on carefully curated long-text training data and self-built long-text instruction sets. The model is now open-source on both Hugging Face and ModelScope. Index-1.9B-32K is a language model with only 1.9 billion parameters, yet it supports a context length of 32K (meaning this extremely small model can read documents of over 35,000 words in one go). The model has undergone Continue Pre-Training and Supervised Fine-Tuning (SFT) specifically for texts longer than 32K tokens, based on carefully curated long-text training data and self-built long-text instruction sets. The model is now open-source on both Hugging Face and ModelScope.