Ziya-LLaMA-13B-v1.1

• Main Page:Fengshenbang
• Github: Fengshenbang-LM

姜子牙系列模型

• Ziya-LLaMA-13B-v1.1
• Ziya-LLaMA-13B-v1
• Ziya-LLaMA-7B-Reward
• Ziya-LLaMA-13B-Pretrain-v1
• Ziya-BLIP2-14B-Visual-v1

簡(jiǎn)介 Brief Introduction

我們對(duì)Ziya-LLaMA-13B-v1模型進(jìn)行繼續(xù)優(yōu)化，推出開源版本Ziya-LLaMA-13B-v1.1。通過(guò)調(diào)整微調(diào)數(shù)據(jù)的比例和采用更優(yōu)的強(qiáng)化學(xué)習(xí)策略，本版本在問(wèn)答準(zhǔn)確性、數(shù)學(xué)能力以及安全性等方面得到了提升，詳細(xì)能力分析如下圖所示。

We have further optimized the Ziya-LLaMA-13B-v1 model and released the open-source version Ziya-LLaMA-13B-v1.1. By adjusting the proportion of fine-tuning data and adopting a better reinforcement learning strategy, this version has achieved improvements in question-answering accuracy, mathematical ability, and safety, as shown in the following figure in detail.

軟件依賴

pip install torch==1.12.1 tokenizers==0.13.3 git+https://github.com/huggingface/transformers

使用 Usage

from modelscope.utils.constant import Tasks
from modelscope.pipelines import pipeline
pipe = pipeline(task=Tasks.text_generation, model='Fengshenbang/Ziya-LLaMA-13B-v1.1', model_revision='v1.0.2', device='cuda')
query="幫我寫一份去西安的旅游計(jì)劃"
inputs = '<human>:' + query.strip() + '\n<bot>:'
result = pipe(inputs)
print(result)

引用 Citation

如果您在您的工作中使用了我們的模型，可以引用我們的論文：

If you are using the resource for your work, please cite the our paper:

@article{fengshenbang,
  author    = {Jiaxing Zhang and Ruyi Gan and Junjie Wang and Yuxiang Zhang and Lin Zhang and Ping Yang and Xinyu Gao and Ziwei Wu and Xiaoqun Dong and Junqing He and Jianheng Zhuo and Qi Yang and Yongfeng Huang and Xiayu Li and Yanghan Wu and Junyu Lu and Xinyu Zhu and Weifeng Chen and Ting Han and Kunhao Pan and Rui Wang and Hao Wang and Xiaojun Wu and Zhongshen Zeng and Chongpei Chen},
  title     = {Fengshenbang 1.0: Being the Foundation of Chinese Cognitive Intelligence},
  journal   = {CoRR},
  volume    = {abs/2209.02970},
  year      = {2022}
}

You can also cite our website:

歡迎引用我們的網(wǎng)站:

@misc{Fengshenbang-LM,
  title={Fengshenbang-LM},
  author={IDEA-CCNL},
  year={2021},
  howpublished={\url{https://github.com/IDEA-CCNL/Fengshenbang-LM}},
}