Current Issue
    , Volume 0 Issue 0 Previous Issue    Next Issue
    For Selected: View Abstracts Toggle Thumbnails
    The Inspiration Brought by ChatGPT to LLM and the New Development Ideas of Multi-modal Large Model
    Zhao Chaoyang,Zhu Guibo,Wang Jinqiao
    2023, 0 (0): 1-11.  DOI: 10.11925/infotech.2096-3467.0216
    Abstract   HTML ([an error occurred while processing this directive]

    [Objective] This paper analyzes the basic technical principles of ChatGPT, and discusses its influence on the development of large language model and the development of multi-modal pretrained model. [Methods] By analyzing the development process and technical principles of ChatGPT, this paper discusses the influence of model building methods such as instruct fine-tuning, data acquisition and annotation, and reinforcement learning based on human feedback on the large language model. At the same time, this paper analyzes several key scientific problems encountered in the construction of multi-modal model, and discusses the future development of multi-modal pretrained model by referring to ChatGPT’s technical scheme. [Conclusions] The success of ChatGPT provides a good reference technology path for the development of pretrained fundamental model to downstream tasks. In the future construction of multi-modal large model and the realization of downstream tasks, we can make full use of high-quality instruction fine-tuning and other technologies to significantly improve the performance of downstream tasks.

    Figures and Tables | References | Related Articles | Metrics
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938   E-mail:jishu@mail.las.ac.cn