[目的/意义]文章旨在探讨ChatGPT用于论文创新性评价的效果与可行性,如果以ChatGPT为代表的生成
式人工智能可以用于论文创新性评价,将能够有效提高创新评价效率。[方法/过程]通过模拟真实的论文创新性
评价需求和应用场景,选择生命科学、细胞免疫、市场营销、经济学、人工智能、信息资源管理6个研究领域完成超
24轮论文创新性评价实验。采用内容分析法,深入分析ChatGPT在论文创新性评价过程中生成的文中本材料,对
其创新评价过程、标准与可行性进行研究。[结果/结论]研究发现,ChatGPT在论文创新性评价任务展现出良好性
能,评价方法与标准均表现出较高的综合性与科学性,能够较好地完成多学科领域的论文创新性评价。现阶段,
ChatGPT用于论文创新性评价的稳定性、准确性与真实性稍显不足,可在相关任务中将其视为高效的论文创新性
评价辅助工具。随着提示工程的发展、互联网访问权限的开启、学术数据库的开放获取,ChatGPT用于论文创新
性评价的不足预计会被逐渐弥补。
[Purpose/significance] This study aims to explore the effectiveness and feasibility of using ChatGPT for
evaluating the innovativeness of academic papers. If generative artificial intelligence, represented by ChatGPT, can be
employed for paper innovativeness assessment, it has the potential to significantly improve the efficiency of innovative?
ness evaluation. [Method/process] By simulating real-world demands and application scenarios for evaluating paper
innovativeness, we conducted over 24 rounds of innovativeness evaluation experiments across six research domains:
life sciences, cellular immunology, marketing, economics, artificial intelligence, and information resource management.
Content analysis was employed to thoroughly examine the text generated by ChatGPT during the process of evaluating
paper innovativeness, enabling us to study its approach, criteria, and feasibility. [Result/conclusion] The study re?
vealed that ChatGPT demonstrated excellent performance in the task of evaluating paper innovativeness, displaying
high comprehensiveness and scientific rigor in its evaluation methods and criteria. It effectively accomplished paper in?
novativeness evaluations across these research fields. At present, while ChatGPT's stability, accuracy, and authenticity
may have some minor limitations, it can still be considered an efficient auxiliary tool for evaluating paper innovative?
ness in relevant tasks. The identified shortcomings of using ChatGPT for paper innovativeness evaluation are likely to
be gradually addressed with the advancement of prompt engineering, opening up of Internet access, and increased avail?
ability of academic databases.