Data Analysis and Knowledge Discovery  2021, Vol. 5 Issue (8): 113-121    DOI: 10.11925/infotech.2096-3467.2020.1193
 Current Issue | Archive | Adv Search |
Automatic Scoring for Subjective Questions in Maritime Competency Assessment
Han Hui(),Liu Xiuwen
Navigation College, Dalian Maritime University, Dalian 116000, China
 Download: PDF (1054 KB)   HTML ( 3 )  Export: BibTeX | EndNote (RIS)
Abstract

[Objective] This paper builds an automatic scoring system for subjective questions in the maritime competency assessment, aiming to reduce the heavy workload and human factors of subjective question scoring. [Methods] Firstly, we used the weighted TextRank algorithm of dependency syntax analysis to extract keywords. Then, we integrated sentence vectors, core words, syntactic components, and dependent structures to judge the similarity between student answers and the standard ones. Third, we constructed a set of special negative words for maritime affairs to judge the semantic opposition between the student’s answer and the standard answer. Finally, we gave each answer an objective score. [Results] We examined our method with multiple sets of different subjective questions, and found the average score difference between the automatic score and the manual scoring was 0.21, with a deviation rate of 4.20%. [Limitations] More research is needed to improve the processing of long and complex sentences. [Conclusions] The proposed algorithm could effectively evaluate subjective questions in the maritime competency assessment.

Received: 30 November 2020      Published: 15 September 2021
 ZTFLH: TP391
Fund:Ministry of Industry and Information Technology([2018]No.473);Fundamental Research Funds for the Central Universities(3132019312)
Corresponding Authors: Han Hui ORCID：0000-0002-3053-0614     E-mail: hanh1201@126.com