%0期刊文章%@ 1438- 8871% I JMIR Publica卡塔尔世界杯8强波胆分析tions Inc. %V 17% N 6% P e135% T HONcode网站符合性自动检测与手动检测相比:An Evaluation %A Boyer,Célia %A Dolamic,Ljiljana %+ HealthOnNet Foundation, 2 Chemin du Petit Bel-Air, Chêne-Bourg, 1225，瑞士，41 793092960,Celia.Boyer@HealthOnNet.org %K HONcode %K分类%K人工智能%K自然语言处理%K质量标准%D 2015 %7 02.06.2015 %9原始论文%J J Med Internet Res %G英文%X背景:要获得HONcode认证，网站必须符合HONcode的8项原则。在目前的手动认证过程中，HONcode专家会根据每项原则的精确指导方针对候选网站进行评估。在欧洲项目KHRESMOI的范围内，网络健康(HON)基金会开发了一个自动化系统，以协助检测网站的HONcode符合性。执行HONcode审查的自动化协助可以加快当前耗时的HONcode认证和持续监督任务。此外，作为通用搜索引擎插件使用的自动化工具可能有助于检测遵守HONcode原则但尚未获得认证的健康网站。目的:本研究的目标是确定自动化系统是否能够像人类专家一样完成在健康网站上识别HONcode原则的任务。方法:本研究以HONcode高级专家的人工评价为基准，比较HONcode自动检测系统与HONcode高级专家的能力。由资深HONcode专家手动评估了27个与健康相关的网站是否符合8项HONcode原则。基于监督机器学习的HONcode合规性检测的自动化系统处理了同一组网站。 The results obtained by these two methods were then compared. Results: For the privacy criterion, the automated system obtained the same results as the human expert for 17 of 27 sites (14 true positives and 3 true negatives) without noise (0 false positives). The remaining 10 false negative instances for the privacy criterion represented tolerable behavior because it is important that all automatically detected principle conformities are accurate (ie, specificity [100%] is preferred over sensitivity [58%] for the privacy criterion). In addition, the automated system had precision of at least 75%, with a recall of more than 50% for contact details (100% precision, 69% recall), authority (85% precision, 52% recall), and reference (75% precision, 56% recall). The results also revealed issues for some criteria such as date. Changing the “document” definition (ie, using the sentence instead of whole document as a unit of classification) within the automated system resolved some but not all of them. Conclusions: Study results indicate concordance between automated and expert manual compliance detection for authority, privacy, reference, and contact details. Results also indicate that using the same general parameters for automated detection of each criterion produces suboptimal results. Future work to configure optimal system parameters for each HONcode principle would improve results. The potential utility of integrating automated detection of HONcode conformity into future search engines is also discussed. %M 26036669 %R 10.2196/jmir.3831 %U //www.mybigtv.com/2015/6/e135/ %U https://doi.org/10.2196/jmir.3831 %U http://www.ncbi.nlm.nih.gov/pubmed/26036669