TY -非盟的太阳,香港非盟- Depraetere,克里斯托夫盟——Meesseman Laurent AU - Cabanillas席尔瓦,帕特丽夏盟,Szymanowsky拉尔夫盟——Fliegenschmidt詹尼斯盟——Hulde尼古拉盟——冯Dossow维拉AU - Vanbiervliet,卡坦AU - De Baerdemaeker乔斯盟——Roccaro-Waldmeyer戴安娜M盟——斯蒂格·Jorg AU -多明格斯伊达尔戈,Manuel盟——Dahlweid Fried-Michael PY - 2022 DA - 2022/6/7 TI -基于机器学习预测模型对不同临床风险在不同的医院:实时性能评估JO - J Med Internet Res SP - e34295 VL - 24 IS - 6kw -机器学习KW -临床风险预测KW -预测KW -模型KW -模型评估KW -可扩展性KW -风险KW -现场临床工作流程KW -谵妄KW -败血症KW -急性肾损伤KW -肾脏KW - EHR KW -电子健康记录KW -工作流KW -算法AB -背景:机器学习算法目前被广泛应用于临床领域，以生成可以预测临床风险事件的模型。大多数模型是用回顾性数据开发和评估的，很少有模型是在临床工作流程中评估的，更少的是报告不同医院的表现。在这项研究中，我们为三家不同医院的三种不同用例提供了临床风险预测模型在现场临床工作流程中的详细评估。目的:本研究的主要目的是评估真实临床工作流程中的临床风险预测模型，并将其在这些设置中的表现与使用回顾性数据时的表现进行比较。我们还通过将我们的调查应用于三家不同医院的三个不同用例来概括结果。方法:我们利用回顾性数据，针对三家不同医院的三种用例(即谵妄、败血症和急性肾损伤)训练临床风险预测模型。我们使用机器学习，特别是深度学习来训练基于Transformer模型的模型。使用所有医院和用例通用的校准工具对模型进行了训练。 The models had a common design but were calibrated using each hospital’s specific data. The models were deployed in these three hospitals and used in daily clinical practice. The predictions made by these models were logged and correlated with the diagnosis at discharge. We compared their performance with evaluations on retrospective data and conducted cross-hospital evaluations. Results: The performance of the prediction models with data from live clinical workflows was similar to the performance with retrospective data. The average value of the area under the receiver operating characteristic curve (AUROC) decreased slightly by 0.6 percentage points (from 94.8% to 94.2% at discharge). The cross-hospital evaluations exhibited severely reduced performance: the average AUROC decreased by 8 percentage points (from 94.2% to 86.3% at discharge), which indicates the importance of model calibration with data from the deployment hospital. Conclusions: Calibrating the prediction model with data from different deployment hospitals led to good performance in live settings. The performance degradation in the cross-hospital evaluation identified limitations in developing a generic model for different hospitals. Designing a generic process for model development to generate specialized prediction models for each hospital guarantees model performance in different hospitals. SN - 1438-8871 UR - //www.mybigtv.com/2022/6/e34295 UR - https://doi.org/10.2196/34295 UR - http://www.ncbi.nlm.nih.gov/pubmed/35502887 DO - 10.2196/34295 ID - info:doi/10.2196/34295 ER -