Assessment of the generalization abilities of machine-learning scoring functions for structure-based virtual screening

04 August 2022, Version 3
This content is a preprint and has not undergone peer review at the time of posting.

Abstract

In structure-based virtual screening (SBVS), it is critical that scoring functions capture protein-ligand atomic interactions. By focusing on the local domains of ligand binding pockets, a standardized pocket Pfam-based clustering (Pfam-cluster) approach was developed to assess the cross-target generalization ability of machine-learning scoring functions (MLSFs). Subsequently, 11 typical MLSFs were evaluated using random cross-validation (Random-CV), protein sequence similarity-based cross-validation (Seq-CV), and pocket Pfam-based cross-validation (Pfam-CV) methods. Surprisingly, all of the tested models showed decreased performances from Random-CV to Seq-CV to Pfam-CV experiments, not showing satisfactory generalization capacity. Our interpretable analysis suggested that the predictions on novel targets by MLSFs were dependent on buried solvent-accessible surface area (SASA)-related features of complex structures, with larger predicted binding affinities on complexes owning larger protein-ligand interfaces. By combining buried SASA-related features with target-specific patterns that were only shared among structurally similar compounds in the same cluster, random forest (RF)-Score attained a good performance in Random-CV test. Based on these findings, we strongly advise to assess the generalization ability of MLSFs with Pfam-cluster approach and to be cautious with the features learned by MLSFs.

Keywords

structure-based virtual screening
machine-learning scoring function
PDBbind
generalization ability

Supplementary materials

Title
Description
Actions
Title
supplementary figures
Description
supplementary figures
Actions
Title
supplementary tables
Description
supplementary tables
Actions

Supplementary weblinks

Comments

Comments are not moderated before they are posted, but they can be removed by the site moderators if they are found to be in contravention of our Commenting Policy [opens in a new tab] - please read this policy before you post. Comments should be used for scholarly discussion of the content in question. You can find more information about how to use the commenting feature here [opens in a new tab] .
This site is protected by reCAPTCHA and the Google Privacy Policy [opens in a new tab] and Terms of Service [opens in a new tab] apply.