Evidence-guided paper · 2012 · outside-scope · full-text
CPred: a web server for predicting viable circular permutations in proteins
Wei-Cheng Lo; Li-Fen Wang; Yen-Yi Liu; Tian Dai; Jenn-Kang Hwang; Ping-Chiang Lyu. CPred: a web server for predicting viable circular permutations in proteins. Nucleic Acids Research 40:W232–W237 (2012).
30-second read
CPred packages CP-site structural preferences into a service that proposes new termini and viability scores from an uploaded structure.
Central question
How can the preceding multifeature CP-viability predictor become a web service that responds in seconds, supports threshold interpretation, and exposes residue-level scores interactively?
Intuition
CPred acts like a risk heat map over a structure: compute 46 sequence/structure features per residue, run four predictors, average them into a 0–1 score, and distribute expensive features and the 500-tree random forest across processors.
Why it matters
A method creates experimental value only when it is deployed, interpreted, and used correctly. This paper adds inputs, parallel execution, caching, threshold precision/recall, interactive views, and runtime, turning the predictor into an actionable tool.
Prerequisites
- Understand circular-permutation viability and the preceding 46-feature ensemble.
- Know Z-score standardization and ensemble averaging.
- Distinguish a probability-like score, precision, recall, AUC, and calibration.
- Understand that distributed computation and caching change serving cost, not model ground truth.
paper-specific guide · plain → technical → input → output → source
Method walkthrough
-
01 · Extract 46 features from a PDB structure
Build a feature card for every residue covering local conformation, exposure, packing, core distance, and flexibility.
Technical reading: Sequence/secondary-structure propensities come from nrCPsitecpdb-40 and nrCPDB-40. After reduce restores hydrogens, closeness, RSA, centroid distance, WCN, farness, GNM fluctuation, and related measures are computed and transformed to Z-scores.
Input: A PDB ID, SCOP ID, or uploaded PDB file.
Output: A standardized 46-dimensional vector for every residue.
Boundary: A structure is required; missing residues, incorrect protonation, or an unrepresentative conformation affect features.
PDF pp. 2–3, Materials and Methods — Computation of feature values
-
02 · Average four models into the CPred score
ANN, SVM, RF, and hierarchical integration each cast a vote, and their average reduces dependence on one model.
Technical reading: A three-layer backpropagation ANN, LIBSVM, a 500-tree C4.5 random forest, and HI each output a [0,1] real score; the main program averages the four values and ranks residues.
Input: Forty-six-feature vectors and trained model parameters.
Output: An integrated CPred score for each residue.
Boundary: The authors call it a probability score for conceptual convenience; it is not a physically guaranteed success probability.
PDF p. 4, Application of machine learning methods
-
03 · Parallelize, cache, and serve interactive results
Distribute expensive feature/model work, then return a score list, profile, and rotatable structure.
Technical reading: The main process distributes feature tasks, launches four predictor threads, and integrates outputs. Features/results for PDB/SCOP ID queries can be cached. The interface provides a sortable list, Jmol structure, and downloadable text.
Input: A query, processor pool, and model outputs.
Output: Results sortable by residue, amino acid, or score, plus visualization.
Boundary: Distributed speedup does not change AUC, and cache-hit latency must not be reported as cold-run runtime.
PDF pp. 3–5, Figure 1, Speed evaluations and Web Server Description
Key result
It turns the methodological work into an actionable engineering interface, a key deployment step in the CP research line.
Evidence-guided deep reading
Paper facts, project readings, and teaching models are labelled separately.
paper-fact
The web server inherits its core model
The original model trains on Dataset T (76 viable/100 inviable) and reaches AUC 0.91 on independent DHFR (86/73). The deployed CPred server instead trains on combined T+DHFR and reports 10-fold-CV AUC 0.940, sensitivity 0.889, specificity 0.898, and MCC 0.787.
The combined-data Table 1 result is cross-validation rather than a DHFR holdout. nrCPDB-40/nrGIS-40 remain low-redundancy external positive sets, with sensitivities 0.746/0.719.
Source locator: PDF pp. 2–4, Experimental data sets and Table 1
paper-fact
The threshold is an experimental-cost control
In 10-fold CV over T+DHFR, Table 2 shows score ≥0.85 gives PPF 0.16, recall 0.33, and precision 1.00, while score ≥0.50 gives PPF 0.54, recall 0.92, and precision 0.82. Raising the threshold reduces experiments and improves observed precision but misses more viable sites.
These precision values belong to this dataset and its CV folds. They are not guaranteed to remain 1.00 under another protein family, viable-site prevalence, or experimental definition.
Source locator: PDF p. 4, Table 2 and information-retrieval evaluation
project-reading
Report serving and scientific performance separately
AUC/MCC describe model discrimination, whereas seconds describe implementation latency. Parallelization reduces average runtime to <3.4 seconds for 150–200-residue proteins and <22 seconds around 600 residues, but does not make predictions more accurate.
A complete model card should list data lineage, CV/holdout status, threshold table, cold-run hardware, and missing-structure policy so a polished UI does not conceal evidence boundaries.
Source locator: PDF pp. 4–5, Tables 1–2 and Speed evaluations
Study design and evaluation
Data and samples
Dataset T (76/100) and DHFR (86/73) are combined for training/10-fold CV. nrCPDB-40 (1,059 proteins) and nrGIS-40 (2,814 proteins) provide large-scale positive evaluation, while nrCPsitecpdb-40 supplies 1,087 nonredundant CP sites for propensity features.
Baselines
- A closeness-only predictor; the non-distributed implementation additionally serves as the runtime baseline.
Metrics
- AUC / sensitivity / specificity / MCC
- Evaluate discrimination and binary decisions in cross-validation with positives and negatives.
Boundary: After combining T+DHFR, this is not an independent holdout and may shift across families. - Precision / recall / PPF by score
- Describe experimental volume, recovery, and hit fraction at different operating thresholds.
Boundary: Precision changes with prevalence and cannot be copied directly across deployments. - Cold-run wall-clock time
- Average runtime by protein length on two 3.33-GHz octa-core Xeons with 128 GB RAM.
Boundary: Hardware and cache state must accompany it; it is not model quality.
Reported result
The deployed server model reports 10-fold-CV AUC 0.940 and MCC 0.787 versus 0.753/0.428 for closeness. A score ≥0.85 gives precision 1.00 and recall 0.33 in that CV set. The distributed implementation averages <3.4 seconds for 150–200 residues and <22 seconds around 600 residues.
PDF pp. 4–5, Tables 1–2 and Speed evaluations
teaching-model · not a reported experiment
Teaching example (not a reported experiment)
Choose a threshold from the wet-lab budget
Project teaching model: in a 200-residue protein, 32 residues score ≥0.85 and 108 score ≥0.50; the lab can build at most 20 constructs.
- Do not blindly use 0.5; first select top-ranked candidates under the 20-construct budget.
- Stratify by score band, secondary structure, and active-site distance so all 20 do not come from one local region.
- Reserve two or three low-score controls and re-estimate precision/recall and calibration after deployment rather than reusing Table 2.
Takeaway: The threshold should be set by costs and validation data in the new domain; the paper's table is a prior, not a warranty.
outside-scope
Evidence boundary versus FAST
CPred ranks breakpoints rather than structural alignments.
Lawful source and access
6 pages · SHA-256 7f45c9dd00376ffd03c6748b48b6694c18fae7d5919223d92a190219716b0e29
Lawful open full text.
Limits and misreadings
- Prediction narrows experiments but cannot replace folding and functional assays.
Source locator map
- PDF pp. 2–3, Experimental data sets and Computation of feature values
- PDF p. 3, Figure 1
- PDF p. 4, Application of machine learning methods
- PDF pp. 4–5, Tables 1–2
- PDF p. 5, Speed evaluations and Web Server Description
Check understanding
Why is CPred Table 1 not an independent DHFR test?
Answer: The server model combines Dataset T and DHFR for training and Table 1 uses 10-fold CV.
When data lineage changes, the evaluation label must change too.
Can precision 1.00 at score ≥0.85 be extrapolated?
Answer: No guarantee; it belongs to the T+DHFR CV composition.
Precision depends on prevalence and distribution shift.
Which quantity does parallelization change?
Answer: It mainly changes wall-clock runtime/throughput, not the fixed model's AUC.
Scientific and serving performance belong in separate columns.
Completion task: Write a one-page CPred model card covering training composition, CV/holdout status, 46-feature prerequisites, threshold table, hardware, cache policy, known failure modes, and wet-lab confirmation.
Paper-specific glossary
- Probability score
- The mean of four model outputs in [0,1]; convenient to interpret but not necessarily a perfectly calibrated probability.
- PPF
- Predicted positive fraction, the proportion of all residues called viable.
- Cold run
- A run without reusable cache that computes all features and predictions.
- Distribution shift
- A difference between deployed protein populations/experimental definitions and training data.