Evidence-guided paper · 2012 · outside-scope · full-text
Deciphering the Preference and Predicting the Viability of Circular Permutations in Proteins
Wei-Cheng Lo; Tian Dai; Yen-Yi Liu; Li-Fen Wang; Jenn-Kang Hwang; Ping-Chiang Lyu. Deciphering the Preference and Predicting the Viability of Circular Permutations in Proteins. PLOS ONE 7:e31791 (2012).
30-second read
The study learns structural preferences of natural CP sites to predict backbone cuts likely to preserve folding and function after rewiring.
Central question
A protein backbone cannot be cut safely everywhere. Can sequence, structure, packing, and dynamics learned from natural and experimental CP sites predict new termini that still permit folding and stability?
Intuition
Viable breakpoints often resemble loose seams on a structure's surface: they favor loops, exposure, low packing, flexibility, and distance from the buried hydrophobic core. The paper integrates these weak signals into 46 features and lets four models vote.
Why it matters
Engineering and validating circular permutations is costly. A predictor does not replace experiments, but it can reject low-probability positions and focus wet-lab work on candidates more likely to fold.
Prerequisites
- Understand the operational definition of a viable CP site: the product folds and is sufficiently stable/purifiable.
- Know solvent accessibility, packing density, B-factor/RMSF, and GNM flexibility.
- Be able to read ROC AUC, sensitivity, specificity, MCC, and predicted positive fraction.
- Understand train/test separation and sequence-redundancy control.
paper-specific guide · plain → technical → input → output → source
Method walkthrough
-
01 · Curate positives, negatives, and independent datasets
Collect foldable and nonfoldable breakpoints from systematically tested proteins and use large CP databases as additional positive sources.
Technical reading: Dataset L contains 335 sites from seven proteins and is split into Dataset T (six proteins; 76 viable, 100 inviable) and DHFR (86 viable, 73 inviable). nrCPDB-40 (1,059 proteins) and nrGIS-40 (2,814 domains) remain below 40% sequence identity relative to the other sets.
Input: Literature wet-lab outcomes, CPDB, GIS, and PDB/SCOP structures.
Output: Low-redundancy training, independent-evaluation, and large-scale positive sets.
Boundary: Large database sets contain almost only viable positives and cannot directly estimate specificity.
PDF pp. 14–15, Materials and Methods — Preparation of Experimental Datasets
-
02 · Quantify CP preferences and select 46 features
Turn each residue's local sequence, secondary structure, surface depth, packing, flexibility, and core distance into comparable numbers.
Technical reading: Candidates include 48 primary-, 19 secondary-, and 36 tertiary-structure properties. Permutation tests, ROC analysis, correlation-based redundancy checks, and cross-dataset tests select features such as propensity scores, RSA, CN/WCN, closeness, RMSF, GNM-F, and the new farness measure.
Input: Sequence and structural context for each candidate residue.
Output: Forty-six standardized features with improved dataset independence.
Boundary: Correlation or AUC for one feature does not establish causality; flexibility, packing, and exposure are interrelated.
PDF pp. 3–11, Figures 1–4 and Table 1; PDF pp. 15–16, feature calculations and selection
-
03 · Integrate HI, ANN, RF, and SVM
Four models each emit a 0–1 score, which are averaged into a final probability score.
Technical reading: Hierarchical integration builds a biologically organized feature tree and searches weights; a three-layer ANN, 500-tree random forest, and RBF-kernel SVM are also trained. A final score of at least 0.5 is called viable.
Input: A 46-feature vector for each residue.
Output: A CP-viability probability score for each residue.
Boundary: The score is a convenient calibrated quantity, not a physical guarantee of folding success; thresholds must reflect experimental cost.
PDF pp. 9–12, Figure 4 and Table 2; PDF p. 16, Hierarchical Integration and machine-learning methods
Key result
Natural CP sites are not randomly distributed, and their preferences become predictive signals later used by CPred.
Evidence-guided deep reading
Paper facts, project readings, and teaching models are labelled separately.
paper-fact
A shared structural language of viable CP sites
Natural CP favors Pro, Gly, hydrophilic residues, and loop/turn/bend conformations, while disfavoring bulky hydrophobics, α/π helices, and β-bridges. RSA, centroid-distance, packing, and flexibility analyses converge on exposed, loosely packed, mobile positions.
RMSF from 100-ps MD reaches AUC 0.76 for viable versus inviable sites, while cheaper GNM-F reaches 0.77. Secondary-structure propensity averages about 0.73 AUC, whereas sequence propensity remains below about 0.60.
Source locator: PDF pp. 3–8, Figures 1–3 and Table 1
paper-fact
Hold DHFR out until the end
Dataset T and DHFR share below 9% sequence identity; the former trains/tests models and the latter serves as an independent evaluation. The combined model reaches 0.905 AUC on DHFR (rounded to 0.91 in text), above the closeness baseline.
For nrCPDB-40/nrGIS-40, which lack negatives, the authors fix predicted positive fraction at 0.5 and report sensitivity; the combined system reaches about 0.75 and 0.715. This is not complete accuracy because specificity is unavailable on these sets.
Source locator: PDF pp. 11–12, Table 2; PDF pp. 14–16, dataset and PPF definitions
project-reading
Prediction supplies priorities, not an experimental substitute
Scores can narrow breakpoint candidates, but viability only means foldable/stable under the study's criteria; it does not guarantee catalytic activity, expression yield, or improved engineered function.
An experimental design should test high-, medium-, and a few low-score controls and record folding, solubility, stability, and function. Testing only successful high-score candidates creates verification bias.
Source locator: PDF pp. 13–14, Conclusions and Future Work
Study design and evaluation
Data and samples
Dataset T has six proteins and 76 viable/100 inviable sites; independent DHFR has 86/73; nrCPDB-40 has 1,059 proteins; nrGIS-40 has 2,814 domains. Pairwise sequence identity across sets is controlled below 40%, and below 9% between T and DHFR.
Baselines
- The prior closeness predictor and single-feature farness serve as baselines; individual HI, ANN, RF, and SVM models are also compared with the averaged ensemble.
Metrics
- ROC AUC
- Threshold-independent ranking discrimination between viable and inviable sites.
Boundary: Does not select an operating threshold or directly state precision. - Sensitivity at PPF = 0.5
- The proportion of known viable sites retrieved when half of all residues are called positive.
Boundary: Designed for database sets without negatives; specificity cannot be inferred. - Precision / recall by threshold
- The tradeoff between hit reliability and recovery at a chosen probability cutoff.
Boundary: Depends on class prevalence and dataset composition.
Reported result
The four-model average reaches 0.905 AUC on independent DHFR; at PPF=0.5, sensitivity is about 0.75 on nrCPDB-40 and 0.715 on nrGIS-40. The system is applied to 8,859 representative structures, but this is prediction deployment, not 8,859 wet-lab validations.
PDF pp. 11–13, Tables 2–4 and Figure 5; PDF p. 17, Text S1 description
teaching-model · not a reported experiment
Teaching example (not a reported experiment)
Prioritize four candidate breakpoints
Project teaching model: A is an exposed loop with low WCN and high GNM flexibility; B lies in a buried helix; C is exposed but tightly packed; D is a flexible loop near the active site.
- Standardize each site's 46 features so Ångströms, counts, and propensity scales are not added directly.
- Let HI, ANN, RF, and SVM each output a 0–1 score and average them; A should rank high, B low, while C/D require integrated judgment.
- Experimentally test A, C, D, and low-score B as a control, measuring folding, stability, and function separately.
Takeaway: A multifeature model ranks candidates; active-site risk and final function still require human design and experimental judgment.
outside-scope
Evidence boundary versus FAST
This is a protein-engineering viability problem, not a FAST-like pairwise alignment contest.
Lawful source and access
20 pages · SHA-256 5e3a1f66eda942cdca09e1c68af5a7be9699489baa8a03c1b915980322c246cd
Lawful open full text.
Limits and misreadings
- Natural-case selection bias may not represent all engineered permutations.
Source locator map
- PDF pp. 2–8, feature preference analyses and Figures 1–3
- PDF pp. 9–12, Figure 4 and Table 2
- PDF pp. 13–14, Conclusions and Future Work
- PDF pp. 14–15, Preparation of Experimental Datasets
- PDF pp. 15–16, feature calculations, PPF and machine-learning methods
Check understanding
Why can nrCPDB-40 not provide specificity?
Answer: It lacks systematically collected inviable CP sites and is almost entirely positive.
A true-negative rate cannot be computed without true negatives.
Does AUC 0.91 mean 91% of predictions succeed?
Answer: No. AUC summarizes how well viable sites rank above inviable sites.
Actual success proportion also depends on threshold and prevalence.
Does a high CP score guarantee improved function?
Answer: No. The target is foldable/stable viability.
Functional improvement is a separate endpoint listed as future work.
Completion task: Design a 12-site wet-lab validation: explain score-stratified sampling, inclusion of low-score controls, and separate success criteria for folding, stability, expression, and function.
Paper-specific glossary
- Viable CP site
- A breakpoint producing a foldable and sufficiently stable/purifiable circular permutant under the paper's operational definition.
- Farness
- A weighted harmonic-distance measure of how far a residue lies from the buried/hydrophobic core.
- Predicted positive fraction
- The fraction of all test-set residues called positive by the model.
- Hierarchical integration
- A procedure that organizes features into a biologically meaningful tree and integrates them with hierarchical weights.