Evidence-guided paper · 2024 · indirect-modern · full-text
Protein structure alignment by Reseek improves sensitivity to remote homologs
Robert C. Edgar. Protein structure alignment by Reseek improves sensitivity to remote homologs. Bioinformatics 40:btae687 (2024).
30-second read
Reseek's mega-alphabet jointly encodes amino acids and eight structural features, then reuses mature local sequence-alignment machinery for remote-homology search.
Central question
How can rich local and long-range structural states be turned into a sequence-alignable representation while keeping E-values calibrated to actual errors in large databases?
Intuition
Reseek avoids learning one enormous substitution matrix for 85.9 billion mega-letters. It factorizes amino acid, local conformation, nearest 3D-neighbor distances, and other features, learns separate log-odds matrices, sums them into residue-pair scores, and applies Smith–Waterman.
Why it matters
On the SCOP40 search benchmark, Reseek v2 achieves higher homolog sensitivity than DALI, TM-align, and Foldseek at matched false-positive errors per query, with better-calibrated E-values. This is retrieval evidence, not a FAST RMSD/coverage head-to-head.
Prerequisites
- Understand structural alphabets and substitution log-odds scores.
- Know Smith–Waterman local alignment and affine gap penalties.
- Be able to interpret sensitivity, FPEPQ, CVE curves, and E-value calibration.
paper-specific guide · plain → technical → input → output → source
Method walkthrough
-
01 · Factor structural context into small alphabets
Each residue records not only amino-acid type but also local backbone shape and distances/conformations of nearest and reverse 3D neighbors; each feature is discretized separately.
Technical reading: The feature vector includes AA, DistNEN/DistREN, Conf represented by pairwise distances within ±3 residues, and NEN/REN contexts. Scalar features use equal-frequency bins; vector features use K-means representatives.
Input: A protein Cα backbone and a training structure collection.
Output: A discrete feature vector for every residue.
Boundary: Discretization and feature selection discard coordinate detail; equal mega-letters do not imply identical full 3D environments.
PDF pp. 2–3, §2 Materials and methods
-
02 · Sum factorized log-odds and run local alignment
When comparing two residues, each feature contributes a weighted vote. Summing these votes yields a pair score without observing every enormous state combination.
Technical reading: Each feature f has log-odds matrix Mf and weight wf, with Sij=Σf wf Mf[Vf(i),Vf(j)]. AA plus eight 16-letter structural features create 20×16^8=85,899,345,920 mega-states. Smith–Waterman/BLAST-like search maximizes substitution scores minus affine gaps.
Input: Two discrete feature-vector sequences and per-feature scoring matrices.
Output: A local alignment and raw alignment score.
Boundary: This is fundamentally local search; homolog-detection ability is not global rigid-superposition quality.
PDF p. 3, Equations 2–3
-
03 · Convert alignment into AQ and calibrated E-values
Combine alignment score, local-distance preservation, and a reversed-sequence control into 0–1 AQ, then calibrate E-values against empirical errors so a threshold predicts false positives.
Technical reading: The AQ statistic combines LDDT-mu, forward score, query-versus-reversed-query score, and mean length, then maps to [0,1] with a logistic function. Constants are trained with SCOP40 holdout and E-values fitted to an empirical AQ distribution.
Input: An alignment, coordinate-derived LDDT-mu, reverse score, and lengths.
Output: AQ, E-value, ranking, and an optional Kabsch superposition.
Boundary: E-value extrapolation to AFDB scale still depends on the null model and database composition; the number of superfamilies is unknown.
PDF p. 3, Equation 4 and SCOP40 assessment protocol
Key result
SCOP40 all-v-all results emphasize remote-homology sensitivity and calibrated E-values, not superposition RMSD.
Evidence-guided deep reading
Paper facts, project readings, and teaching models are labelled separately.
paper-fact
Read sensitivity at a fixed error rate
Table 1 reports sensitivity at FPEPQ=.1/1/10: Reseek-sensitive scores .22/.34/.48, whereas Reseek-very-sensitive scores .22/.35/.51; TM-align gives .12/.24/.42, DALI .075/.17/.44, and Foldseek .11/.22/.41. Both the preset and error budget affect the conclusion, so the two Reseek modes must not be conflated.
The same table reports 49 s for Reseek-fast, 78 for Foldseek, 178 for Reseek-sensitive, 840 for Reseek-very-sensitive, 3.7×10^5 for TM-align, and 4.1×10^5 for DALI, on a 32-thread i9-14900K excluding database-build time.
Source locator: PDF pp. 3–5, Fig. 3 and Table 1
paper-fact
Why E-value calibration is a core result
A CVE plot asks how many homologs are recovered when allowing x false positives per query, matching threshold decisions in large databases more directly than ROC or precision alone. Ideally E≈FPEPQ.
In Fig. 3, a Foldseek E-value of 10^-6 corresponds to measured FPEPQ around .1, underestimating errors by five orders; Reseek E-values track measured errors better. This concerns significance calibration, not coordinate-alignment RMSD.
Source locator: PDF pp. 4–5, Figs. 2–3 and Discussion
project-reading
Evidence distance from the FAST question
FAST is not among the tested methods, and Reseek uses SCOP40 superfamily retrieval as ground truth with sensitivity/FPEPQ/E-value outputs. These do not answer FAST's aligned length and RMSD.
Reseek can reasonably be called a modern candidate for AI-scale structure search. Claiming greater overlap and lower error requires a separate same-pair experiment with fixed coverage rules and RMSD/TM-score computed from both outputs.
Source locator: PDF p. 3, SCOP40 protocol; PDF p. 5, Table 1
Study design and evaluation
Data and samples
SCOP40 v1.75 with 11,206 domains in 1,960 superfamilies, evaluated all-versus-all with same-superfamily as homolog truth.
Baselines
- DALILite v5, TM-align 2022/4/12, and Foldseek 8-ef4e960.
- BLASTP as sequence-search context.
Metrics
- Sensitivity@FPEPQ
- Fraction of homologs recovered at a fixed number of false positives per query.
Boundary: Using SCOP superfamily as truth can label unknown homology as negative. - E-value calibration
- Compares reported E-values with measured FPEPQ.
Boundary: Calibration depends on database size, composition, and the null distribution. - Time / memory
- Wall time and peak memory for all-versus-all search on common hardware.
Boundary: Database-build time is excluded and tools differ in filtering/output completeness.
Reported result
Reseek variants generally lead SCOP40 sensitivity at fixed FPEPQ and provide better-calibrated E-values, but speed depends on the preset: 49 s for fast, 178 s for sensitive, and 840 s for very-sensitive versus 78 s for Foldseek. FAST is not tested.
PDF pp. 3–5, §3 Results, Figs. 3–4, and Table 1
teaching-model · not a reported experiment
Teaching example (not a reported experiment)
How E-value underestimation grows in a large database
A tool reports E=10^-6 for a query, but a benchmark measures .1 false positives per query.
- The user expects one error per million searches; in reality there is about one per ten.
- They differ by 10^5, so even a useful ranking yields a dangerously wrong threshold interpretation.
- CVE plots sensitivity against measured FPEPQ, separating ranking from calibration.
Takeaway: Large-scale search must not only rank good hits early; it must know how many errors a cutoff implies.
indirect-modern
Evidence boundary versus FAST
FAST is not compared directly, and the evaluation is not an RMSD/coverage benchmark.
Lawful source and access
6 pages · SHA-256 998dff41139e909b3c0dcdacf8681bff76a985c5988dea5b00152b1740ee62fe
CC BY 4.0 open full text.
Limits and misreadings
- Single-author, author-run evaluation benefits from independent benchmarking.
Source locator map
- PDF pp. 2–3, §2 Materials and methods and Equations 2–4
- PDF pp. 3–5, §3 Results and Figs. 2–4
- PDF p. 5, Table 1
- PDF pp. 4–5, Discussion on CVE and E-value calibration
Check understanding
Does 85,899,345,920 states require an equally large substitution matrix?
Answer: No; Reseek factorizes the mega-state into small feature alphabets and sums their log-odds scores.
This is the key to avoiding sparse observations and memory explosion.
Can Reseek-very-sensitive Sens(10)=.51 be interpreted as lower RMSD?
Answer: No; it is the fraction of homologs recovered at FPEPQ=10.
It is a retrieval operating point, not superposition geometry.
Does this paper directly prove Reseek beats FAST?
Answer: No. FAST is absent.
Its primary metrics are sensitivity/FPEPQ, not the RMSD-plus-coverage question posed for FAST.
Completion task: Plot the four structural methods at FPEPQ .1, 1, and 10 from Table 1, then state why this plot cannot replace an Nmat/RMSD table.
Paper-specific glossary
- mega-alphabet
- The Cartesian-product state of multiple discrete features; Reseek does not enumerate a full matrix.
- false-positive errors per query
- The average number of false-positive hits per query.
- coverage-versus-error curve
- A search evaluation plotting sensitivity against measured error rate.
- alignment quality (AQ)
- Reseek's 0–1 test statistic combining alignment, reverse control, and LDDT-mu.