[GoTo Human/Server Evaluation]

CASP8 Server only Evaluation

Chain: FM First-Score scores

This web-page is non-intuitive, but loaded with action. READ THIS:

WARNING: these tables are generated automatically and do not represent the final word in CASP8 assessment. For other automatic evaluations see Baker, Cheng, McGuffin, Zhang.

questions, comments, suggestions: shuoyong.shi@utsouthwestern.edu

get the list of target PDB codes; get target category assignment and domain definitions; get all evaluation tables in a text file
get renumbered and edited to match target sequences PDB coordinates; learn about 'random predictions'
read about NMR structures we processed, target categories we defined and scores we used; see the discussion of whole chain vs. domain evaluation

Target Categories in CASP8 First Score from First model only
CM_easy: Top 10 First-GTD_TS avg ≥ 81 Best Score from Best scoring model (up to 5)
CM_medium: Top 10 First-GDT_TS avg ≥ 67 Z-score Z-score computed on the target scores
CM_hard: Top 10 First-GDT_TS avg ≥ 52 TS GDT_TS score by LGA 1)
FR: Top 10 First-GDT_TS avg ≥ 30 TR GDT_TS score by LGA 1) minus penalty
FM: Top 10 First-GDT_TS avg < 30 CS Contact score based on intramolecular distances
All Targets: Everything combined SUM The sum of scores for all models

1) Zemla A. (2003) "LGA: A method for finding 3D similarities in protein structures." Nucleic Acids Research, 31(13):3370-3374; PMID: 12824330

CM_easy: [First-score] [First-Z score] [Best-score] [Best-Z score]
CM_medium: [First-score] [First-Z score] [Best-score] [Best-Z score]
CM_hard: [First-score] [First-Z score] [Best-score] [Best-Z score]
FR: [First-score] [First-Z score] [Best-score] [Best-Z score]
FM: [First-score] [First-Z score] [Best-score] [Best-Z score]   [GoTo Evaluation on domains]
All Targets: [First-score] [First-Z score] [Best-score] [Best-Z score]

7 chains: text file [GoTo Human/Server Evaluation]

# GROUP ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ ↓ GROUP #
SUM T0405 T0419 T0443 T0465 T0478 T0496 T0504 SUM
alig targ
alig targ
alig targ
alig targ
alig targ
alig targ
alig targ
1 FALCON 166.34 138.35 287.94 17.35 14.09 33.17 25.16 21.91 40.65 20.00 15.46 39.54 31.20 23.76 44.73 24.91 21.02 33.63 22.00 18.67 36.81 25.72 23.44 59.41 166.34 138.35 287.94 FALCON 1
2 FALCON_CONSENSUS 156.25 127.35 279.05 17.35 14.09 33.17 23.44 20.44 40.34 20.00 15.46 39.54 27.07 22.38 42.97 23.77 14.17 28.42 19.14 16.57 35.58 25.48 24.24 59.03 156.25 127.35 279.05 FALCON_CONSENSUS 2
3 Zhang‑Server 152.62 124.09 284.59 12.81 11.00 29.25 23.61 18.70 47.68 17.88 13.79 38.22 29.75 23.42 45.21 22.82 16.00 39.28 24.00 20.71 38.83 21.75 20.47 46.12 152.62 124.09 284.59 Zhang‑Server 3
4 pro‑sp3‑TASSER 152.07 118.02 232.81 15.57 12.60 27.00 27.52 22.84 50.14 19.62 14.21 36.66 24.38 20.80 35.97 28.41 19.25 34.21 16.86 11.81 13.25 19.71 16.51 35.58 152.07 118.02 232.81 pro‑sp3‑TASSER 4
5 SAM‑T08‑server 147.93 117.47 242.33 14.15 11.42 24.66 10.62 7.05 21.78 21.75 16.42 37.00 24.17 21.01 40.68 20.17 10.83 26.72 27.14 26.38 34.36 29.93 24.36 57.13 147.93 117.47 242.33 SAM‑T08‑server 5
6 PSI 142.98 122.64 274.96 16.55 15.18 33.22 19.64 17.70 42.46 21.00 16.00 38.97 22.52 18.11 41.73 17.42 13.26 28.33 19.29 16.71 41.56 26.56 25.68 48.69 142.98 122.64 274.96 PSI 6
7 Pcons_dot_net 140.59 118.84 152.73 16.82 13.14 36.60 15.61 13.00 -15.76 14.88 13.29 26.22 23.14 20.45 32.98 23.01 19.03 5.25 24.29 18.86 39.32 22.84 21.07 28.12 140.59 118.84 152.73 Pcons_dot_net 7
8 MUProt 140.28 115.20 208.53 9.70 8.13 10.76 20.12 17.97 33.94 18.75 16.46 23.97 24.17 14.12 40.62 16.86 15.21 17.47 24.00 16.95 29.24 26.68 26.36 52.53 140.28 115.20 208.53 MUProt 8
9 MULTICOM‑CLUSTER 140.20 117.28 221.49 11.65 10.23 17.72 20.01 17.18 33.83 19.62 17.46 27.06 22.31 17.49 39.71 17.61 12.78 21.85 24.00 17.62 28.99 25.00 24.52 52.33 140.20 117.28 221.49 MULTICOM‑CLUSTER 9
10 BAKER‑ROBETTA 138.08 117.23 258.54 15.30 13.52 31.93 19.64 17.10 40.10 21.00 19.33 42.13 24.79 17.91 44.13 17.05 15.72 28.28 20.71 17.38 32.38 19.59 16.27 39.59 138.08 117.23 258.54 BAKER‑ROBETTA 10
11 RAPTOR 134.99 106.03 252.67 13.52 8.07 27.88 22.75 15.29 30.14 16.25 13.58 38.34 20.45 17.29 35.13 15.81 14.71 29.91 22.29 15.62 40.53 23.92 21.47 50.74 134.99 106.03 252.67 RAPTOR 11
12 RBO‑Proteus 132.57 112.55 240.46 17.62 14.00 34.93 8.91 7.31 25.25 18.50 15.88 35.57 28.51 22.73 47.29 23.20 19.60 26.05 21.29 20.81 38.82 14.54 12.22 32.55 132.57 112.55 240.46 RBO‑Proteus 12
13 MULTICOM‑REFINE 132.09 110.80 213.08 10.94 10.59 19.34 17.81 15.92 30.72 18.75 16.50 23.99 24.17 14.12 40.62 17.61 12.78 21.85 17.57 16.29 23.93 25.24 24.60 52.63 132.09 110.80 213.08 MULTICOM‑REFINE 13
14 3DShot2 131.92 111.24 137.86 10.23 8.99 15.88 21.14 16.74 23.54 18.38 15.29 21.94 25.62 22.25 32.06 11.36 11.27 0.62 22.71 16.71 9.90 22.48 19.99 33.92 131.92 111.24 137.86 3DShot2 14
15 circle 131.55 108.51 126.67 10.41 9.94 20.81 20.06 17.27 -8.65 21.38 15.58 27.79 17.15 16.05 28.19 23.20 17.93 3.66 14.71 12.43 26.80 24.64 19.31 28.07 131.55 108.51 126.67 circle 15
16 Pcons_multi 128.75 114.38 164.38 9.61 8.87 17.58 19.47 16.97 40.88 15.25 13.75 26.14 23.14 20.45 32.98 23.01 19.03 5.25 15.43 14.24 13.43 22.84 21.07 28.12 128.75 114.38 164.38 Pcons_multi 16
17 MULTICOM‑RANK 128.08 107.72 180.51 9.61 7.71 10.42 20.28 17.42 37.56 19.12 16.75 24.24 19.63 16.18 27.29 17.61 13.04 21.43 16.71 12.14 7.30 25.12 24.48 52.27 128.08 107.72 180.51 MULTICOM‑RANK 17
18 MULTICOM‑CMFR 128.06 114.11 195.92 10.94 10.47 19.35 20.01 16.95 37.64 18.75 16.54 23.83 17.15 15.29 22.78 17.80 12.40 20.74 17.57 16.86 23.98 25.84 25.60 47.60 128.06 114.11 195.92 MULTICOM‑CMFR 18
19 HHpred4 127.93 105.55 109.45 7.56 6.23 3.02 16.79 14.29 15.99 19.25 15.50 4.52 26.86 22.04 31.31 13.07 9.91 -16.05 17.00 12.10 15.74 27.40 25.48 54.92 127.93 105.55 109.45 HHpred4 19
20 HHpred2 127.56 105.24 124.01 7.56 6.23 3.02 16.68 13.64 16.49 17.38 15.25 19.05 26.86 22.86 29.39 15.62 12.50 -11.97 17.14 11.24 15.25 26.32 23.52 52.78 127.56 105.24 124.01 HHpred2 20
21 HHpred5 125.24 105.85 91.96 7.56 6.23 3.02 18.08 15.86 3.46 18.75 15.92 6.44 26.86 22.04 31.31 13.07 9.91 -16.05 17.00 16.14 18.43 23.92 19.75 45.35 125.24 105.85 91.96 HHpred5 21
22 FAMSD 124.10 102.06 187.36 11.92 9.88 25.49 17.65 14.82 17.61 21.50 16.54 27.65 20.04 16.60 31.52 22.25 18.09 17.29 15.00 12.71 25.09 15.74 13.42 42.71 124.10 102.06 187.36 FAMSD 22
23 COMA‑M 123.36 108.78 99.53 8.72 7.89 -11.55 20.06 17.36 18.20 17.50 14.17 17.03 25.41 21.56 14.61 14.30 12.60 4.96 14.29 13.00 10.46 23.08 22.20 45.82 123.36 108.78 99.53 COMA‑M 23
24 FEIG 122.57 102.05 156.90 10.14 8.54 16.28 21.03 16.92 44.50 15.50 12.83 18.27 22.73 19.77 31.24 11.84 9.19 2.29 16.57 11.00 7.36 24.76 23.80 36.96 122.57 102.05 156.90 FEIG 24
25 MUFOLD‑MD 122.29 99.20 225.25 16.99 11.83 31.35 9.28 8.55 23.89 17.62 15.29 38.39 25.41 20.73 42.18 18.75 13.26 25.22 21.86 18.52 42.79 12.38 11.02 21.43 122.29 99.20 225.25 MUFOLD‑MD 25
26 GeneSilicoMetaServer 121.69 103.35 40.37 10.41 9.31 15.96 15.77 12.64 -20.60 19.25 17.42 -14.26 17.56 17.29 31.38 18.66 13.10 -6.71 13.00 9.95 5.48 27.04 23.64 29.12 121.69 103.35 40.37 GeneSilicoMetaServer 26
27 CpHModels 118.60 108.09 8.53 10.59 9.85 1.21 17.86 16.20 -14.63 13.62 12.12 -8.26 22.31 20.11 6.51 15.72 13.83 17.13 18.43 18.43 -16.84 20.07 17.55 23.41 118.60 108.09 8.53 CpHModels 27
28 Phyre_de_novo 117.46 99.39 198.32 9.43 8.42 23.88 20.98 15.83 37.80 14.38 12.88 19.64 18.18 15.56 25.39 16.48 13.70 16.32 16.86 12.81 30.82 21.15 20.19 44.47 117.46 99.39 198.32 Phyre_de_novo 28
29 METATASSER 116.70 104.67 207.10 13.70 11.48 29.05 5.90 5.40 9.29 19.75 17.42 37.51 21.69 19.15 39.34 12.50 9.91 16.82 19.00 18.43 31.08 24.16 22.88 44.01 116.70 104.67 207.10 METATASSER 29
30 GS‑KudlatyPred 116.04 94.34 190.81 4.00 2.73 12.12 18.99 9.82 20.67 13.50 11.12 17.75 23.76 20.39 41.13 16.48 14.08 26.42 19.00 18.29 29.28 20.31 17.91 43.44 116.04 94.34 190.81 GS‑KudlatyPred 30
31 3D‑JIGSAW_V3 114.03 100.24 89.75 7.03 6.02 -15.16 18.83 13.91 16.69 10.00 9.12 -11.12 22.73 18.87 17.86 15.06 13.86 8.45 12.86 12.10 16.40 27.52 26.36 56.63 114.03 100.24 89.75 3D‑JIGSAW_V3 31
32 Pcons_local 113.36 104.29 77.82 8.36 8.36 14.81 15.61 13.00 -15.76 14.88 14.12 27.36 20.66 19.97 33.61 14.30 12.53 -11.99 16.71 15.24 1.67 22.84 21.07 28.12 113.36 104.29 77.82 Pcons_local 32
33 COMA 112.80 99.67 85.37 8.45 8.10 -11.46 18.94 16.58 15.67 17.62 14.38 7.87 16.12 12.81 11.93 14.30 12.60 4.96 14.29 13.00 10.46 23.08 22.20 45.94 112.80 99.67 85.37 COMA 33
34 Phyre2 111.81 98.05 166.50 8.99 7.89 11.02 16.31 14.72 34.58 19.50 15.25 26.96 17.36 16.39 19.88 11.36 10.04 3.88 17.86 14.05 24.79 20.43 19.71 45.39 111.81 98.05 166.50 Phyre2 34
35 BioSerf 111.38 94.91 212.41 13.08 9.88 27.71 9.66 6.72 21.14 14.12 13.12 36.85 20.66 18.18 38.62 14.21 11.55 15.65 21.14 19.67 36.72 18.51 15.79 35.72 111.38 94.91 212.41 BioSerf 35
36 GS‑MetaServer2 110.93 96.00 33.30 10.41 9.31 15.96 17.27 15.31 -14.54 19.25 17.42 -14.26 17.56 17.29 31.38 18.66 13.10 -6.71 13.00 9.95 5.48 14.78 13.62 15.99 110.93 96.00 33.30 GS‑MetaServer2 36
37 SAM‑T06‑server 110.72 95.41 165.61 10.23 9.25 23.21 11.11 9.82 13.71 13.62 12.21 28.72 20.45 15.91 28.11 19.41 15.85 19.90 15.71 15.14 19.97 20.19 17.23 31.99 110.72 95.41 165.61 SAM‑T06‑server 37
38 pipe_int 108.63 93.93 166.69 9.43 8.51 28.78 19.64 16.06 33.57 13.12 11.38 23.93 23.97 20.39 19.19 15.81 14.08 21.81 12.00 11.33 25.52 14.66 12.18 13.89 108.63 93.93 166.69 pipe_int 38
39 Poing 108.21 93.70 172.14 9.88 8.78 18.05 15.13 13.95 27.56 16.00 13.25 23.49 17.56 14.39 20.70 16.29 14.49 19.94 19.29 16.38 28.91 14.06 12.46 33.49 108.21 93.70 172.14 Poing 39
40 FFASstandard 108.11 87.98 -30.17 7.74 5.66 -9.07 16.68 13.07 -13.65 18.62 15.79 -14.71 17.36 11.71 -1.40 14.96 10.61 7.40 18.57 18.48 -15.90 14.18 12.66 17.16 108.11 87.98 -30.17 FFASstandard 40
41 3Dpro 106.79 94.65 145.79 12.01 10.62 22.82 8.53 7.55 -0.80 13.25 11.92 19.64 17.98 15.29 28.71 16.67 12.28 18.87 19.00 19.00 23.65 19.35 17.99 32.90 106.79 94.65 145.79 3Dpro 41
42 MUFOLD‑Server 106.20 79.25 169.24 11.92 8.99 24.80 7.99 6.67 13.70 19.00 16.38 29.42 22.11 17.70 33.17 22.25 11.14 29.14 12.71 11.76 21.90 10.22 6.61 17.11 106.20 79.25 169.24 MUFOLD‑Server 42
43 3D‑JIGSAW_AEP 105.75 96.04 83.06 8.01 6.97 -6.80 17.22 14.97 11.30 11.75 10.71 -10.79 18.39 17.84 24.40 14.11 12.37 6.08 12.71 11.38 15.16 23.56 21.80 43.71 105.75 96.04 83.06 3D‑JIGSAW_AEP 43
44 fais‑server 105.66 85.40 154.46 8.90 6.94 2.76                   17.38 15.83 31.03 24.17 20.18 31.29 18.94 9.38 33.66 23.29 20.81 32.57 12.98 12.26 23.15 105.66 85.40 154.46 fais‑server 44
45 Phragment 105.59 93.17 172.34 11.03 9.96 21.64 16.31 14.72 34.58 15.62 12.67 23.37 17.56 15.63 26.08 14.87 12.97 8.67 16.14 14.24 24.11 14.06 12.98 33.89 105.59 93.17 172.34 Phragment 45
46 FFASsuboptimal 104.63 85.45 -50.31 5.52 4.83 -24.13 16.31 12.70 -14.04 18.75 13.62 -12.80 16.32 13.29 -3.85 15.44 10.48 0.30 18.71 18.43 -16.58 13.58 12.10 20.79 104.63 85.45 -50.31 FFASsuboptimal 46
47 PS2‑server 103.48 89.40 100.53 9.34 7.59 17.78 18.40 15.66 -17.80 11.00 9.33 2.31 17.36 14.12 26.86 17.14 15.37 24.83 14.86 13.71 18.28 15.38 13.62 28.27 103.48 89.40 100.53 PS2‑server 47
48 MUSTER 101.41 86.93 130.10 11.83 10.59 13.84 7.83 6.87 3.40 14.62 13.46 28.28 16.74 14.26 20.75 16.57 14.74 19.59 17.71 12.67 8.72 16.11 14.34 35.52 101.41 86.93 130.10 MUSTER 48
49 Frankenstein 99.13 85.64 130.05 10.41 9.88 20.25                   14.00 10.21 19.91 19.42 17.77 24.68 13.64 12.44 16.57 14.86 9.86 8.77 26.80 25.48 39.87 99.13 85.64 130.05 Frankenstein 49
50 mGenTHREADER 98.96 89.80 146.38 10.41 9.99 17.56 5.15 4.04 22.78 15.88 12.62 23.95 17.98 16.67 30.44 13.73 12.25 7.26 18.86 18.57 22.13 16.95 15.66 22.26 98.96 89.80 146.38 mGenTHREADER 50
51 Distill 97.53 86.51 166.63 12.19 10.14 24.68                   16.62 13.54 30.14 20.87 17.91 34.05 14.02 13.89 28.17 22.29 20.57 30.25 11.54 10.46 19.34 97.53 86.51 166.63 Distill 51
52 FOLDpro 97.48 87.34 65.94 9.79 9.49 11.02 5.85 5.45 -8.81 13.88 12.29 6.53 17.98 15.29 27.34 13.26 11.49 -2.24 18.57 16.38 6.04 18.15 16.95 26.06 97.48 87.34 65.94 FOLDpro 52
53 keasar‑server 95.98 84.75 99.23 8.36 7.29 6.68                   9.75 8.17 -1.22 16.74 15.56 17.21 16.38 11.74 10.77 20.71 18.91 27.41 24.04 23.08 38.38 95.98 84.75 99.23 keasar‑server 53
54 forecast 94.93 80.84 119.92 10.77 8.87 18.08 9.44 8.76 8.62 12.50 10.21 19.04 16.53 15.56 20.70 15.44 13.07 13.83 15.71 13.19 23.02 14.54 11.18 16.63 94.93 80.84 119.92 forecast 54
55 nFOLD3 94.49 82.07 168.22 11.65 9.07 24.13 7.83 6.33 17.48 10.88 9.54 26.87 17.77 14.67 32.38 15.44 12.72 24.37 16.86 16.24 27.91 14.06 13.50 15.08 94.49 82.07 168.22 nFOLD3 55
56 ACOMPMOD 91.93 83.53 -46.80 8.36 7.59 5.88 15.02 12.38 -14.19 11.50 11.00 16.08 17.36 15.01 16.73 6.53 5.27 -66.99 18.86 18.86 -16.10 14.30 13.42 11.79 91.93 83.53 -46.80 ACOMPMOD 56
57 FFASflextemplate 89.08 70.64 -16.01 7.56 5.96 -8.88 16.52 13.55 -14.29 18.62 15.79 -14.71 17.36 11.71 -1.40 14.96 10.61 7.40                   14.06 13.02 15.87 89.08 70.64 -16.01 FFASflextemplate 57
58 SAM‑T02‑server 88.71 80.45 -103.50 9.52 8.36 1.28 13.79 12.25 -17.19 11.12 9.54 -27.84 17.36 15.56 7.53 7.39 5.93 -57.27 16.43 16.43 -19.26 13.10 12.38 9.25 88.71 80.45 -103.50 SAM‑T02‑server 58
59 RANDOM 88.35 74.49 88.35 10.71 9.22 10.71 7.23 6.37 7.23 12.96 10.74 12.96 17.30 14.39 17.30 16.03 13.39 16.03 14.68 12.24 14.68 9.44 8.14 9.44 88.35 74.49 88.35 RANDOM 59
60 mariner1 82.65 68.73 14.89 9.43 9.19 7.19 7.67 6.47 -20.24 9.88 7.96 8.77 18.39 15.50 9.74 13.54 10.64 -14.18 14.00 11.48 13.16 9.74 7.49 10.45 82.65 68.73 14.89 mariner1 60
61 FUGUE_KM 75.53 69.32 -103.32 8.10 7.59 -1.43 13.89 11.32 -15.71 11.12 9.67 9.25 0.00 0.00 -32.79 10.13 9.41 -54.13 18.71 18.43 -16.58 13.58 12.90 8.07 75.53 69.32 -103.32 FUGUE_KM 61
62 LEE‑SERVER 74.21 66.87 135.94 11.39 9.37 19.83                                     18.39 16.74 31.88 18.47 16.32 26.95                   25.96 24.44 57.28 74.21 66.87 135.94 LEE‑SERVER 62
63 schenk‑torda‑server 72.01 60.80 47.54 7.74 6.55 8.11 5.20 4.43 -0.95 9.62 8.29 8.41 16.12 13.77 21.03 10.32 8.30 -9.78 14.00 11.81 8.99 9.01 7.65 11.73 72.01 60.80 47.54 schenk‑torda‑server 63
64 huber‑torda‑server 68.29 59.52 -29.49 8.90 7.12 2.61 5.96 5.13 -13.90 16.88 14.46 14.70 0.00 0.00 -32.79 9.09 8.14 -23.18 17.00 16.62 15.98 10.46 8.05 7.09 68.29 59.52 -29.49 huber‑torda‑server 64
65 LOOPP_Server 64.52 53.75 9.06 10.77 9.99 -4.33 7.19 6.33 -10.36                                     15.81 10.89 -13.73 17.29 14.52 24.98 13.46 12.02 12.50 64.52 53.75 9.06 LOOPP_Server 65
66 OLGAFS 49.43 44.08 -96.63 5.96 5.81 -26.73                   9.88 8.58 -27.40 12.40 10.81 -16.61 8.62 7.17 -22.81 12.57 11.71 -3.08                   49.43 44.08 -96.63 OLGAFS 66
67 rehtnap 42.56 39.00 -248.23 2.58 2.40 -35.09 3.38 3.20 -43.69 8.00 7.33 -33.43 9.09 8.13 -26.57 4.74 4.74 -76.48 4.43 3.86 -36.87 10.34 9.34 3.90 42.56 39.00 -248.23 rehtnap 67
68 Pushchino 41.28 35.23 -72.68 7.21 6.85 -3.72                   6.12 5.62 -35.62 0.00 0.00 -32.79 9.56 7.10 -16.40                   18.39 15.66 15.85 41.28 35.23 -72.68 Pushchino 68
69 mahmood‑torda‑server 38.07 32.31 37.13                                                       15.08 11.91 22.81 9.28 8.21 -4.34 13.71 12.19 18.66                   38.07 32.31 37.13 mahmood‑torda‑server 69
70 panther_server 30.75 25.98 -142.32                                     10.75 8.79 -4.81 0.00 0.00 -32.79 4.36 3.54 -76.15 8.43 7.52 -31.11 7.21 6.13 2.54 30.75 25.98 -142.32 panther_server 70
71 BHAGEERATH                                                                                                                                                                   BHAGEERATH 71
72 Fiser‑M4T                                                                                                                                                                   Fiser‑M4T 72
73 YASARA                                                                                                                                                                   YASARA 73
74 test_http_server_01                                                                                                                                                                   test_http_server_01 74