[GoTo Human/Server Evaluation]

CASP8 Server only Evaluation

Domain: FM: First-Score scores

This web-page is non-intuitive, but loaded with action. READ THIS:

WARNING: these tables are generated automatically and do not represent the final word in CASP8 assessment. For other automatic evaluations see Baker, Cheng, McGuffin, Zhang.

questions, comments, suggestions: shuoyong.shi@utsouthwestern.edu

get the list of target PDB codes; get target category assignment and domain definitions; get all evaluation tables in a text file
get renumbered and edited to match target sequences PDB coordinates; learn about 'random predictions'
read about NMR structures we processed, target categories we defined and scores we used; see the discussion of whole chain vs. domain evaluation

Target Categories in CASP8 First Score from First model only
CM_easy: Top 10 First-GTD_TS avg ≥ 81 Best Score from Best scoring model (up to 5)
CM_medium: Top 10 First-GDT_TS avg ≥ 67 Z-score Z-score computed on the target scores
CM_hard: Top 10 First-GDT_TS avg ≥ 52 TS GDT_TS score by LGA 1)
FR: Top 10 First-GDT_TS avg ≥ 30 TR GDT_TS score by LGA 1) minus penalty
FM: Top 10 First-GDT_TS avg < 30 CS Contact score based on intramolecular distances
All Targets: Everything combined SUM The sum of scores for all models

1) Zemla A. (2003) "LGA: A method for finding 3D similarities in protein structures." Nucleic Acids Research, 31(13):3370-3374; PMID: 12824330

CM_easy: [First-score] [First-Z score] [Best-score] [Best-Z score]
CM_medium: [First-score] [First-Z score] [Best-score] [Best-Z score]
CM_hard: [First-score] [First-Z score] [Best-score] [Best-Z score]
FR: [First-score] [First-Z score] [Best-score] [Best-Z score]
FM: [First-score] [First-Z score] [Best-score] [Best-Z score]   [GoTo Evaluation on whole chain]
All Targets: [First-score] [First-Z score] [Best-score] [Best-Z score]

5 domains: text file [GoTo Human/Server Evaluation]

# GROUP ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ ↓ GROUP #
SUM 397_1 405_2 407_2 465 496_1 SUM
alig targ
alig targ
alig targ
alig targ
alig targ
1 Zhang‑Server 129.23 100.39 169.56 28.96 19.82 30.90 14.23 12.36 27.29 31.70 24.40 29.86 29.75 23.42 45.21 24.59 20.39 36.30 129.23 100.39 169.56 Zhang‑Server 1
2 MUFOLD‑MD 128.27 105.80 182.59 33.54 31.10 36.68 22.73 15.15 35.18 21.39 17.61 26.72 25.41 20.73 42.18 25.20 21.21 41.83 128.27 105.80 182.59 MUFOLD‑MD 2
3 BAKER‑ROBETTA 127.26 103.99 170.14 29.57 23.88 32.47 20.57 18.18 32.62 28.35 22.68 26.90 24.79 17.91 44.13 23.98 21.34 34.02 127.26 103.99 170.14 BAKER‑ROBETTA 3
4 FALCON 120.19 101.79 180.32 26.83 25.20 39.72 18.54 13.99 32.63 19.84 16.41 25.80 31.20 23.76 44.73 23.78 22.43 37.44 120.19 101.79 180.32 FALCON 4
5 Phyre_de_novo 119.96 103.91 160.42 23.78 19.51 32.21 12.68 11.92 25.85 44.59 40.46 46.66 18.18 15.56 25.39 20.73 16.46 30.31 119.96 103.91 160.42 Phyre_de_novo 5
6 RBO‑Proteus 117.92 99.28 175.54 25.61 21.14 32.31 23.68 18.82 37.26 19.59 17.01 23.28 28.51 22.73 47.29 20.53 19.58 35.40 117.92 99.28 175.54 RBO‑Proteus 6
7 pro‑sp3‑TASSER 115.80 98.20 139.35 25.30 21.24 27.96 13.04 10.96 24.81 34.79 30.84 34.93 24.38 20.80 35.97 18.29 14.36 15.68 115.80 98.20 139.35 pro‑sp3‑TASSER 7
8 PSI 112.01 95.65 169.17 23.78 21.34 30.32 15.91 14.39 32.48 22.16 19.59 19.78 22.52 18.11 41.73 27.64 22.22 44.86 112.01 95.65 169.17 PSI 8
9 METATASSER 110.44 94.00 161.56 33.54 27.85 35.43 15.79 13.16 29.97 17.27 14.26 25.56 21.69 19.15 39.34 22.15 19.58 31.26 110.44 94.00 161.56 METATASSER 9
10 RAPTOR 108.30 90.42 157.29 25.30 21.85 29.41 18.18 11.64 28.57 18.56 16.67 26.54 20.45 17.29 35.13 25.81 22.97 37.64 108.30 90.42 157.29 RAPTOR 10
11 SAM‑T08‑server 107.57 93.13 148.02 23.17 19.51 30.43 19.14 15.47 25.76 16.50 15.12 22.04 24.17 21.01 40.68 24.59 22.02 29.11 107.57 93.13 148.02 SAM‑T08‑server 11
12 BioSerf 106.03 91.31 154.56 24.39 22.66 27.07 16.87 12.28 28.81 22.16 17.87 23.80 20.66 18.18 38.62 21.95 20.32 36.26 106.03 91.31 154.56 BioSerf 12
13 MULTICOM‑REFINE 102.60 84.86 144.78 22.87 20.12 30.47 14.12 13.48 23.76 22.94 18.64 25.88 24.17 14.12 40.62 18.50 18.50 24.05 102.60 84.86 144.78 MULTICOM‑REFINE 13
14 MULTICOM‑CLUSTER 98.28 85.27 139.58 22.26 19.11 30.39 15.55 13.72 21.17 18.04 16.32 24.40 22.31 17.49 39.71 20.12 18.63 23.91 98.28 85.27 139.58 MULTICOM‑CLUSTER 14
15 fais‑server 97.57 83.13 118.89 21.04 19.11 23.27 10.17 8.37 7.67 22.68 18.13 26.14 24.17 20.18 31.29 19.51 17.34 30.52 97.57 83.13 118.89 fais‑server 15
16 MUProt 96.61 79.83 137.14 21.95 20.02 31.42 10.88 8.49 13.36 20.10 18.64 27.75 24.17 14.12 40.62 19.51 18.56 23.99 96.61 79.83 137.14 MUProt 16
17 Distill 95.96 78.20 142.44 20.12 15.24 29.84 16.27 13.52 27.90 16.75 12.29 20.44 20.87 17.91 34.05 21.95 19.24 30.21 95.96 78.20 142.44 Distill 17
18 HHpred4 95.42 75.76 102.34 22.56 15.85 24.93 9.45 7.66 5.97 15.21 13.14 18.59 26.86 22.04 31.31 21.34 17.07 21.54 95.42 75.76 102.34 HHpred4 18
19 mGenTHREADER 95.35 86.34 117.86 29.88 25.00 34.05 14.12 13.56 16.95 16.50 15.12 17.59 17.98 16.67 30.44 16.87 15.99 18.83 95.35 86.34 117.86 mGenTHREADER 19
20 FAMSD 95.01 81.42 141.49 20.43 17.28 24.02 14.47 11.96 28.62 20.36 18.30 27.55 20.04 16.60 31.52 19.71 17.28 29.78 95.01 81.42 141.49 FAMSD 20
21 Poing 94.72 77.89 119.68 25.30 20.73 28.89 12.56 8.33 18.66 19.59 16.15 23.26 17.56 14.39 20.70 19.71 18.29 28.17 94.72 77.89 119.68 Poing 21
22 Phragment 94.18 82.31 126.92 20.73 19.51 28.58 14.47 12.16 20.94 21.91 19.16 26.88 17.56 15.63 26.08 19.51 15.85 24.44 94.18 82.31 126.92 Phragment 22
23 FALCON_CONSENSUS 93.95 77.15 136.79 21.04 20.22 31.77 18.54 13.99 32.63 7.99 6.27 -3.73 27.07 22.38 42.97 19.31 14.29 33.15 93.95 77.15 136.79 FALCON_CONSENSUS 23
24 MULTICOM‑CMFR 93.83 84.44 122.71 22.56 19.71 25.35 14.23 13.60 23.77 21.39 17.61 26.83 17.15 15.29 22.78 18.50 18.23 23.98 93.83 84.44 122.71 MULTICOM‑CMFR 24
25 forecast 93.41 80.01 108.54 25.30 19.71 20.51 13.88 12.96 18.98 17.78 15.38 23.56 16.53 15.56 20.70 19.92 16.40 24.79 93.41 80.01 108.54 forecast 25
26 nFOLD3 92.46 79.95 131.09 21.34 19.71 21.25 13.16 10.85 23.60 20.88 17.44 24.69 17.77 14.67 32.38 19.31 17.28 29.17 92.46 79.95 131.09 nFOLD3 26
27 MUFOLD‑Server 92.31 72.29 141.40 22.87 19.21 36.19 12.68 8.97 25.89 17.78 10.22 23.16 22.11 17.70 33.17 16.87 16.19 22.99 92.31 72.29 141.40 MUFOLD‑Server 27
28 Pcons_dot_net 90.87 78.18 125.34 22.56 18.80 25.88 22.61 17.66 38.00 0.00 0.00 -5.92 23.14 20.45 32.98 22.56 21.27 34.40 90.87 78.18 125.34 Pcons_dot_net 28
29 FEIG 89.45 77.96 119.89 21.95 19.11 34.26 12.08 10.41 20.44 15.21 13.49 24.37 22.73 19.77 31.24 17.48 15.18 9.58 89.45 77.96 119.89 FEIG 29
30 HHpred2 89.30 79.57 97.32 21.04 19.71 25.65 9.45 7.66 5.97 13.66 13.49 15.61 26.86 22.86 29.39 18.29 15.85 20.70 89.30 79.57 97.32 HHpred2 30
31 HHpred5 88.24 74.29 105.24 20.73 18.80 24.90 9.45 7.66 5.97 13.92 11.43 18.12 26.86 22.04 31.31 17.28 14.36 24.94 88.24 74.29 105.24 HHpred5 31
32 MULTICOM‑RANK 88.08 71.80 106.52 19.82 14.43 30.23 10.88 10.45 13.13 20.88 16.92 26.82 19.63 16.18 27.29 16.87 13.82 9.05 88.08 71.80 106.52 MULTICOM‑RANK 32
33 Phyre2 87.73 73.56 105.94 25.61 20.02 29.68 10.65 9.85 12.67 15.21 13.14 18.43 17.36 16.39 19.88 18.90 14.16 25.28 87.73 73.56 105.94 Phyre2 33
34 SAM‑T06‑server 87.24 77.27 116.97 18.90 17.68 17.70 12.68 12.20 22.86 17.53 14.95 23.85 20.45 15.91 28.11 17.68 16.53 24.45 87.24 77.27 116.97 SAM‑T06‑server 34
35 3Dpro 87.18 77.44 122.25 21.65 20.12 25.53 16.03 13.36 22.99 15.46 15.46 22.71 17.98 15.29 28.71 16.06 13.21 22.31 87.18 77.44 122.25 3Dpro 35
36 pipe_int 86.49 75.15 119.83 18.90 15.85 21.27 12.08 10.49 29.85 16.50 13.92 23.14 23.97 20.39 19.19 15.04 14.50 26.38 86.49 75.15 119.83 pipe_int 36
37 mariner1 86.18 70.34 84.03 24.09 17.07 25.71 12.68 12.36 12.69 15.98 14.43 19.10 18.39 15.50 9.74 15.04 10.98 16.79 86.18 70.34 84.03 mariner1 37
38 3D‑JIGSAW_V3 85.50 69.86 45.95 18.90 14.63 7.52 9.69 7.22 -8.10 16.50 12.54 8.27 22.73 18.87 17.86 17.68 16.60 20.40 85.50 69.86 45.95 3D‑JIGSAW_V3 38
39 RANDOM 84.99 71.91 84.99 19.60 16.84 19.60 11.91 10.16 11.91 18.81 15.96 18.81 17.30 14.39 17.30 17.37 14.56 17.37 84.99 71.91 84.99 RANDOM 39
40 3DShot2 84.16 70.08 91.69 18.90 15.55 18.65 11.84 9.97 16.84 14.18 11.60 18.61 25.62 22.25 32.06 13.62 10.71 5.53 84.16 70.08 91.69 3DShot2 40
41 3D‑JIGSAW_AEP 80.34 71.55 72.90 19.21 15.75 18.34 10.77 9.61 1.98 14.69 12.97 8.14 18.39 17.84 24.40 17.28 15.38 20.04 80.34 71.55 72.90 3D‑JIGSAW_AEP 41
42 MUSTER 79.82 67.75 93.70 18.29 14.43 24.00 12.32 10.69 15.70 14.18 13.06 22.57 16.74 14.26 20.75 18.29 15.31 10.68 79.82 67.75 93.70 MUSTER 42
43 FOLDpro 79.44 68.76 89.54 21.95 20.22 25.88 10.17 9.81 10.14 15.72 13.14 19.13 17.98 15.29 27.34 13.62 10.30 7.05 79.44 68.76 89.54 FOLDpro 43
44 COMA‑M 77.98 69.16 51.84 20.73 18.90 24.17 11.72 10.61 -4.61 0.00 0.00 -5.92 25.41 21.56 14.61 20.12 18.09 23.59 77.98 69.16 51.84 COMA‑M 44
45 keasar‑server 77.66 67.04 94.99 31.40 23.88 38.21 10.41 8.97 10.28                   16.74 15.56 17.21 19.11 18.63 29.29 77.66 67.04 94.99 keasar‑server 45
46 schenk‑torda‑server 76.01 68.49 91.82 19.51 19.11 21.54 10.17 8.57 14.04 15.98 15.12 19.81 16.12 13.77 21.03 14.23 11.92 15.40 76.01 68.49 91.82 schenk‑torda‑server 46
47 Frankenstein 75.84 68.09 75.73 10.98 9.15 -4.18 13.16 11.64 20.71 15.21 15.03 24.06 19.42 17.77 24.68 17.07 14.50 10.46 75.84 68.09 75.73 Frankenstein 47
48 Pcons_local 74.12 66.11 71.64 19.82 15.96 22.67 10.53 9.89 18.81 10.31 9.11 3.97 20.66 19.97 33.61 12.80 11.18 -7.42 74.12 66.11 71.64 Pcons_local 48
49 Pcons_multi 70.03 61.03 88.92 18.90 16.06 20.09 11.12 9.41 19.19 0.00 0.00 -5.92 23.14 20.45 32.98 16.87 15.11 22.58 70.03 61.03 88.92 Pcons_multi 49
50 circle 69.70 62.46 99.38 20.43 19.00 23.73 12.20 11.56 22.16 0.00 0.00 -5.92 17.15 16.05 28.19 19.92 15.85 31.22 69.70 62.46 99.38 circle 50
51 PS2‑server 68.89 58.59 89.62 18.60 15.55 19.78 12.20 9.81 21.56 0.00 0.00 -5.92 17.36 14.12 26.86 20.73 19.11 27.34 68.89 58.59 89.62 PS2‑server 51
52 COMA 67.23 56.48 46.35 19.51 15.45 20.55 11.48 10.13 -3.80 0.00 0.00 -5.92 16.12 12.81 11.93 20.12 18.09 23.59 67.23 56.48 46.35 COMA 52
53 GS‑MetaServer2 67.03 58.68 73.64 8.23 6.20 -6.96 13.40 9.97 17.94 14.43 13.57 20.26 17.56 17.29 31.38 13.41 11.65 11.02 67.03 58.68 73.64 GS‑MetaServer2 53
54 GS‑KudlatyPred 61.49 53.42 72.77 10.98 9.35 -5.72 6.22 5.86 13.79 0.00 0.00 -5.92 23.76 20.39 41.13 20.53 17.82 29.49 61.49 53.42 72.77 GS‑KudlatyPred 54
55 LEE‑SERVER 58.40 52.28 87.38 24.70 22.46 32.72 15.31 13.08 22.78                   18.39 16.74 31.88                   58.40 52.28 87.38 LEE‑SERVER 55
56 LOOPP_Server 55.25 50.06 22.20 14.02 11.99 0.97 12.56 11.80 -2.64 11.60 11.43 0.20                   17.07 14.84 23.67 55.25 50.06 22.20 LOOPP_Server 56
57 huber‑torda‑server 53.67 44.49 16.39 21.34 17.48 22.66 11.60 8.45 7.97                   0.00 0.00 -32.79 20.73 18.56 18.55 53.67 44.49 16.39 huber‑torda‑server 57
58 mahmood‑torda‑server 53.60 42.74 69.94 23.48 18.50 23.81                                     15.08 11.91 22.81 15.04 12.33 23.32 53.60 42.74 69.94 mahmood‑torda‑server 58
59 GeneSilicoMetaServer 52.60 45.11 47.46 8.23 6.20 -6.96 13.40 9.97 17.94 0.00 0.00 -5.92 17.56 17.29 31.38 13.41 11.65 11.02 52.60 45.11 47.46 GeneSilicoMetaServer 59
60 OLGAFS 50.28 44.45 -10.36 16.46 16.06 16.73 8.01 7.82 -14.39                   12.40 10.81 -16.61 13.41 9.76 3.91 50.28 44.45 -10.36 OLGAFS 60
61 ACOMPMOD 48.11 40.57 28.42 19.51 15.35 18.27 11.24 10.21 20.41 0.00 0.00 -5.92 17.36 15.01 16.73 0.00 0.00 -21.07 48.11 40.57 28.42 ACOMPMOD 61
62 CpHModels 36.19 32.95 -16.73 0.00 0.00 -9.70 13.88 12.84 13.45 0.00 0.00 -5.92 22.31 20.11 6.51 0.00 0.00 -21.07 36.19 32.95 -16.73 CpHModels 62
63 Pushchino 30.73 27.60 -19.04 21.04 18.39 16.23 9.69 9.21 3.44 0.00 0.00 -5.92 0.00 0.00 -32.79                   30.73 27.60 -19.04 Pushchino 63
64 panther_server 29.37 25.85 -45.63 17.38 15.14 4.34                   0.00 0.00 -5.92 0.00 0.00 -32.79 11.99 10.71 -11.26 29.37 25.85 -45.63 panther_server 64
65 SAM‑T02‑server 28.72 26.05 -22.34 0.00 0.00 -9.70 11.36 10.49 6.82 0.00 0.00 -5.92 17.36 15.56 7.53 0.00 0.00 -21.07 28.72 26.05 -22.34 SAM‑T02‑server 65
66 rehtnap 28.54 24.42 -74.70 0.00 0.00 -9.70 3.47 3.23 -24.85 15.98 13.06 7.49 9.09 8.13 -26.57 0.00 0.00 -21.07 28.54 24.42 -74.70 rehtnap 66
67 FFASflextemplate 27.53 19.72 -18.45 0.00 0.00 -9.70 10.17 8.01 -1.43 0.00 0.00 -5.92 17.36 11.71 -1.40                   27.53 19.72 -18.45 FFASflextemplate 67
68 FFASstandard 27.41 19.84 -39.39 0.00 0.00 -9.70 10.05 8.13 -1.30 0.00 0.00 -5.92 17.36 11.71 -1.40 0.00 0.00 -21.07 27.41 19.84 -39.39 FFASstandard 68
69 FFASsuboptimal 23.14 19.27 -53.87 0.00 0.00 -9.70 6.82 5.98 -13.33 0.00 0.00 -5.92 16.32 13.29 -3.85 0.00 0.00 -21.07 23.14 19.27 -53.87 FFASsuboptimal 69
70 FUGUE_KM 10.88 10.21 -45.72                   10.88 10.21 14.06 0.00 0.00 -5.92 0.00 0.00 -32.79 0.00 0.00 -21.07 10.88 10.21 -45.72 FUGUE_KM 70
71 Fiser‑M4T 0.00 0.00 -5.92                                     0.00 0.00 -5.92                                     0.00 0.00 -5.92 Fiser‑M4T 71
72 BHAGEERATH                                                                                                                               BHAGEERATH 72
73 YASARA                                                                                                                               YASARA 73
74 test_http_server_01                                                                                                                               test_http_server_01 74