[GoTo Human/Server Evaluation]

CASP8 Server only Evaluation

Domain: FM: Best-Score scores

This web-page is non-intuitive, but loaded with action. READ THIS:

WARNING: these tables are generated automatically and do not represent the final word in CASP8 assessment. For other automatic evaluations see Baker, Cheng, McGuffin, Zhang.

questions, comments, suggestions: shuoyong.shi@utsouthwestern.edu

get the list of target PDB codes; get target category assignment and domain definitions; get all evaluation tables in a text file
get renumbered and edited to match target sequences PDB coordinates; learn about 'random predictions'
read about NMR structures we processed, target categories we defined and scores we used; see the discussion of whole chain vs. domain evaluation

Target Categories in CASP8 First Score from First model only
CM_easy: Top 10 First-GTD_TS avg ≥ 81 Best Score from Best scoring model (up to 5)
CM_medium: Top 10 First-GDT_TS avg ≥ 67 Z-score Z-score computed on the target scores
CM_hard: Top 10 First-GDT_TS avg ≥ 52 TS GDT_TS score by LGA 1)
FR: Top 10 First-GDT_TS avg ≥ 30 TR GDT_TS score by LGA 1) minus penalty
FM: Top 10 First-GDT_TS avg < 30 CS Contact score based on intramolecular distances
All Targets: Everything combined SUM The sum of scores for all models

1) Zemla A. (2003) "LGA: A method for finding 3D similarities in protein structures." Nucleic Acids Research, 31(13):3370-3374; PMID: 12824330

CM_easy: [First-score] [First-Z score] [Best-score] [Best-Z score]
CM_medium: [First-score] [First-Z score] [Best-score] [Best-Z score]
CM_hard: [First-score] [First-Z score] [Best-score] [Best-Z score]
FR: [First-score] [First-Z score] [Best-score] [Best-Z score]
FM: [First-score] [First-Z score] [Best-score] [Best-Z score]   [GoTo Evaluation on whole chain]
All Targets: [First-score] [First-Z score] [Best-score] [Best-Z score]

5 domains: text file [GoTo Human/Server Evaluation]

# GROUP ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ TS ↓ TR ↓ CS ↓ ↓ GROUP #
SUM 397_1 405_2 407_2 465 496_1 SUM
alig targ
alig targ
alig targ
alig targ
alig targ
1 MUFOLD‑MD 146.01 127.27 195.45 33.54 31.10 36.68 31.70 27.15 38.81 26.29 22.34 33.98 25.41 20.73 42.18 29.07 25.95 43.80 146.01 127.27 195.45 MUFOLD‑MD 1
2 BAKER‑ROBETTA 145.11 113.55 188.78 29.57 23.88 32.47 23.57 19.42 38.80 31.70 23.80 34.35 31.20 23.35 44.13 29.07 23.10 39.03 145.11 113.55 188.78 BAKER‑ROBETTA 2
3 Zhang‑Server 140.47 112.75 194.23 29.57 22.46 36.66 20.57 14.43 35.85 32.73 26.89 37.13 29.75 24.38 45.21 27.85 24.59 39.38 140.47 112.75 194.23 Zhang‑Server 3
4 RBO‑Proteus 137.23 118.71 186.75 35.06 30.39 36.15 24.64 19.50 37.26 20.36 19.16 24.53 28.72 24.73 48.03 28.45 24.93 40.78 137.23 118.71 186.75 RBO‑Proteus 4
5 pro‑sp3‑TASSER 135.22 117.65 180.87 27.44 23.48 33.84 16.87 15.03 29.51 43.56 37.54 41.86 24.38 20.80 42.02 22.97 20.80 33.64 135.22 117.65 180.87 pro‑sp3‑TASSER 5
6 Phyre_de_novo 131.62 114.22 172.98 28.05 25.51 34.60 15.79 13.91 27.09 44.59 40.46 46.66 19.21 16.32 31.74 23.98 18.02 32.89 131.62 114.22 172.98 Phyre_de_novo 6
7 FALCON 129.45 111.56 188.19 32.32 30.29 39.72 21.29 17.70 35.15 19.84 16.41 25.80 31.20 24.73 46.74 24.80 22.43 40.78 129.45 111.56 188.19 FALCON 7
8 PSI 122.09 102.51 175.44 25.61 21.34 32.73 21.29 17.70 35.15 22.16 19.59 19.78 23.76 19.49 42.92 29.27 24.39 44.86 122.09 102.51 175.44 PSI 8
9 METATASSER 120.91 105.33 183.45 33.54 27.85 42.74 17.70 16.19 33.20 22.16 19.24 29.69 21.90 19.15 43.60 25.61 22.90 34.22 120.91 105.33 183.45 METATASSER 9
10 RAPTOR 118.97 104.50 175.26 25.30 21.85 31.55 19.98 16.07 32.22 24.74 23.02 29.23 22.73 20.52 43.47 26.22 23.04 38.79 118.97 104.50 175.26 RAPTOR 10
11 FALCON_CONSENSUS 116.76 101.94 153.44 32.32 30.29 37.62 21.29 17.70 35.15 7.99 6.79 -3.51 29.96 24.73 46.74 25.20 22.43 37.44 116.76 101.94 153.44 FALCON_CONSENSUS 11
12 MULTICOM‑CLUSTER 115.96 104.88 154.07 33.54 30.49 41.28 15.55 13.72 21.17 22.16 21.31 24.40 24.59 20.73 43.31 20.12 18.63 23.91 115.96 104.88 154.07 MULTICOM‑CLUSTER 12
13 fais‑server 115.51 97.03 179.78 25.00 20.43 39.03 20.69 18.22 33.76 22.68 18.13 29.21 24.17 21.01 42.88 22.97 19.24 34.90 115.51 97.03 179.78 fais‑server 13
14 BioSerf 113.26 94.82 157.51 24.39 22.66 27.07 16.87 12.28 28.81 22.16 17.87 23.80 27.89 21.69 41.57 21.95 20.32 36.26 113.26 94.82 157.51 BioSerf 14
15 Pcons_dot_net 113.00 89.40 148.41 29.57 23.88 32.47 23.57 19.42 38.80 0.00 0.00 -5.92 31.20 23.00 44.13 28.66 23.10 38.93 113.00 89.40 148.41 Pcons_dot_net 15
16 Distill 112.38 93.52 156.17 26.52 21.65 30.66 17.46 14.59 28.72 17.01 15.29 21.89 23.14 20.04 35.63 28.25 21.95 39.27 112.38 93.52 156.17 Distill 16
17 Poing 112.04 96.37 139.37 26.52 24.09 37.27 12.92 10.37 19.05 25.77 21.13 27.49 17.56 15.98 24.13 29.27 24.80 31.43 112.04 96.37 139.37 Poing 17
18 PS2‑server 110.89 96.05 161.00 26.83 23.68 38.35 15.55 13.24 25.40 25.26 21.22 30.65 22.52 18.80 35.80 20.73 19.11 30.80 110.89 96.05 161.00 PS2‑server 18
19 FEIG 110.64 96.76 153.22 32.93 26.83 41.36 13.99 12.32 20.44 15.72 15.55 24.37 26.86 23.97 39.59 21.14 18.09 27.46 110.64 96.76 153.22 FEIG 19
20 MULTICOM‑REFINE 110.01 93.82 151.23 29.27 23.58 33.47 14.12 13.48 23.76 22.94 18.64 26.96 24.17 19.56 40.62 19.51 18.56 26.42 110.01 93.82 151.23 MULTICOM‑REFINE 20
21 MUProt 108.36 94.23 149.62 29.27 23.58 33.47 15.31 13.48 23.76 20.10 18.64 27.75 24.17 19.97 40.62 19.51 18.56 24.02 108.36 94.23 149.62 MUProt 21
22 SAM‑T08‑server 107.57 94.64 148.38 23.17 19.82 30.79 19.14 16.67 25.76 16.50 15.12 22.04 24.17 21.01 40.68 24.59 22.02 29.11 107.57 94.64 148.38 SAM‑T08‑server 22
23 nFOLD3 106.99 93.08 142.10 29.88 25.20 30.26 13.16 11.28 23.60 20.88 17.44 24.69 23.76 20.32 32.38 19.31 18.84 31.17 106.99 93.08 142.10 nFOLD3 23
24 Phragment 106.72 90.09 140.06 23.78 20.32 30.84 17.82 15.03 21.46 21.91 19.16 26.88 19.63 17.42 28.02 23.58 18.16 32.86 106.72 90.09 140.06 Phragment 24
25 MULTICOM‑CMFR 102.76 89.37 144.10 22.87 20.43 31.26 14.23 13.60 23.77 24.23 21.13 30.82 22.73 15.98 31.93 18.70 18.23 26.32 102.76 89.37 144.10 MULTICOM‑CMFR 25
26 forecast 102.32 87.02 125.51 25.30 21.85 32.07 15.79 14.79 22.42 21.91 15.89 25.52 18.39 17.01 20.70 20.93 17.48 24.80 102.32 87.02 125.51 forecast 26
27 Phyre2 101.39 90.91 135.91 25.61 20.02 29.68 11.60 10.61 21.85 23.20 22.16 29.98 20.25 19.28 29.12 20.73 18.84 25.28 101.39 90.91 135.91 Phyre2 27
28 FAMSD 100.82 90.50 144.93 23.78 21.75 27.46 14.47 12.48 28.62 20.36 18.30 27.55 21.07 18.32 31.52 21.14 19.65 29.78 100.82 90.50 144.93 FAMSD 28
29 MUSTER 99.82 88.16 144.37 27.13 24.19 29.19 13.16 11.01 25.91 16.50 13.57 22.57 21.28 18.18 35.05 21.75 21.21 31.65 99.82 88.16 144.37 MUSTER 29
30 MUFOLD‑Server 98.88 77.06 148.57 22.87 19.21 36.69 12.80 9.61 25.89 21.39 14.35 23.16 22.11 17.70 33.91 19.71 16.19 28.92 98.88 77.06 148.57 MUFOLD‑Server 30
31 mariner1 98.51 85.31 118.73 24.09 19.21 25.71 13.40 12.52 21.58 21.65 18.81 23.22 20.87 17.49 21.33 18.50 17.28 26.89 98.51 85.31 118.73 mariner1 31
32 MULTICOM‑RANK 97.39 86.86 140.92 21.65 19.11 32.83 13.64 12.08 22.24 20.88 17.27 26.82 22.52 19.90 32.61 18.70 18.50 26.42 97.39 86.86 140.92 MULTICOM‑RANK 32
33 HHpred4 95.42 75.76 102.34 22.56 15.85 24.93 9.45 7.66 5.97 15.21 13.14 18.59 26.86 22.04 31.31 21.34 17.07 21.54 95.42 75.76 102.34 HHpred4 33
34 mGenTHREADER 95.35 86.34 117.86 29.88 25.00 34.05 14.12 13.56 16.95 16.50 15.12 17.59 17.98 16.67 30.44 16.87 15.99 18.83 95.35 86.34 117.86 mGenTHREADER 34
35 SAM‑T06‑server 93.75 80.47 116.97 18.90 17.68 17.70 12.68 12.20 22.86 17.53 14.95 23.85 20.45 16.94 28.11 24.19 18.70 24.45 93.75 80.47 116.97 SAM‑T06‑server 35
36 pipe_int 92.72 80.26 129.05 19.51 17.18 26.70 15.67 13.80 29.85 16.50 13.92 23.14 23.97 20.39 19.19 17.07 14.97 30.17 92.72 80.26 129.05 pipe_int 36
37 3Dpro 91.22 81.40 125.28 22.26 20.22 25.98 16.03 13.36 22.99 17.27 17.27 23.70 17.98 16.12 28.71 17.68 14.43 23.90 91.22 81.40 125.28 3Dpro 37
38 3D‑JIGSAW_AEP 89.55 78.16 81.03 19.51 17.48 18.34 11.24 9.77 2.32 14.69 13.66 8.24 25.41 20.52 30.31 18.70 16.73 21.82 89.55 78.16 81.03 3D‑JIGSAW_AEP 38
39 HHpred2 89.30 79.57 97.32 21.04 19.71 25.65 9.45 7.66 5.97 13.66 13.49 15.61 26.86 22.86 29.39 18.29 15.85 20.70 89.30 79.57 97.32 HHpred2 39
40 HHpred5 88.24 74.29 105.24 20.73 18.80 24.90 9.45 7.66 5.97 13.92 11.43 18.12 26.86 22.04 31.31 17.28 14.36 24.94 88.24 74.29 105.24 HHpred5 40
41 3D‑JIGSAW_V3 88.23 78.08 50.62 18.90 15.85 7.52 9.69 8.49 -8.08 17.78 16.07 8.64 23.97 21.07 22.14 17.89 16.60 20.40 88.23 78.08 50.62 3D‑JIGSAW_V3 41
42 ACOMPMOD 87.85 76.27 114.69 19.51 16.57 21.14 11.48 11.04 20.41 18.56 15.21 21.82 18.59 15.70 21.48 19.71 17.75 29.84 87.85 76.27 114.69 ACOMPMOD 42
43 FOLDpro 86.15 76.95 114.27 21.95 20.22 26.01 10.65 9.81 18.05 17.27 17.27 23.70 19.21 15.29 27.34 17.07 14.36 19.17 86.15 76.95 114.27 FOLDpro 43
44 huber‑torda‑server 85.03 71.18 66.45 30.18 24.09 22.66 16.15 13.88 12.70                   17.56 13.43 12.43 21.14 19.78 18.66 85.03 71.18 66.45 huber‑torda‑server 44
45 RANDOM 84.99 71.91 84.99 19.60 16.84 19.60 11.91 10.16 11.91 18.81 15.96 18.81 17.30 14.39 17.30 17.37 14.56 17.37 84.99 71.91 84.99 RANDOM 45
46 3DShot2 84.16 70.08 91.69 18.90 15.55 18.65 11.84 9.97 16.84 14.18 11.60 18.61 25.62 22.25 32.06 13.62 10.71 5.53 84.16 70.08 91.69 3DShot2 46
47 circle 83.18 72.76 118.74 31.10 24.59 36.12 12.32 11.72 22.83 0.00 0.00 -5.92 19.84 16.80 34.49 19.92 19.65 31.22 83.18 72.76 118.74 circle 47
48 GS‑MetaServer2 82.91 73.14 102.54 18.29 15.65 18.65 14.47 13.68 20.81 14.43 13.57 20.68 22.31 18.59 31.38 13.41 11.65 11.02 82.91 73.14 102.54 GS‑MetaServer2 48
49 Frankenstein 82.61 75.81 104.83 12.80 10.98 -2.01 13.16 12.00 22.67 15.21 15.03 24.06 23.35 20.52 34.19 18.09 17.28 25.92 82.61 75.81 104.83 Frankenstein 49
50 keasar‑server 81.52 72.20 99.52 32.01 26.52 38.21 11.84 10.13 12.74                   16.74 15.56 17.21 20.93 19.99 31.36 81.52 72.20 99.52 keasar‑server 50
51 COMA‑M 80.93 71.22 76.27 21.04 19.00 25.87 11.72 10.61 11.69 0.00 0.00 -5.92 25.41 21.56 15.75 22.76 20.05 28.88 80.93 71.22 76.27 COMA‑M 51
52 Pcons_local 80.65 71.68 83.70 19.82 15.96 22.67 12.44 11.28 21.66 10.82 9.97 5.00 23.14 20.45 33.61 14.43 14.02 0.76 80.65 71.68 83.70 Pcons_local 52
53 COMA 80.62 71.53 76.27 20.73 19.31 25.87 11.72 10.61 11.69 0.00 0.00 -5.92 25.41 21.56 15.75 22.76 20.05 28.88 80.62 71.53 76.27 COMA 53
54 schenk‑torda‑server 78.18 72.05 102.12 20.12 19.11 22.56 11.01 9.73 14.12 16.50 15.12 20.97 16.12 14.95 21.03 14.43 13.14 23.44 78.18 72.05 102.12 schenk‑torda‑server 54
55 GS‑KudlatyPred 77.53 64.16 94.15 10.98 9.35 -5.72 9.57 7.54 17.96 0.00 0.00 -5.92 28.93 23.83 41.13 28.05 23.44 46.70 77.53 64.16 94.15 GS‑KudlatyPred 55
56 LOOPP_Server 76.96 67.16 76.83 15.55 14.23 1.33 13.64 12.52 20.68 28.87 23.20 31.15                   18.90 17.21 23.67 76.96 67.16 76.83 LOOPP_Server 56
57 Pcons_multi 72.67 65.84 92.99 20.73 18.50 21.60 11.12 9.41 19.19 0.00 0.00 -5.92 23.14 20.45 32.98 17.68 17.48 25.14 72.67 65.84 92.99 Pcons_multi 57
58 GeneSilicoMetaServer 68.48 59.57 75.94 18.29 15.65 18.65 14.47 13.68 20.81 0.00 0.00 -5.92 22.31 18.59 31.38 13.41 11.65 11.02 68.48 59.57 75.94 GeneSilicoMetaServer 58
59 FUGUE_KM 63.37 56.63 54.68                   11.84 10.57 18.04 18.56 16.84 22.73 15.29 13.57 5.73 17.68 15.65 8.18 63.37 56.63 54.68 FUGUE_KM 59
60 LEE‑SERVER 60.10 53.91 89.63 24.70 22.66 33.32 16.39 14.51 24.43                   19.01 16.74 31.88                   60.10 53.91 89.63 LEE‑SERVER 60
61 mahmood‑torda‑server 54.64 45.64 70.01 23.48 18.50 23.81                                     16.12 14.74 22.81 15.04 12.40 23.39 54.64 45.64 70.01 mahmood‑torda‑server 61
62 OLGAFS 53.26 50.46 -0.34 16.77 16.06 16.73 8.01 7.82 -14.39                   14.46 13.91 -9.80 14.02 12.67 7.12 53.26 50.46 -0.34 OLGAFS 62
63 panther_server 46.82 41.58 -17.52 17.38 15.14 4.74                   4.64 4.30 -5.33 12.81 11.43 -7.14 11.99 10.71 -9.79 46.82 41.58 -17.52 panther_server 63
64 SAM‑T02‑server 45.39 40.01 19.40 0.00 0.00 -9.70 11.36 10.49 6.82 0.00 0.00 -5.92 17.36 15.56 7.66 16.67 13.96 20.54 45.39 40.01 19.40 SAM‑T02‑server 64
65 CpHModels 36.19 32.95 -16.73 0.00 0.00 -9.70 13.88 12.84 13.45 0.00 0.00 -5.92 22.31 20.11 6.51 0.00 0.00 -21.07 36.19 32.95 -16.73 CpHModels 65
66 FFASsuboptimal 36.18 31.87 -26.50 0.00 0.00 -9.70 6.82 5.98 -11.70 0.00 0.00 -5.92 17.77 17.29 -0.56 11.59 8.60 1.38 36.18 31.87 -26.50 FFASsuboptimal 66
67 FFASstandard 34.57 27.78 -27.99 5.49 4.67 -8.77 11.72 8.65 8.38 0.00 0.00 -5.92 17.36 14.46 -0.61 0.00 0.00 -21.07 34.57 27.78 -27.99 FFASstandard 67
68 Pushchino 30.73 27.60 -19.04 21.04 18.39 16.23 9.69 9.21 3.44 0.00 0.00 -5.92 0.00 0.00 -32.79                   30.73 27.60 -19.04 Pushchino 68
69 rehtnap 29.21 25.64 -73.82 0.00 0.00 -9.70 3.47 3.35 -24.85 16.24 13.06 7.49 9.50 9.23 -25.69 0.00 0.00 -21.07 29.21 25.64 -73.82 rehtnap 69
70 FFASflextemplate 28.01 22.47 -16.31 0.00 0.00 -9.70 10.65 8.01 -0.08 0.00 0.00 -5.92 17.36 14.46 -0.61                   28.01 22.47 -16.31 FFASflextemplate 70
71 Fiser‑M4T 0.00 0.00 -5.92                                     0.00 0.00 -5.92                                     0.00 0.00 -5.92 Fiser‑M4T 71
72 BHAGEERATH                                                                                                                               BHAGEERATH 72
73 YASARA                                                                                                                               YASARA 73
74 test_http_server_01                                                                                                                               test_http_server_01 74