BA 5 Year Program Effectiveness Study
Comments
Content
!
!
Program'Effectiveness'Evidence'
As! a! Supplemental! Educational! Services! provider,! Brilliance! Academy! constantly! monitors! student!
academic!achievement.!By!maintaining!focus!on!achievement,!we!can!ensure!program!effectiveness!and!
positive!outcomes!for!students!and!schools.!!
!
Students!in!both!programs!are!assessed!using!the!Basic!Achievement!Skills!Inventory!(BASI)!standardized!
assessment.! The! BASI! is! aligned! to! state! and! national! academic! standards.! Yielding! standard! scores,!
national! percentile! rankings,! grade! equivalency,! and! performance! classification! by! learning! objective,!
the! results! of! the! BASI! provide! Brilliance! with! a! reliable! metric! to! predict! student! achievement! in! the!
classroom! and! to! ensure! maximum! accountability.! The! initial! BASI! assessment! scores! are! used! to!
prescribe! individualized! curriculum! for! each! student.! Upon! completion! of! the! program,! students! are!
again!assessed!using!the!BASI.!The!pre<!and!post<assessment!scores!are!compiled!by!Brilliance!Academy.!!
!
The!following!pages!are!a!compilation!of!BASI!pre<!and!post<!assessment!results!from!past!school!years.!
The!numbers!reflect!all!students!served!in!each!grade!level!and!subject!area.!The!bar!graphs!show!the!
difference!in!pre<!and!post<assessment!scores,!separated!by!grade!and!subject!area.!Certain!school!years!
show! a! “zero”! for! various! subjects! because! no! students! were! served! in! that! grade.! Following! the! bar!
graphs! is! a! chart! depicting! population! size,! average! pre<! and! post<test! scores,! difference,! standard!
deviation,!and!effect!size.!!
!
The! effect! size! shows! the! average! difference! between! pre<! and! post<assessment! results! without!
discussing!the!variability!within!the!groups.!In!other!words,!the!effect!size!shows!the!effectiveness!of!our!
programs.! For! example,! if! the! effect! size! were! 0.0,! the! percentage! of! pre<test! scores! that! would! be!
below! the! average! student! post<test! score! would! be! fifty! percent.! As! you! can! see! from! the! chart,! our!
effect! sizes! are! significantly! higher! than! 0.0.! For! example,! during! the! 2008<09! school! year,! Reading!
scores!for!grade!5!showed!a!0.5!effect!size.!Therefore,!about!68%!of!students!improved!their!results!on!
the!post<assessment!BASI.!Our!effect!sizes!show!an!impressive!amount!of!improvement!across!the!grade!
levels!and!subject!areas.!Improvements!of!this!nature!can!only!be!attributed!to!the!unique!nature!of!our!
program,!allowing!students!to!start!at!their!exact!academic!level!and!proceed!at!their!own!pace!towards!
success.!!
!
!
!
!
5940!West!Touhy!
!
!
!
!Niles,!Illinois!!60714!
!
!
!phone!(847)559<7464!
!fax!(866)782<6769!!
Brilliance Academy
# of Students per Year per Grade
450
400
350
300
250
2005 2006
200
2006 2007
150
2007 2008
2008 2009
100
50
0
GradeGradeGrade GradeGradeGradeGradeGradeGradeGrade GradeGrade
1
2
3
4
5
6
7
8
9
10
11 12
Brilliance Academy
20
15
10
5
0
9.65
15.2
12.88
0
Grade 2 Reading Increases by Year
Difference
Difference
Grade 1 Reading Increases by Year
15
10.91
12.91
10.49
10
5
0
0
School Year
School Year
*No Students were enrolled for 2007 08 for both the 1st and 2nd Grade
20
15
10
5
0
Grade 4 Reading Increases by Year
16.89
16.25
12.37
Difference
Difference
Grade 3 Reading Increases by Year
4.85
25
20
15
10
5
0
11.72
School Year
13.06
Difference
Difference
10.64
25
20
15
10
5
0
20.85
8.96
School Year
15.34
6.77
5.28
School Year
8.31
Grade 8 Reading Increases by Year
Difference
Difference
12.63
12.1
School Year
Grade 7 Reading Increases by Year
20
15
10
5
0
19.37
Grade 6 Reading Increases by Year
18.89
11.7
18.83
School Year
Grade 5 Reading Increases by Year
20
15
10
5
0
14.68
15
10
5
0
13.63
13.3
6.61
8.16
School Year
Brilliance Academy
20
15
10
5
0
Grade 10 Reading Increases by
Year
15.17
10.43
0
Difference
Difference
Grade 9 Reading Increases by Year
2.34
School Year
15
10
5
0
11.44
0
0
4.78
School Year
*No Students were enrolled for 2006 07 for the 9th Grade and 2006 07 and 2007 08 for 10th Grade
Difference
Grade 11 Reading Increases by Year
25
20
15
10
5
0
19.44
0
0
0
School Year
*No Students were enrolled for 2006 07, 2007 08 and 2008 09 for the 11th Grade
Brilliance Academy
25
20
15
10
5
0
Grade 2 Writing Increases by Year
22.38
18.27
5.07
Difference
Difference
Grade 1 Writing Increases by Year
0
20
15
10
5
0
14.68
13.75
6.18
0
School Year
School Year
*No Students were enrolled for 2007 08 for both the 1st and 2nd Grade
20
15
10
5
0
Grade 4 Writing Increases by Year
17.46
13.22
12.99
12.6
15
Difference
Difference
Grade 3 Writing Increases by Year
14.07
10.26
5
0
School Year
Grade 5 Writing Increases by Year
11.61
11.32
5
Difference
Difference
12.89
Grade 6 Writing Increases by Year
14.22
14 22
10
0
20
15
10
5
0
8.4
School Year
12.5
9.33
School Year
14.51
7.95
9.62
Grade 8 Writing Increases by Year
Difference
Difference
11.25
11.26
School Year
Grade 7 Writing Increases by Year
15
10
5
0
11.98
10
School Year
15
12.3
20
15
10
5
0
14.15
11.71
6.63
School Year
15.4
Brilliance Academy
40
30
20
10
0
Grade 10 Writing Increases by Year
34.97
19.95
Difference
Difference
Grade 9 Writing Increases by Year
19.11
0
School Year
20
15
10
5
0
14.93
11.5
0
0
School Year
*No Students were enrolled for 2006 07 for the 9th Grade and 2006 07 and 2007 08 for 10th Grade
Grade 11 Writing Increases by Year
Difference
15
13.94
10
5
0
0
0
0
School Year
*No Students were enrolled for 2006 07,
07 2007 08 and 2008 09 for the 11th Grade
Brilliance Academy
25
20
15
10
5
0
17.53
Grade 2 Math Increases by Year
21.71
13.33
0
Difference
Difference
Grade 1 Math Increases by Year
40
30
20
10
0
18.53
0
School Year
School Year
26.38
29.02
Grade 4 Math Increases by Year
28.45
Difference
Difference
Grade 3 Math Increases by Year
35
30
25
20
15
10
5
0
17.17
30
25
20
15
10
5
0
25.6
15.03
School Year
21.63
38.91
30.67
Grade 6 Math Increases by Year
Difference
Difference
Grade 5 Math Increases by Year
28.38
40
30
20
10
0
33
25
33.25
21.79
School Year
11.87
Difference
Difference
23.48
School Year
9.67
Grade 8 Math Increases by Year
30.7
23.14
17.35
School Year
Grade 7 Math Increases by Year
35
30
25
20
15
10
5
0
22.26
9.53
School Year
50
40
30
20
10
0
29.25
23.66
40
30
20
10
0
33.56
16.94
19.44
8.64
School Year
Brilliance Academy
50
40
30
20
10
0
Grade 10 Math Increases by Year
42.51
34.92
20.19
0
School Year
Difference
19.24
0
0
School Year
40
35
30
25
20
15
10
5
0
35.74
25.75
0
0
School Year
Grade 11 Math Increases by Year
25
20
15
10
5
0
Difference
Difference
Grade 9 Math Increases by Year
0
Brilliance Academy
Avg Reading Increases By Grade, 2005 06
Grade 11
19.44
11.44
10.43
Grade 9
Grade 7
13.63
12.63
8.96
Grade 5
Grade 3
Grade 1
9.65
0
5
11.7
11.72
12.37
10.91
10
15
20
25
Average Difference
Avg Reading Increases By Grade, 2006 07
0
0
0
Grade 10
6.61
6.77
Grade 7
12.1
Grade 4
14.68
12.91
12.88
Grade 1
0
2
4
6
8
10
12
14
18.89
16.25
16
18
20
Average Difference
*No Students were enrolled for 2006 07 for the 9th, 10th and 11th Grades
Avg Reading Increases By Grade, 2007 08
0
0
Grade 10
2.34
Grade 7
8.16
8.31
5.28
Grade 4
0
0
Grade 1
0
10.64
18.83
4.85
2
4
6
8
10
12
14
16
18
20
Average Difference
*No Students were enrolled for 2007 08 for the 1st, 2nd, 10th and 11th Grades
Avg Reading Increases By Grade, 2008 09
0
Grade 10
Grade 7
Grade 4
Grade 1
4.78
13.3
13.06
10.49
0
5
10
15.17
15.34
15.2
15
16.89
19.37
20
Average Difference
*No Students were enrolled for 2008 09 for the 11th Grade
20.85
25
Brilliance Academy
Avg Writing Increases By Grade, 2005 06
Grade 11
13.94
11.5
Grade 9
6.63
Grade 7
11.25
8.4
Grade 5
Grade 3
12.89
14.07
13.22
6.18
Grade 1
0
19.95
18.27
5
10
15
20
25
Average Difference
Avg Writing Increases By Grade, 2006 07
0
0
0
Grade 10
Grade 7
Grade 4
14.22
10.26
Grade 1
14.15
12.5
11.26
12.99
14.68
5.07
0
2
4
6
8
10
12
14
16
Average Difference
*No Students were enrolled for 2006 07 for the 9th, 10th and 11th Grades
Avg Writing Increases By Grade, 2007 08
0
0
Grade 10
Grade 7
Grade 4
Grade 1
7.95 9.33
0
0
0
5
19.11
11.71
11.61
12.3
12.6
10
15
20
25
Average Difference
*No Students were enrolled for 2007 08 for the 1st, 2nd, 10th and 11th Grades
Avg Writing Increases By Grade, 2008 09
0
Grade 10
Grade 7
Grade 4
Grade 1
0
14.93
15.4
9.62
14.51
11.32
11.98
13.75 17.46
5
10
15
34.97
22.38
20
25
30
Average Difference
*No Students were enrolled for 2008 09 for the 11th Grade
35
40
Brilliance Academy
Avg Math Increases By Grade, 2005 06
Grade 11
19.24
Grade 9
16.94
Grade 7
Grade 5
9.53
Grade 3
5
23.14
21.79
21.63
17.17
18.53
17.53
Grade 1
0
25.75
20.19
10
15
20
25
30
Average Difference
Avg Math Increases By Grade, 2006 07
0
0
0
Grade 10
19.44
Grade 7
23.48
17.35
Grade 4
Grade 1
21.71
0
5
10
15
23.66
20
25.6
26.38
28.38
25
30
Average Difference
*No Students were enrolled for 2006 07 for the 9th, 10th and 11th Grades
Avg Math Increases By Grade, 2007 08
0
0
Grade 10
Grade 7
30.7
Grade 4
22.26
0
5
10
15
20
42.51
38.91
29.02
0
0
Grade 1
33.56
33.25
25
30
35
40
45
Average Difference
*No Students were enrolled for 2007 08 for the 1st, 2nd, 10th and 11th Grades
Avg Math Increases By Grade, 2008 09
0
Grade 10
Grade 7
Grade 4
Grade 1
35.74
34.92
8.64 11.87
9.67
30.67
28.45
29.25
15.03
13.33
0
5
10
15
20
25
30
Average Difference
*No Students were enrolled for 2008 09 for the 11th Grade
35
40
Brilliance Academy
Grade
1
1
1
2
2
2
3
3
3
4
4
4
5
5
5
6
6
6
7
7
7
8
8
8
9
9
9
10
10
10
11
11
11
Subject
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Pop. Size
32
32
32
11
11
11
23
23
23
30
30
30
23
23
23
24
24
24
44
44
44
48
48
48
21
21
21
25
25
25
17
17
17
Year
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005/2006
2005 2006
Pretest
39.49
35.08
50.31
25.91
22.45
42.55
48.98
31.26
60.30
34.73
37.27
59.50
35.70
31.81
46.71
32.83
47.74
47.75
33.52
49.68
47.39
41.62
43.38
50 48
50.48
43.52
37.48
52.81
26.44
43.00
45.00
33.74
45.00
50.18
Posttest
49.14
53.34
67.84
36.82
28.64
61.27
61.35
44.48
77.48
46.45
51.33
69.03
47.39
44.70
59.92
41.79
56.15
69.54
46.15
60.93
70.52
55.25
50.01
67 42
67.42
53.95
57.43
73.00
37.88
54.50
70.75
53.18
58.94
69.41
Difference
9.65
18.27
17.53
10.91
6.18
18.73
12.37
13.22
17.17
11.72
14.07
9.53
11.70
12.89
21.63
8.96
8.40
21.79
12.63
11.25
23.14
13.63
6.63
16 94
16.94
10.43
19.95
20.19
11.44
11.50
25.75
19.44
13.94
19.24
SDpre
33.00
34.35
28.81
31.53
17.37
29.94
33.48
28.02
25.57
28.71
30.62
25.32
33.42
33.42
29.30
30.11
35.88
28.03
31.28
31.21
29.78
33.81
33.83
25 73
25.73
34.00
31.01
27.94
26.07
29.82
37.96
29.57
30.47
30.17
SDpost
32.74
35.35
25.85
32.11
14.11
33.12
34.28
29.49
17.88
26.80
31.47
21.59
36.86
36.86
28.03
31.92
37.63
26.16
30.80
30.65
20.94
30.99
32.47
23 51
23.51
32.60
26.55
25.10
27.38
27.59
32.43
29.33
28.73
25.84
Effect Size
0.29
0.52
0.64
0.34
0.39
0.59
0.36
0.46
0.79
0.42
0.45
0.41
0.33
0.37
0.46
0.29
0.23
0.80
0.41
0.36
0.91
0.42
0.20
0 69
0.69
0.31
0.69
0.76
0.43
0.40
0.73
0.66
0.47
0.69
Brilliance Academy
Grade
1
1
1
2
2
2
3
3
3
4
4
4
5
5
5
6
6
6
7
7
7
8
8
8
Subject
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Pop. Size
136
136
136
121
121
121
141
141
141
155
155
155
138
138
138
333
333
333
403
403
403
389
389
389
Year
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006/2007
2006 2007
Pretest
48.24
49.06
50.69
47.93
52.34
46.74
48.28
52.06
48.46
47.46
52.28
52.08
43.91
49.20
52.40
54.18
49.04
50.57
54.83
47.61
47.36
54.17
49.81
50.34
Posttest
61.11
54.13
72.40
60.84
67.02
70.40
64.53
65.05
74.84
62.14
62.55
77.68
62.80
63.42
80.78
66.28
60.30
67.92
61.60
60.11
70.84
60.78
63.96
69.78
Difference
12.88
5.07
21.71
12.91
14.68
23.66
16.25
12.99
26.38
14.68
10.26
25.60
18.89
14.22
28.38
12.10
11.26
17.35
6.77
12.50
23.48
6.61
14.15
19.44
SDpre
29.28
28.64
28.45
27.33
28.89
28.45
28.72
29.34
28.77
29.05
27.82
27.13
28.76
28.32
30.09
29.74
29.19
28.32
29.26
29.49
28.03
29.98
28.57
29.02
SDpost
29.77
30.10
26.12
27.77
29.23
27.62
26.85
31.47
28.93
27.91
30.65
25.12
26.01
29.44
25.56
31.86
30.66
28.54
33.30
30.60
25.04
33.28
30.24
26.50
Effect Size
0.44
0.17
0.80
0.47
0.51
0.84
0.58
0.43
0.91
0.52
0.35
0.98
0.69
0.49
1.02
0.39
0.38
0.61
0.22
0.42
0.89
0.21
0.48
0.70
Brilliance Academy
Grade
3
3
3
4
4
4
5
5
5
6
6
6
7
7
7
8
8
8
9
9
9
Subject
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Pop. Size
174
174
174
114
114
114
117
117
117
106
106
106
141
141
141
97
97
97
47
47
47
Year
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007/2008
2007 2008
Pretest
53.70
49.93
30.72
50.43
49.70
23.28
48.56
51.32
16.58
47.61
52.96
19.06
52.57
55.45
19.57
48.84
47.63
11.88
46.83
51.04
17.21
Posttest
58.55
62.53
59.74
69.26
62.00
45.54
59.20
62.93
55.49
55.92
60.92
52.31
57.84
64.78
49.65
57.00
59.34
45.43
49.17
70.15
59.72
Difference
4.85
12.60
29.02
18.83
12.30
22.26
10.64
11.61
38.91
8.31
7.95
33.25
5.28
9.33
30.07
8.16
11.71
33.56
2.34
19.11
42.51
SDpre
28.54
29.79
20.09
28.50
26.59
10.58
29.90
28.51
9.78
31.19
30.69
10.17
27.37
28.71
10.51
29.85
31.32
7.88
30.26
51.04
5.63
SDpost
33.34
31.49
20.09
26.43
28.34
26.81
31.74
30.11
27.56
31.16
33.92
26.77
32.42
31.61
29.40
32.08
31.79
28.59
33.17
24.79
23.82
Effect Size
0.16
0.41
1.44
0.69
0.45
1.19
0.35
0.40
2.08
0.27
0.25
1.80
0.18
0.31
1.51
0.26
0.37
1.84
0.07
0.50
2.89
Brilliance Academy
Grade
1
1
1
2
2
2
3
3
3
4
4
4
5
5
5
6
6
6
7
7
7
8
8
8
9
9
9
10
10
10
Subject
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Reading
Writing
Math
Pop. Size
45
45
45
37
37
37
74
74
74
261
261
261
182
182
182
168
168
168
128
128
128
117
117
117
63
63
63
27
27
27
Year
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008/2009
2008 2009
Pretest
52.18
50.51
68.56
56.05
51.31
29.53
46.22
47.95
41.16
48.35
52.12
60.68
51.78
48.94
23.35
49.56
49.53
74.82
51.31
53.20
78.05
53.19
52.80
82.42
50 87
50.87
50.43
17.49
56.04
54.19
9.04
Posttest
67.38
72.89
81.89
66.54
65.06
58.78
63.11
65.41
69.61
67.72
64.10
75.71
64.84
60.27
54.02
70.40
64.04
84.50
66.65
62.82
89.91
66.49
68.19
91.06
66 05
66.05
62.35
52.41
60.81
69.11
44.78
Difference
15.20
22.38
13.33
10.49
13.75
29.25
16.89
17.46
28.45
19.37
11.98
15.03
13.06
11.32
30.67
20.85
14.51
9.67
15.34
9.62
11.87
13.30
15.40
8.64
15 17
15.17
34.97
34.92
4.78
14.93
35.74
SDpre
27.85
26.93
19.23
17.47
25.97
17.07
31.51
29.39
22.30
29.12
29.18
22.29
29.78
28.14
13.62
30.56
26.62
14.85
28.65
28.06
21.29
27.63
28.65
12.53
28 49
28.49
28.18
14.24
24.25
31.13
4.29
SDpost
28.83
21.27
23.32
22.13
32.89
21.56
34.72
25.71
23.89
26.89
31.67
23.43
30.67
30.00
25.15
27.41
30.08
14.85
28.66
31.68
17.38
30.27
27.03
14.21
28 36
28.36
31.36
27.48
30.50
31.72
25.44
Effect Size
0.54
0.93
0.63
0.53
0.47
1.51
0.51
0.63
1.23
0.69
0.39
0.66
0.43
0.39
1.58
0.72
0.51
0.65
0.54
0.32
0.61
0.46
0.55
0.65
0 53
0.53
0.40
1.67
0.17
0.47
2.40
Sponsor Documents