COMMONWEALTH OF VIRGINIA
DEPARTMENT OF EDUCATION
P. O. BOX 2120
RICHMOND, VIRGINIA 23218-2120
SUPTS. MEMO. NO. 179
November 20, 1998

INFORMATIONAL

TO: Division Superintendents
FROM: Paul D. Stapleton
Superintendent of Public Instruction
SUBJECT: Standards of Learning (SOL) Test Scaled Scores and Equating

 
  As noted in Informational Superintendents Memorandum No.
  159, dated October 30, 1998, your school division will
  receive a second set of reports from the spring 1998
  administration of the Standards of Learning (SOL)
  assessments. These reports will apply the decisions made
  by the Board of Education regarding the passing scores
  for the SOL tests. The purpose of this memo is to explain
  the information provided on the updated reports.  

  SOL Tests:  Achievement Levels Total Test Information

  Student performance on each test will be reported as one
  of three achievement levels:  

   Pass/Advanced
   Pass/Proficient
   Fail.  

  Achievement level results for schools will be reported
  showing the number and percent of students who scored in
  each achievement level.

  SOL Tests:  Scaled Scores Total Test Information

  In addition to the achievement levels, student
  performance on all SOL tests will be reported as scaled
  scores.  For ease in interpretation, the same scaled
  score range of 0 to 600 will be used on each test at each
  grade level. As discussed in Informational Superintendents
  Memo No. 159, dated October 30, 1998, two forms of each
  SOL test are used in each test administration:  one form
  is used as the predominant form (the one taken by most
  students), and the other is the back-up form.  The Board
  of Education established the passing scores for each of
  the SOL tests based on the number of questions a student
  had to answer correctly (also called a raw score) on the
  predominant form. 

  The minimum raw score required for Pass/Proficient has
  been assigned a scaled score of 400.  Any student
  achieving a scaled score from 400 to 600 on any test form
  will have passed that SOL test.  Scaled scores ranging
  from 0 to 399 will always indicate that a student has
  failed the test.  A raw score of zero will be reported as
  a scaled score of zero.

  The Board of Education has established a designation of
  "Pass/Advanced" for those students who achieve a high
  level of performance on an SOL test.  The minimum raw
  score required for "Pass/Advanced" has been assigned a
  scaled score of 500.  Scaled scores ranging from 500 to
  600 will always indicate that the student has passed the
  SOL test and met the criteria for "Pass/Advanced."  A
  scale score of 600 will always indicate a perfect score.  

  The following summarizes this SOL test scaled score
  information: 

   Failure                    0-399
   Pass/Proficient          400-499
   Pass/Advanced            500-600

  The passing scores set by the Board of Education on the
  standard-setting form establish the level of performance
  required of students to pass an SOL test in every
  subsequent administration.  The spring 1998 back-up forms
  and all new SOL test forms will be statistically equated
  to the spring 1998 standard-setting forms.  The objective
  in equating test forms is to ensure that the passing
  scores on these forms are equivalent to the passing
  scores on the standard-setting forms.  Consequently,
  students do not have an advantage or are not penalized
  because they have taken a slightly easier or more
  difficult form of the test. As stated, any student
  achieving a scaled score from 400 to 600 on any test form
  will have passed the SOL test.

  The test development and equating procedures used in
  developing the SOL tests strictly adhere to widely
  accepted test development practices and are similar to
  procedures used in other testing programs to equate
  multiple forms of a test.  Other programs in which these
  procedures have been used include Virginia's Literacy
  Testing Program (LTP) and Minimum Competency Test (MCT),
  the Scholastic Assessment Test (SAT), the Graduate Record
  Exam (GRE), and the Law School Admissions Test (LSAT).

  SOL Tests:  Scaled Scores for Reporting Categories

  Student performance will also be reported for the
  reporting categories that make up each test, as outlined
  in the test blueprints.  Student performance on the
  reporting categories will be reported as scaled scores so
  that progress over time may be measured.  The statewide
  average number of items answered correctly for each
  reporting category in the spring of 1998 has been
  assigned a scaled score of 35.  Thus, for the spring of
  1998 the statewide average scaled score for each
  reporting category will be 35. 

  Future forms of the SOL tests will be developed so that
  reporting category scaled scores from different forms and
  different years may be compared.  A score of 35 will
  represent the same level of performance in subsequent
  years, and will permit the comparison of scores in future
  years to the baseline established in the spring of 1998. 
  For example, a reporting category scaled score of 38.5 in
  the spring of 1999 will represent improvement of 3.5
  points in that reporting category.
  As is the case for the total test score, a raw score of
  zero for a reporting category will be reported as a
  scaled score of zero. Because the passing scores for the
  SOL tests were set only on each test as a whole, no
  achievement level designations (i.e., Pass/Proficient,
  Pass/Advanced, Fail) can be assigned to scores on the
  reporting categories. 

  Phase 2 SOL Reports

  At this time, the testing contractor is preparing the
  Phase 2 SOL reports.  Phase 2 SOL reports are essentially
  the same reports as those issued after the spring
  administration, except that raw scores are now replaced
  by scaled scores and the "Fail," "Pass/Proficient," and
  "Pass/Advanced" designations appear.  The Division of
  Assessment and Reporting is preparing a report
  interpretation package to assist school division
  personnel in interpreting the Phase 2 reports.  In the
  coming weeks your Division Director of Testing will
  receive further information regarding the Phase 2 SOL
  report interpretation package.  We appreciate your
  continued cooperation as we implement the SOL testing
  program.  

  Should you have questions or need additional information,
  please call Cam Harris or staff of the Division of
  Assessment and Reporting at (804) 225-2102.

  PDS/CMH