« Expand and Contract | Main | LeaderTalk: The End of an Era »

Picking an Assessment

Many school districts are starting to choose common assessments from third party vendors. Some of this is due to new federal or state regulations, and some of this is due to allowing for an assessment that might be more reliable than one created internally. The purpose of this article is to provide practical advice on how to choose an assessment; it is NOT an endorsement of one company over another.

Psychometric Questions
The first aspect to consider when researching assessments is the psychometrics behind the assessment. In other words... How is this test put together? For example, the assessment should be one that contains field tested and leveled questions--the most common being Webb Leveling. Some other questions you should ask include:
1. How do you scale your assessment?
2. Can we get the Pvalue of each question?
3. Does the assessment correlate to the state assessment?
4. Is a metric being used in the background so that the assessment will be tailored to the student dependent on their answers? If so, what goes into the metric? The time it took students to answer to each question?? Right answers?

Standards Questions
Another area to review when selecting a third party assessment is its alignment to the Common Core or your state's standards in a given subject area. Such an exam will help students and teachers identify areas of strengths and areas in need of improvement. Some guiding questions are:
1. Is there an item map that shows the alignment between the test questions and Common Core or state standards?
2. Who did the alignment of the questions and what is their background?
3. What resources are available to support teachers as they identify students' needs and develop interventions?

Data Analysis
The assessment is only the first piece of an effective assessment plan. A second piece to the puzzle that is just as important is related to data analysis. Teachers and administrators will need easy to read and understandable data analysis; therefore, asking the right questions to third party vendors is essential. Some questions to ask include:
Is there a way to get the results out of the system via Excel or other flat format?
Does the system come equipped with CBM (Curriculum Based Measurement) reports?
How is RTI supported through the use of the assessment?
Is there a model report accessible to customers to review prior to purchasing the system? Are the reprorts available in color? If so, are the colors standardized throughout the tool? For example, does red consistently indicate an area in need of improvement?
Is there a parent portal or a parent component for school to home communication about student progress?
How soon are reports generated after testing?
Is a benchmarking to other clients or to national norms provided? How many records is the benchmarking based?

Nuts and Bolts
Just as important as all of the above is the backend of the system. You need to make sure that it will fit into your current technology. You will also want to inquire about the company and their history in the industry.
How do we get the students' information into the system? Is there any automated way? SIF, Web folder, auto extract, etc.
Is your solution Web based or Web enabled (Enabled means it is mostly Web delivered but you may need to install certain files on each computer)?
Can students take the test on both Mac and PC?
If it is Web based, then what browsers work the best and what plugins are necessary?
Will the assessment and management of the reports be accessible and editable on a tablet and/or IPad or Iphone?
Can you provide references? Can we do a site visit to any of them?
How long have you been in this specific marketplace?

Implementation
The last part that needs to be addressed is the actual implementation of the assessment. Teachers who administer the test will have more confidence doing so if they can experience the tests firsthand. Finally, knowing what the timeline is between signing a contract and obtaining the product should be discussed and confirmed.
1. How is training provided? Onsite training or Web ex? How much professional development is included?
2. What are the credentials of trainers?
3. How quick after the contract is signed should we expect to be up and running?
4. What kind of contract do I need to sign? Make sure the contract does not allow the company to use your district in any promotional material.

There are several aspects to consider when researching third party assessments. The questions noted above provide a glimpse into the types of inquiries educators may make when faced with the decision to purchase of an assessment. Companies in the assessment field are competitive, and educators do not have to settle for anything less than what is best for their districts. Asking challenging questions will help narrow the selection process; thus, you will be well on your way to picking an assessment that will fit the culture and needs of your district.

James Yap and Dr. Teresa Ivey

You must be logged in to leave a comment. Login | Register
Ground Rules for Posting
We encourage lively debate, but please be respectful of others. Profanity and personal attacks are prohibited. By commenting, you are agreeing to abide by our user agreement.
All comments are public.

Advertisement

Recent Comments

Archives

Categories

Technorati

Technorati search

» Blogs that link here

Tags

#ccko9
#eci831
#ic3s21
#passiondriven
1:1
1:1 laptops
21st century
21st Century
21st Century Schools
21st Century skills
21st Century Skills
Abraham Lincoln
Accountability
accountabilty
adifference
administrator
Adolescent Literacy Panel
advice
aldonza
aleccouros
Alfie Kohn
Angela Maiers
aptitude
Arthur Benjamin
Artists
Arts
ASCD
Assessment
astronaut
Author
avatar
basketball
Beyond Discipline
Blog
blogging
blogs
boss
calculus
Capacity
Career and College Readiness
Carnegie Foundation
CEDS
Cell Phones
Challenge
Change
change
Charleston Children's Museum
Chris Anderson
CIES
class blogs
Clay Shirky
College
Colonel Eileen Collins
commenting
commitment
communication
community
Community
comparative
compassion
compensation
Comprehension
Comprhension
computers in the classroom
Constructivism
cookie
Copyright_infringement
Copyright_laws
Council of Conscience
Creativity
creativity
Creativity Conversation
Creativity Index
Cultivate
Dan Pink
death valley
Decision making
dennisar
Derailed
Disruptive Innovation
Divergent
dkuropatwa
Don Quixote
Dr. Jeff
Dr. Jeff Goldstein
Drive
dulcinea
Education
education
Education in the United States
educational change
educational leadership
Educational Leadership
educational technology leadership
Educators
effectiveness
Element
empathy
Enactivism
energy savings
Engage
engineering
Engineering
evaluation
evernote
evsc
Facebook
failure
Feedback
Festival
Film festival
firing
formative and summative assessments
Frank Smith
friendship
Future
Garr Reynolds
georgesiemens
Global
Golden Rule
Grades
green technology
heart
heart of a teacher
High school
high school
Higher Education
Higher Order Thinking Skills
hire
history
HOME
Home School Partnership
Homework
hospitals
humility
I Notice
Ian Jukes
Ideas
Identity crisis
imagination
improvement
Improvement
Indexing
influence
innovation
Innovation
innovation3
innovation3 llc
inspiration
instructional leadership
Interests
international
International Society for Technology in Education
interview
ipad
ISTE
Jayson Richardson
job
Job Readiness
John Seely Brown
K through 12
K-8
Karen Armstrong
karl fisch
kellychristopherson
Kent
leaderhhip coaching
leadershiop
leadership
Leadership
leadership development
leadership management influence
Leadership Resources
lean
learning
Learning
Learning 21st Century
legislation
Lifelong learning
Literacy
Literacy and Learning
Love
Man of La Mancha
management
math
math education
mathematics
Mathematics
mboe
Media literacy
medicine
mentoring
merit pay
mguhlin
Michael Watkins
Minds on Fire
moodle
Motivation
Movies
Multiple choice
NAESP
NASA
national educational technology plan
National Governors Association
NCESSE
Neil Rochelle
netbooks
NETS-A
Norma Rae
Nurture
Obama
one to one
online
online learning
Online Software
Originality
osu
Paradoxical Commandments
Parent Invovlement
Parent Partnership
passion
Passion Driven Classroom
Passion Education
Passion Leadership
performance
pete reilly
peter o'toole
Peter Senge
plagiarism
pln
PLN
plurk
Positive feedback
power
preconceptions
President Kennedy
principal
Principal
principal preparation
priorities
probability
Problem Solving
productivity
Professional development
publishing
read/write web
Reading
Reading Next
Reflection
reform
religion
reorganization
research
saving IT dollars
Schedules
school leadership
School Reform
schooling
Science
science
Scott McCloud
Scott McLeod
Second Life
self management
Seth Godin
Shall We Dance?
Shanghai
SIF
sir ken robinson
Sir Ken Robinson
SLC
Social Media
Social Networking
sophia loren
Standardized test
statistics
STEM
stephaniepacemarshall
stephendownes
strategy leadership
student achievement
student led conferences
suffering
summer
Switzerland
systemic change
Teacher
teacher
Teacher Professional Development
teachers
Teachers College Columbia University
teaching
technology
Technology
technology change
Technology integration
technology research
TED
TED Prize
textbooks
The First 90 Days
thin client
Thinking
Thomas Dewey
Tim Irwin
time management
Time To Act
transformation
transformative change
transitions
Tribes-We Need You To Lead Us
twitter
Twitter
Uniqueness
United States
University
University of Alabama-Birmingham
University of Kentucky
vacation
Value
vision
Vision
Wagner
walkthroughs
Web 2.0
Web Filtering
Webinar
weighting
Whole New Mind
wisdom
Wordle
workforce
World Read Aloud Day
Young People