Testing…In today’s academic environment, testing seems ubiquitous. In elementary, middle, and high schools, students spend hours taking tests while teachers spend hours of class time preparing students to take such tests. Then comes college entrance exams, college placement exams, and tests that purport to judge a student’s readiness for a graduate or professional degree. Upon entering the workforce, many fields require candidates pass licensure exams. It never stops. Yet, for all the time, effort, and money spent on testing, most tests currently provide very little feedback that can help a person learn, grow, or better understand their strengths and weaknesses.
Current tests are not informative because of the psychometrics underlying the test: the way most tests are built, analyzed, and scored. In recent years, a great amount of research has been conducted on the development of newer psychometric methods for building, analyzing, and scoring tests. These newer methods are described using terms such as cognitive diagnosis and cognitive assessment are used to describe some of the underlying premises of such work, all of which fall under the umbrella of the title and content of this workshop: Diagnostic Measurement.
Diagnostic measurement is a field of psychometrics that focuses on providing actionable feedback from tests. This workshop provides a hands-on introduction to the terms, techniques, and methods used for diagnosing what students know. Such diagnostic information can be used to guide decisions regarding students’ instructional needs. Upon completion of the workshop, you will be able to understand the rationale and motivation for using diagnostic measurement methods. You will become well-versed in the state-of-the-art techniques currently used in practice and will be able to use and estimate diagnostic measurement models using new software developed by the instructor.
Overview and Objectives
From a practical point of view, you will see how to develop instruments for diagnosing student abilities and how to create easy-to-use score reports. Additionally, you will be able to interpret results from diagnostic measurement analyses to evaluate what topics and concepts students have mastered. From this information, you will learn how to use profiles to inform remediation plans that focus on a multidimensional view of student progress in achievement. Finally, you will be able to interpret research articles using diagnostic measurement techniques, thereby allowing you a better opportunity to integrate such methods into your active testing or research program.
Upon completion of the workshop, you will be able to understand the rationale and motivation for using diagnostic measurement methods. Furthermore, you will be able to understand the types of data typically used in diagnostic measurement along with the information that can be obtained from implementing diagnostic models. You will become well-versed in the state-of-the-art techniques currently used in practice and will be able to use and estimate diagnostic measurement models on their own.
Included in this Workshop
- Hard-copy handouts of all lecture materials
- A one-year license for use of new software by Analyticable that makes diagnostic measurement much easier to implement than any existing programs (be among the first to use this program)
- Analysis syntax and output for all data
- One-on-one consultation with the instructor for any questions you may have about your data, project, or testing program
- Limited enrollment to allow for more individualized instruction
The workshop presents both conceptual and technical content and also provides hands-on experiences throughout for you to practice and apply what you have learned. Much of the content will be delivered through lecture, and content will be reinforced using activities embedded throughout the different sections of the course. Trial licenses of new software, developed by the instructor, will be given to students to reinforce concepts taught in lectures.
Each day has two parts: a morning session from 8:30am to 11:00am and an afternoon session from 2:30pm to 5:00pm. Lectures are provided during each section with all lecture materials available both online and in hard-copy format.
From 11:00am to 2:30pm is open time. Go to lunch, visit the beach, lounge by the pool, or sit and work through the examples presented during the day in the course classroom. Individual consultation sessions with the instructor are available by appointment during each day of the workshop.
Additional Online Course Materials
Augmenting the in-class portion of the workshop are supplemental materials available online. These materials include online videos demonstrating how to use the new software to conduct analyses with diagnostic models. Examples with data and syntax for each analysis presented in the course are also provided.
Finally, all workshop lectures are recorded and videos of the course will be available online shortly after the workshop is completed. Online content is available to registered participants in advance of the workshop and continues to be available to participants up to one year after the workshop.
Learn from an Expert
Jonathan Templin is an Associate Professor in the Research, Evaluation, Measurement, and Statistics (REMS) Program in the Department of Educational Psychology at University of Kansas. In 2004, Dr. Templin received his Ph.D. in Quantitative Psychology at the University of Illinois at Urbana-Champaign, where he also received an M.S. in Statistics. He joined the faculty of Kansas in January of 2014, having previously served on the faculty at the University of Nebraska-Lincoln, the University of Georgia, and in the Department of Psychology at the University of Kansas. The main focus of Dr. Templin’s research is in the field of diagnostic classification models—psychometric models that seek to provide multiple highly reliable scores from psychological tests. Dr. Templin’s research program has been funded by the National Science Foundation and the Institute for Education Sciences and has been published in journals such as Psychometrika, Psychological Methods, Applied Psychological Measurement, and the Journal of Educational Measurement. He currently serves as co-editor of the Journal of Educational Measurement, Associate Editor for Psychometrika, and on the editorial board for the Educational Measurement: Issues and Practice. Dr. Templin is a coauthor of the book Diagnostic Measurement: Theory, Methods, and Applications, which won the 2012 American Educational Research Association Division D Award for Significant Contribution to Educational Measurement and Research Methodology. For more information, please visit his website: http://jonathantemplin.com.
Workshop Location: Omni Hilton Head Oceanfront Resort
The Omni Hilton Head Oceanfront Resort boasts an elegant contemporary design throughout the property’s spacious guest rooms, public areas, meeting rooms and the unmatched white sand beaches joining the cool blue Atlantic Ocean. Tropical gardens run throughout the Hilton Head beach resort, providing a serene and tranquil place where you can choose from a variety of activities during your stay.
For hotel information and registration, please visit https://www.omnihotels.com/hotels/hilton-head.
Discount for Multiple Workshop Enrollment
Enrolling in more than one workshop? Enrolling as a group? We offer a 10% discount on the total price of enrollment for in-person workshops.
Enter twoworkshops in the coupon code section of the check-out page to receive the discount.
Please contact Jonathan Templin at firstname.lastname@example.org.