Xcalibre IRT models

Iteman: Automated Test & Item Analysis Software

Iteman automates a psychometrician’s work for test and item analysis: Build a comprehensive psychometric tech report in Word with graphics, tables, and narratives… in seconds!  Automatically flag questions that are too hard or confusing, and dig in to diagnose with easy-to-read graphs.

Prefer to hire a pro to analyze your data?  Get in touch!

Iteman will transform how you approach psychometric analysis and test validation with Classical Test Theory

diagnostic assessment gradeA

Save Money

Why pay a consultant $10,000 to make this report for you? For every test?

admissions test

User-Friendly UI

A friendly UI – no coding involved! Designed to make world-class psychometrics accessible to anyone.

laptom on table

Narrative Output in Word

Output is a Word file with embedded tables, graphics, and narratives. You can immediately start typing to make it “your own” as a technical report.

Support team help

Automated Performance Flagging

The software flags items that do not meet your configurable standards, diagnose with detailed option statistics, discuss with your SMEs.

certification management system

Visual Analytics

Quickly diagnose problem items with colorful quantile plots that make it easy to see how examinees are interacting.

Medical office desk

Incredibly Configurable

You specify the flag levels, whether to do DIF, removed items, and so much more.

What is Iteman?

Iteman is a software platform for automated psychometric reporting (test and item analysis) with classical test theory. What does that mean?  It means that the software doesn’t just calculate statistics – it automatically builds you a tech report in MS Word, potentially hundreds of pages, with embedded narratives, graphs, and tables like you see here.  You can take the item analysis pages and share them on your screen to discuss with the content experts.

Ready for the next step in psychometric technology?  Start using item response theory, the modern psychometric paradigm, by downloading Xcalibre for free.

Iteman45-quantile-plot
Reliability analysis Iteman

Start using Iteman for test and item analysis – no cost or strings attached

Iteman comes as a free version with full functionality but a limit to 100 students and 100 items. This is perfect for teaching or learning classical test theory as well as real-world application to many smaller-scale tests. The allows you to get going with the program immediately and start improving your assessments by flagging items that do not meet best practices. The free version is governed by our terms of use.

Download Iteman (free version)

Not quite ready for the complexity of a professional system like Iteman?  Try CITAS first! It is just an Excel spreadsheet that automatically populates the most basic psychometric statistics.

Learn about CITAS

I’m very pleased with ASC’s analysis platform. The ability to run both CTT and IRT methods makes for a versatile system. Easily adjustable performance groupings, differential item functions, and integrated item flagging are my favorite options.  Randomized item data, non-scoring items, and items with multiple key responses are easy to control. Output reports feature customized analysis which create high-quality, thorough analysis reports.  I appreciate the excellent customer service ranging from a live system demonstration to prompt email responses.  ASC’s technical support is noteworthy as it offers a user-friendly technical manual which includes sample data and control files.  Well done, ASC!

Tina Koepf, PhD

Psychometrician, Nocti Business Solutions

Diagnose item performance with easy-to-read output

Iteman provides a straightforward UI for you to specify your input files and types of classical test and item analysis you want to do.  If you are completely new to the field of Psychometrics, start with the video on the right.

  • Differential item functioning
  • Mastery (cutscore) analysis
  • Scaled scoring
  • Automated flagging of poorly performing items
  • Collusion (cheating) analysis
  • Reliability & SEM analysisDescriptive statistics (mean, SD, Mean P, Mean Rpbis)
  • Item statistics such as P and Rpbis
  • Distractor analysis with option statistics
YouTube video
YouTube video

How do I interpret Iteman output for item analysis?

Instead of producing output as ASCII text from the 1980s, Iteman produces a full narrative report in Microsoft Word.  You can then use this as the starting point draft for your own report, saving you many hours of effort.

The program produces extensive test-level output regarding the examinee scores, including 7 estimates of reliability, complete analysis of domains (content areas), frequency distributions of scores, subscores, and statistics, and CSEM.

However, the majority of the report is item-by-item results using classical test theory like you see here, presented in detailed tables with a quantile plot for each item. Simply paste in item texts, and you have a comprehensive report ready for item reviewers!

Get in touch with one of our psychometricians to learn more.

Request a Consultation
Woman at desk smiling 1