CONTENTS
Introduction to AIG
What Is AIG?
How It Works
Who Can Use AIG?
The Value of AIG
The Security Benefits of AIG
Four Ways AIG Saves Time and Money
Methods of Item Pool Expansion
Implementing AIG
Talking to Your Team
Too many tabs open?
We’ve been there. Enter your email to get a permanent copy of this guide sent directly to your inbox.
Introduction
Many of the negative effects of cheating and content theft can be mitigated by a large enough item bank.
But until recently, physical and economic limitations have made it difficult to rapidly expand an item pool.
Dedicating item writers and subject matter experts (SMEs) to the arduous task of expanding your item pool can be expensive and time-consuming.
AIG transforms this process.
Because up until now, testing professionals have always had to manually and painstakingly perform the fundamental task of item writing—there has been no way to easily and rapidly expand an item pool while also maintaining its psychometric quality.
As a result, test programs pour time and money into item development… and then redevelopment.
Is there an easier way?
AIG has been around for a while. However, pumping out items using typical methods of item design hasn’t exactly been useful or attainable for most of us, either. AIG still required the skills of a developer to pull off.
That gets costly.
Luckily, new ways of designing items are making it easier than ever to rapidly expand item pools at a reduced cost—no developer required.
But how does AIG work? What are the benefits? How does a program even get started?
We’ll explore these questions and more in this Ultimate Guide.
What Is AIG?
Automated Item Generation (AIG) is a process that leverages test item templates and computer algorithms to quickly create a large variety of item permutations, or test items. The result is hundreds or thousands of new test questions based on one single item model.
As the name suggests, AIG automates much of the effort involved in item creation—which is one the most time-intensive and costly aspects of test development. Using computer technology, AIG generates large numbers of high-quality test items automatically. (Welcome to the future.)
Utilizing AIG helps to maintain and improve test quality in a world where online braindumps and content sharing platforms disclose test content and threaten the validity of exam scores. With AIG, stolen test questions can be replaced quickly, and the damage that shared test content can inflict on assessment programs is palliated.
“AIG involves leveraging the expertise of content specialists, item templates, and computer algorithms to create a variety of item permutations, often resulting in hundreds or thousands of new items based on a single item model.”
—European Medical Journal
How It Works
1. Template Build
Thousands of unique items start with the construction of a strong item template or model.
2. Data Dump
The item template is then populated with all kinds of data and variables.
3. Generation
Item generation used to take forever. Some modern AIG tools require just the push of a button.
4. Review and Testing
The hundreds or thousands of new items can undergo psychometric testing and review.
5. Import
Approved items are then uploaded or integrated with existing item banking and delivery systems.
Who Can Use AIG?
AIG is for all.
Here’s what AIG can do for your program:
Certification and Licensure
If the content of your exams must be constantly updated, as is the case with many certifications, AIG can reduce the duration and cost of redevelopment.
K-12 Testing
Distill the content of your K-12 exams into expansive item pools to deploy more forms, thereby making it more difficult for gossip to contribute to useful pre-knowledge.
International
Exams delivered internationally are more at risk for content theft. A large item bank limits item exposure to protect the value of your exam.
Higher Education
Use AIG to create and maintain item pools that are secure enough to be confidently used in online learning environments and expansive enough to be relied upon for years to come.
The Value of AIG
Security
Reduce item exposure, stay ahead of content thieves, and build secure and adaptive exams with AIG technology.
Savings
Increase productivity using a smaller team, build better exams on a budget, and save on long-term security costs.
Speed
Some AIG tools can transform one item into 1,000 at the click of a button. Nobody can write that fast.
Accuracy
Reduce the amount of inevitable human error by using AIG to accurately generate your new items.
Creativity
Get the most out of your best resources—your SMEs—by supplying them with time-saving design tools.
Popularity
Your team will love the switch to AIG. It cuts down on manual labor and saves costs, reducing logistical headaches.
The Security Benefits of AIG
Limit Item Exposure
Numbers don’t lie. More items in your item pool means fewer eyes see each item. Limit item exposure by rapidly expanding your item pool through AIG.
Stay Ahead
To combat item theft, it is important to stay one step ahead of prying eyes. AIG makes it possible to refresh your item pool as often as necessary.
Block Preknowledge
A larger pool of items can prevent test takers from using pre-knowledge by making it harder for them to predict which test question they’ll see. Nice try!
Use Fewer Humans
Maintain an extra layer of security by involving fewer individuals in the item writing process. AIG gives smaller teams the tools to be more efficient.
Get Adaptive
Secure test designs such as CATs (Computerized Adaptive Tests), multiple forms, & LOFTs require large item banks. AIG makes bank expansion accessible.
4 Ways AIG Saves Time and Money
Reducing Development Costs
The boost in productivity when using AIG affords many programs the luxury of reducing the human resources necessary to create a set amount of items.
Reducing Redevelopment Costs
The enhanced security benefits of a larger item pool mean fewer security and redevelopment costs in the long run. Over time, your budget will notice.
Increasing Productivity
How long would it take a team of item writers to craft 400 unique items? Using AIG, that team could potentially develop twice that many at the push of a button.
Increasing Item Pool Longevity
Rapid item pool expansion with AIG makes more secure test designs—like CATs and LOFTs—possible. Get more
bang for your item-writing buck.
Methods of Item Pool Expansion
Writing Tons of Items
One way to expand an item pool is to manually write lots of items. This method is nice because SMEs are highly involved, but the cost and the duration of the project can quickly add up.
Theory-Based Expansion
This method of item pool expansion requires developers to use heavy-duty computer programs to build item models based on principles of cognitive psychology. SMEs are left out in the cold.
Designing with a GUI
Recent advances in user interface technology have made it possible for subject matter experts to re-enter the equation and build items themselves using a graphical user interface to drag and drop.
Skill-Based Item Generation
Using this method, one single item covers the breadth and depth of a skill or objective, and data sources are added to yield every permutation of an item/objective, expanding item pools dramatically.
Getting Started with AIG
1. Research Options
What method of AIG do you plan to use? What tools can integrate with your existing systems?
2. Test Drive
Once you’ve found a tool you think you’ll like, take it for a test drive. Request demos. Be sure the solution works for you.
3. Integration
Now that you have your tool, you can take whatever steps you need to integrate. Do you require a developer?
4. Training
Depending on the AIG solution you select, you may need to train your item writers and SMEs on best practices.
5. Build Templates
Whether you plan to use a GUI interface, cloning, SmartItem™ technology, or some other solution, high-quality templates are a must.
6. Generate Items
The cost and duration of this step of the process will vary depending on the AIG method you’ve chosen.
7. Make it Happen
Whether they’re developed and sent to you, or rendered into an uploadable file, you can now enjoy all of the benefits of your plentiful new items.
Talking to Your Team
You may be wondering, "How can I get my team to adopt AIG?"
“I know how we can quickly increase item output!”
“If exam security is our priority, then we need to expand our item pool.”
“I believe this is an opportunity to save on overall costs.”
“Our item writers deserve new tools.”
Want to take a copy of the guide to-go?
You don’t need a disposable lid, bag, or box. Just download here.
Check out Other Test Security Resources
Security Boot Camp Part 1: Preparedness
In Part 1: Preparedness, you’ll learn how to proactively boost your security prior to testing. You’ll uncover ways to create a comprehensive test security and response plan and find out how to effectively deter security threats by publicizing your test security measures.
Go to Workbook
Security Boot Camp Part 2: Technology
In Part 2: Technology, you’ll learn ways to evaluate the technology you use to shore up your test security. Evaluating your online testing solutions, leveraging secure item types, and effectively increasing the number of items on your tests are three key ways to ensure the long-term health of your exams.
Go to Workbook
Security Boot Camp Part 1: Preparedness
In Part 1: Preparedness, you’ll learn how to proactively boost your security prior to testing. You’ll uncover ways to create a comprehensive test security and response plan and find out how to effectively deter security threats by publicizing your test security measures.
Go to Workbook
Security Boot Camp Part 2: Technology
In Part 2: Technology, you’ll learn ways to evaluate the technology you use to shore up your test security. Evaluating your online testing solutions, leveraging secure item types, and effectively increasing the number of items on your tests are three key ways to ensure the long-term health of your exams.
Go to Workbook
Security Boot Camp Part 1: Preparedness
In Part 1: Preparedness, you’ll learn how to proactively boost your security prior to testing. You’ll uncover ways to create a comprehensive test security and response plan and find out how to effectively deter security threats by publicizing your test security measures.
Go to Workbook
Security Boot Camp Part 2: Technology
In Part 2: Technology, you’ll learn ways to evaluate the technology you use to shore up your test security. Evaluating your online testing solutions, leveraging secure item types, and effectively increasing the number of items on your tests are three key ways to ensure the long-term health of your exams.
Go to Workbook
Want to subscribe to our newsletter?