1.   Arnold recommended asking three basic questions when choosing a test publisher.

2.   She blamed the problem on the test publisher, Harcourt Educational Measurement of Texas and said other state schools chiefs also believe there is something wrong with the questions.

3.   Test publishers calculate reliability by analyzing thousands of student tests to estimate chances that students who answer some questions correctly will also answer others correctly.

4.   Test publishers report strong growth over the last three to five years.

5.   The questionable tests were flagged by the test publisher, Doug Stone, a spokesman for the state Education Department, said Wednesday.