MAMAY P's Pinoy Halu-Halo: Standardized test

Showing posts with label Standardized test. Show all posts

Saturday, November 9, 2013

Some Issues with Norm-referenced Tests

Below is part of the post of my classmate Ian Kevin Magabilin on 5 November 2013 regarding norm-referenced test. I find his work worth taking because it highlights some problems with the traditional norm-referenced assessment. To view the full post of Ian, please click http://myportal.upou.edu.ph/mod/forum/discuss.php?d=72638

"Here are some of the issues with norm-referenced tests:

Tests can be biased. Some questions may favor one kind of student or another for reasons that have nothing to do with the subject area being tested. Non-school knowledge that is more commonly learned by middle or upper class children is often included in tests. To help make the bell curve, test makers usually eliminate questions that students with low overall scores might get right but those with high overall scores get wrong. Thus, most questions which favor minority groups are eliminated.

NRTs usually have to be completed in a time limit. Some students do not finish, even if they know the material. This can be particularly unfair to students whose first language is not English or who have learning disabilities. This "speededness" is one way test makers sort people out.

The items on the test are only a sample of the whole subject area. There are often thousands of questions that could be asked, but tests may have just a few dozen questions. A test score is therefore an estimate of how well the student would do if she could be asked all the possible questions.

All tests have "measurement error." No test is perfectly reliable. A score that appears as an absolute number -- say, Jamal's 63 -- really is an estimate. For example, Jamal's "true score" is probably between 56 and 70, but it could be even further off. Sometimes results are reported in "score bands," which show the range within which a test-takers' "true score" probably lies.

There are many other possible causes of measurement error. A student can be having a bad day. Test-taking conditions often are not the same from place to place (they are not adequately "standardized"). Different versions of the same test are in fact not quite exactly the same.

Any one test can only measure a limited part of a subject area or a limited range of important human abilities. A "reading" test may measure only some particular reading "skills," not a full range of the ability to understand and use texts. Multiple-choice math tests can measure skill in computation or solving routine problems, but they are not good for assessing whether students can reason mathematically and apply their knowledge to new, real-world problems.

Most NRTs focus too heavily on memorization and routine procedures. Multiple-choice and short-answer questions do not measure most knowledge that students need to do well in college, qualify for good jobs, or be active and informed citizens. Tests like these cannot show whether a student can write a research paper, use history to help understand current events, understand the impact of science on society, or debate important issues. They don't test problem-solving, decision-making, judgment, or social skills.

Tests often cause teachers to overemphasize memorization and de-emphasize thinking and application of knowledge. Since the tests are very limited, teaching to them narrows instruction and weakens curriculum. Making test score gains the definition of "improvement" often guarantees that schooling becomes test coaching. As a result, students are deprived of the quality education they deserve.

Norm-referenced tests also can lower academic expectations. NRTs support the idea that learning or intelligence fits a bell curve. If educators believe it, they are more likely to have low expectations of students who score below average."

References:

Suskie, L. (2003). What is “Good” Assessment. Retrieved fromhttp://faculty.ccp.edu/dept/viewpoints/f03v4n1/suskie.html

Merrell, A. (n.d.) Traditional Assessment. Retrieved from

http://audreymerrell.net/INTASC/INTASC8/Assessment/traditionalassessment_files/traditional.html

Fairtest. The National Center for Fair and Open Testing (2007). Retrieved from http://www.fairtest.org/facts/nratests.html

Guilty as Charged

Assessment of students’ skills and performance through observations and other traditional testing methods is not only for the concern of the learners but also for the teachers. This is because the outcome of the evaluation does not only reflect the level of students’ understanding but also indicate the quality of instruction received by the learners. Wary of this implication, teachers do their best to see to it that their students’ performance and skills meet the standards set by school officials. To achieve this, more often than not, teachers result to teaching to the test. Is this cheating?

Teaching to the test refers to giving instruction to students of the contents of the standard tests that they shall take in a given time. Nothing is wrong in this definition. The problem lies when the teachers or instructors give the exact items or similar to it during class discussion or review. Some academicians assert that this kind of tactic is wrong because it is tantamount to cheating. Popham (2001) argues that item testing is unacceptable because it takes away valid inferences about the outcome of the assessment because the result assumes that the students also understand the other contents of the curriculum not just the items appearing on the test.

Veteran educator Jeanne Clements (2013) argues in favor of teaching to the test and recommends its wide use. However, she is not talking about reviewing the exact items on the standardized test but on the specific contents of the test. She stresses that the test does not rely on rote memorization of facts and concepts. She further asserts that no one condemn licensure examinations for professionals when the reviewers also result to teaching to the test.

As a student at Tapinac Elementary School in Olongapo City, I had never experienced that my teachers were actually using the outmost form of teaching to the test, which we can also refer to as “cheating to the test.” We can all infer that my teachers knew before hand the contents or subject matters of the standard or achievement tests to be given at designated time that they needed to teach us students. However, they never drill us on the actual test items or “clones” of them. They just presented us with the format and the directions of the actual test to familiarize ourselves to save time. Since we knew before hand that the result of the test will not become part of our final grade (which we never knew if ever true), test anxiety was diminished.

Nowadays, teachers’ performance are also gauged against the results of their students’ evaluation. As a result, they result to “cheating to the test” or during performance evaluation conducted by principals and other district supervisors. One of the tactics employ during visits of high ranking school officials and achievement tests is to tell low-performing pupils not to come to class during the date of the visit or test. A drill before the visit is perfected by simulating the visit’s scenario through giving high achievers their roles, that is, who will answer first, who will ask question and what, etc. This results to high satisfactory rating to students, teachers and schools.

To overcome their shortcomings as administrators, principals and teachers, there are many instances that sample or the actual test papers are being reviewed by the students and teachers. Because no one from the students up to high ranking officials of the district want to get a failing or unsatisfactory rating or remark from those above them, the performance maybe conceived as cooperative. This kind of drama becomes unacceptable when the learners do not gain from the experience. As long as the students understand the materials being presented and taken during class and these items are not the actual items, teaching to the actual test items is not wrong. This is also what is happening during review classes for the professional accreditation and certification. Teaching to the test is reprehensible if the test items being reviewed are the actual and same items or their clones.