Homogeneous lengthening of a test increases both validity and reliability. If the test is too short to become a representative one, then validity will be affected accordingly. (a) Length of the test – A test usually represents a sample of many questions. OpenStax CNX.The following factors in the test itself can prevent the test items from functioning as desired and thereby lower the validity: This text is adapted from OpenStax, Psychology. To address these concerns, he has called for significant changes to the SAT exam (Lewin, 2014). In 2014, College Board president David Coleman expressed his awareness of these problems, recognizing that college success is more accurately predicted by high school grades than by SAT scores. Many institutions of higher education are beginning to consider de-emphasizing the significance of SAT scores in making admission decisions (Rimer, 2008). In fact, it has been suggested that the SAT’s predictive validity may be overestimated by as much as 150% (Rothstein, 2004). Additionally, some research has suggested that the predictive validity of the SAT is grossly exaggerated in how well it is able to predict the GPA of first-year college students. For one, some researchers assert that the SAT is a biased test that places minority students at a disadvantage and unfairly reduces the likelihood of being admitted into a college (Santelices & Wilson, 2010). However, the emphasis placed on SAT scores in college admissions has generated some controversy on a number of fronts. Given that many institutions of higher education require the SAT for admission, this high degree of predictive validity might be comforting. In this context, predictive validity refers to the test’s ability to effectively predict the GPA of college freshmen. Standardized tests like the SAT are supposed to measure an individual’s aptitude for a college education, but how reliable and valid are such tests? Research conducted by the College Board suggests that scores on the SAT have high predictive validity for first-year college students’ GPA (Kobrin, Patterson, Shaw, Mattern, & Barbuti, 2008). Researchers strive to use instruments that are both highly reliable and valid. While any valid measure is by necessity reliable, the reverse is not necessarily true. Validity refers to the extent to which a given instrument or tool accurately measures what it’s supposed to measure. While the scale is highly reliable in producing consistent results ( e.g., the same amount of cereal poured onto the scale produces the same reading each time), those results are incorrect. If the scale is not properly calibrated, it may consistently under- or overestimate the amount of cereal that’s being measured. To illustrate this concept, consider a kitchen scale that would be used to measure the weight of cereal that you eat in the morning. Unfortunately, being consistent in measurement does not necessarily mean that you have measured something correctly. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways. Reliability refers to the ability to consistently produce a given result. Reliability and validity are two important considerations that must be made with any type of data collection. In the end, researchers strive for reproducibility and accuracy: here, the test is successful if other incompatible couples continue in misery, while those who share common interests enjoy a fantastic time together. In this case, the test did have high predictive validity-it forecasted the behavior. If the pair scored low in dating compatibility and still went out to dinner together, perhaps they had a miserable time. Will they actually enjoy spending time together on a date? Now, the second factor, validity-the extent to which a test accurately measures or predicts what it set out to measure-must be reflected. However, getting consistent results does not ensure that a test is accurate. This situation is also known as test-retest reliability. In this context, the compatibility test would be considered reliable if the same people take the test twice and perform similarly each time. One is reliability, which refers to the ability of a test-or other research instrument-to provide consistent, and thus, reproducible, results under similar circumstances. They must consider two important factors to generate successful outcomes. In a scientific setting, suppose a researcher wants to create a test to measure the compatibility of potential partners on an online dating website.