September 1993
In the June, 1993, issue of Internal Auditor, readers were invited to measure their honesty by completing the Applicant Review, an honesty test. After marking the test, they phoned an analysis center to report their answers and obtain a percentile score.
During the months of June and July, 720 people completed the test and scored their responses. The gender of these respondents was 56% male and 44% female. The racial composition was 93% white, 3% Asian, 1% Hispanic, 1% Native American, and 2% Black. The age distribution included 28% in their 20s, 43% in their 30s, 19% in their 40s, and only 8% age 50 and over.
The average percentile score for this group was 52.4, which is about the same as the general population. The distribution of scores for these 720 people are shown in deciles in the table below. Since they are percentile scores, they should be evenly distributed from one extreme to the other. The data indicate, however, that a disproportionately large number of these 720 people obtained a score of 2 and more than usual scored above 70.
The Applicant Review
The Applicant Review was developed in 1983 as a pre-employment screening test primarily for job applicants in retailing. The test was based on five years of research on honesty, white-collar crime, moral development, and the climate of honesty. The test has been revised three times as a result of additional research and recent legislation.
The Applicant Review is one of about a dozen honesty tests used by employers to screen job applicants. We developed this test because we were dissatisfied with the other honesty tests that asked too many offensive and ambiguous questions and their scoring procedures disqualified too many honest people. We think the Applicant Review is less offensive and we are pleased with how well it measures honesty. Our primary motive, however, is not to measure honesty, but to understand character development. Our goal is to raise the standards of honesty in society. We hope to stimulate higher levels of honor and integrity within ourselves and others.
How Scores are Calculated
A person’s honesty percentile is calculated by combining several subscale scores, each of which measures a different dimension of honesty. Each subscale score ranges from 0 to 100. The average scores for the general population are compared with the average scores for the internal auditors.
1. Personal honesty: This score comes from combining responses to items that describe one’s personal honesty, such as the statement “I am an honest person and would never steal or cheat.” This score measures what people say about their own behavior and whether they are honest or dishonest. (85 versus 75.6 for auditors)
2. Honesty of others: This score measures how honest one thinks other people are. People who are honest think other people are also honest, while those who are dishonest tend to think others are also dishonest. (70 versus 61 for auditors)
3. Blame for dishonesty: This score measures how wrong one thinks dishonesty is and how much blame should be attributed to those who behave dishonestly. (80 versus 85 for auditors)
4. Punishment: This score measures one’s degree of punitiveness and whether one thinks dishonest acts should be severely punished or overlooked. Dishonest people tend to overlook and excuse the dishonesty of others. (75 versus 67 for auditors)
5. Definition and standards of honesty: This score measures how explicitly one has defined honesty and whether one’s standards of honesty are strictly or casually defined. (80 versus 75 for auditors)
6. Moral reasoning: This score measures one’s level of moral reasoning based on the ranking items at the end of the questionnaire. These items can not be easily faked and our research indicates that some types of moral reasoning are much more conducive to honesty than others. (75 for both the general public and auditors)
7. Past behavior: This score measures self-reported admissions of previous theft and substance abuse. (95 versus 90 for auditors)
The questionnaire includes several faking scales to prevent people from getting fictitious high scores. A small amount of faking simply reduces the person’s percentile score, while excessive faking produces a score of zero. Considerably less faking was reported by this sample of auditors than most job applicants: .8 versus 2.0 faking items.
The scores are also adjusted for what is called a social desirability response bias. Some people have a stronger desire than others to report socially desirable responses and their scores are adjusted to reduce the biasing effect of this personality trait. This group of auditors displayed considerably less social desirability response bias than normal job applicants.
Interpreting the Scores
The percentile scores can range from zero to 100, with higher numbers indicating higher levels of honesty. Retail companies that use the Applicant Review for hiring typically set the 25th percentile as the minimum acceptable score.
Many people were disappointed because their scores were lower than they expected. Some of the reasons why people scored low are explained later. In several cases, however, the callers did not know how to interpret a percentile score. When one caller was told his score was 69, he responded “So, I failed it then?” The analyst tried to explain that his score was better than average, but he still said “If I ever got less than 70 percent in college, I figured I failed.” Even after he was told that his score of 69 meant that in an average group of 100 people, 69 of them would be expected to score lower, he still had difficulty comprehending the difference between a percentile and a percentage.
Percentile scores do not indicate what percent of the time a person is being honest; they simply compare one person with a larger population. These comparisons are often disturbing. We have learned that almost everyone describes himself or herself as an honest person. When people are asked to write anonymous essays describing how honest they really are, virtually everyone begins by saying “Basically, I’m an honest person.” However, we have also learned that most people are not as honest as they think they are. People have a remarkable ability to rationalize and justify dishonest behavior. Consequently, many people are surprised at their low scores when they measure their honesty and compare themselves to others. The following paragraphs discuss some of the most frequent comments of callers.
I can’t believe I got a low score!
Low scores are caused by several factors; no single item can produce a low score. A score of zero means there was insufficient data to calculate a reliable score either because too many items were left blank or because too many faking responses were indicated to have confidence in the data. Faking responses are defined as extreme responses to selected items that are considered highly improbable, such as “When I find money on the sidewalk, I take it to the police even when it is less than one dollar.” The police say no one ever submits loose change they find on the sidewalk. So if someone claims to do it always, this is considered a faking response.
The most obvious reason why people get low scores is because their answers endorse dishonesty — they do not describe themselves as honest people, they think other people are dishonest, they excuse people for dishonesty and are reluctant to punish them, they have poorly-defined standards of honesty, they have been dishonest in the past, or their moral reasoning is weak.
Some people have relatively low scores not because they endorse dishonesty, but because virtually all of their answers tend to be neutral — they only disagree rather than strongly disagree. For example, responses to the item “Most sales clerks deserve to steal a little now and then because they are so badly underpaid.” ought to evoke a stronger response than just “disagree”. An honest person would never think sales clerks deserved to steal from the company regardless of how underpaid they are, and to obtain a high score a person ought to feel strongly about it. The data indicated that 22 percent answered disagree and 77 percent strongly disagreed.
What is Honesty? Who’s to say what honesty is?
Although everyone seems to agree that the Applicant Review is a test of honesty, some people question whether anyone really knows what honesty is. This concern is usually prompted by incidents that would be considered moral dilemmas, such as whether it is dishonest to tell a child that the picture she painted was ugly. Twenty-nine percent said they would always lie to the child, 35 percent said frequently, 20 percent said occasionally, 10 percent said seldom, and 5 percent said never.
Clearly, there are occasional moral dilemmas where honest people may disagree about what is the right choice to make. The purpose of ethics training is to help people learn how to resolve such moral dilemmas, and we do not want to disparage the value of this training. But, we believe the vast majority of time, certainly more than 95 percent, people face issues of choice rather than issues of dilemma. People know what is right and wrong, what is fair and unfair, what is honest and dishonest and the question is whether they have the integrity to make the right choice. When asked if they reported their income taxes honestly, only 50 percent said always, 38 percent said frequently, 6 percent said occasionally, 2 percent said seldom, and 3 percent said never.
Honesty is not difficult to define and we think most people have a fairly consistent definition of honesty. Honesty means to be free from deceit and fraud, to be open and above board in your transactions, and to be fair and just in how you treat others. People who are honest do not say things they know are not true, they do not take things of value that belong to others, they do not knowingly give false impressions, and they follow the rules they have agreed to accept. When asked how much cash or merchandise they had stolen in the past three years, only 82 percent said they had not stolen any cash and only 52 percent said they had not stolen any merchandise.
Is Honesty a Personality Trait?
A personality trait refers to an individual’s predisposition to act in a consistent way in a variety of situations. Therefore, honesty can be a personality trait, but it is not a single trait and it does not act alone when influencing behavior. Honesty has multiple dimensions, and the Applicant Review measures several different dimensions of honesty.
In our research on honesty, we have focused primarily on three dimensions of honesty: how well standards are defined, how well they have been internalized, and the degree of remorse for violations. People vary on these three dimensions.
For someone to be considered an extremely honest person, that person must have very high well-defined general standards of honesty, these standards must be internalized as moral imperatives, and living a moral life has to matter to the point that violating these standards would cause feelings of shame and remorse.
Standards. Whether a person has high, well-defined general standards of honesty depends largely on the person’s experience and training. People have to learn right from wrong and this training occurs at every age as new issues are confronted. In school, for example, students have to learn when it is acceptable to work together on assignments and exams and what is considered cheating.
Learning acceptable standards of honesty is equally important at work. Copying computer programs is a difficult issue for some people because they do not realize that pirating software is stealing. Some employees think violating the copyright protection on a computer software program by taking a copy home is as immaterial as taking a pencil home from the office. When asked if sales representatives should be fired for padding their expense accounts each month, 2 percent strongly disagreed, 31 percent disagreed, 44 percent agreed and 22 percent strongly agreed.
Child-rearing research has demonstrated the importance of teaching children general standards of right and wrong rather than specific rules. Taking candy from a store without paying for it is more than just a simple act of not paying for the candy. Children should learn that taking something without paying for it is shoplifting, which is a form of stealing; and stealing is a general form of behavior that is wrong.
Internalization.Remorse. Honesty should matter; people should not lie or steal with impunity and think nothing about it. An honest person has a genuine concern for doing the right thing and being fair and just. When a mistake is made, an honest person has a genuine feeling of remorse and guilt. This is not to say that the person should be overwhelmed with feelings of inadequacy or unworthiness, but that the person feels sufficient discomfort to correct the mistake. Continuing to behave dishonestly is not acceptable; there must be a sincere desire to improve and do better.
This test is not a good measure of my honesty!
This comment was made by most of the callers who received low scores. Calling it a bad test probably preserved their self-esteem, but we think it is a good test. However, the issue needs to be carefully analyzed. All paper and pencil honesty tests have certain limitations that limit their reliability. Honesty tests can be faked, responses can be influenced by the person’s mind set when taking it, and questions can be misinterpreted.
Therefore, a person’s score may, indeed, be grossly incorrect. Nevertheless, our research indicates that the test is highly reliable — scores are consistent from one time to another. The test is also valid — it is a good measure of what we call honesty.
Evidence of the Applicant Review’s reliability comes from test-retest reliability studies. Groups of people, mostly students, have been tested twice with a one week interval between administrations and their scores on both tests have been highly correlated.
Evidence of the Applicant Review’s validity comes from a variety of studies, such as comparing the average scores of known groups who are expected to differ significantly (such as prisoners versus housewives), and correlating test scores with admissions of theft.
Perhaps the most impressive validity evidence comes from correlating the test scores for people who are asked to complete the test and then write an anonymous essay about how honest they really are. When these essays are coded on a 10 point scale and correlated with the test scores, the correlations are quite impressive. Although people with low scores begin their essays by saying they are basically honest people, they typically admit to a variety of dishonest acts such as stealing from their employer, shoplifting, lying to their family members, cheating on their income taxes, exceeding speed limits, and falsifying reports.
I got a low score because I was honest.
Some of the callers were indignant because their scores were low and they thought only dishonest people would get higher scores. When one caller was told that part of the reason why her score was low was because she disagreed with such statements as “I am an honest person and would never steal or cheat,” she said she was only being honest and should not be penalized for her honesty. She claimed that everyone would have to disagree with these statements unless they were lying. When asked if they were an honest person who would never steal or cheat, 2 percent strongly disagreed, 30 percent disagreed, 51 percent agreed, and 17 percent strongly agreed.
People who have low scores often do not believe there are people who are really committed to honesty. Conversely, people with high scores are usually surprised to hear the skepticism and rationalizations of others because they genuinely believe most people are honest.
People who are extremely honest or dishonest seem to seriously underestimate both the number and character of people who are opposite to themselves. This misperception has been conspicuous in group discussions about such items as “Nearly every worker has stolen something from his or her company at one time or another.” In this study, only 7 percent strongly disagreed, 34 percent disagreed, 43 percent agreed, and 14 percent strongly agreed. When this item is discussed in workshops, widely opposing views are usually expressed about it. Those with low scores strongly agree with this statement and think anyone who disagrees with them is either naive or lying. However, some people with high scores claim they have never stolen anything from their employers and they assume most people are just like themselves. Although they have heard stories of significant employee theft, they assume these cases are exceptional stories that attract undue attention rather than customary practices.
If someone gets a low score does that mean he or she will steal?
People who have low scores will not necessarily steal the next time they have a chance; but, people with low scores are certainly more likely to steal than people with high scores. A basic principle of employee selection is that past behavior is the best predictor of future behavior. Scores on the Applicant Review are significantly related to past behavior — people who have low scores voluntarily admit to higher levels of previous theft and illegal drug use.
In our first validity study we were surprised to discover that the single best predictor of employee theft was a question asking about the use of marijuana. We should not have been so surprised at this correlation because marijuana use is both illegal and expensive. People who disregard the law by using illegal drugs can probably disregard other standards of honesty, and drug habits are too expensive for most people to maintain on an honest income. Unfortunately, the new Americans With Disabilities Act prevents asking anything more than whether applicants are current drug users. When asked if they plan to use marijuana in the future, only 81 percent said absolutely never, 14 percent said they didn’t think so, and 5 percent said possibly yes. Three percent of the respondents said they had used marijuana within the previous four weeks.
While personal honesty is an important predictor of whether someone will lie or steal, our research indicates that it is only one of three important variables that need to be considered. The other two variables are the kinds of situational pressures the person is experiencing and the kind of opportunities available for stealing.
Situational pressures refer to the specific problems a person might face at a particular time, especially a need for money. Although everyone would probably appreciate having more money to spend, some people have intense financial needs to cover short-term emergencies. Occasionally these financial pressures can be overwhelming, such as trying to support a drug habit, covering gambling losses, or maintaining the social image of an extravagant life style. Situational pressures are particularly intense when people have a non-sharable need — they are too embarrassed to share their financial problems with anyone.
Some situations are more conducive to theft than others. The opportunity to commit fraud is more convenient when people have access to financial accounts, when no one audits them, and when they think it is unlikely they will be caught or prosecuted or punished. Fraud is easier when companies have poor internal accounting controls and when they fail to follow them. Occasionally, fraud is so convenient that even honest people are seduced by the opportunity presented to them even though they had no intention of being dishonest.
Whether someone will steal in a particular situation, therefore, depends on more than just the person’s level of honesty. Even honest people can succumb to theft when the opportunities are convenient and they face intense situational pressures. All three variables need to be considered to understand and predict employee theft.
My score is low because I work with dishonest people.
Since one’s perception of the honesty of others is one of the subscale scores forming the honesty score, some people think their scores are low because their jobs expose them to extensive dishonesty. People who work in law enforcement, tax auditing, loss prevention, and youth corrections claim their scores on the Applicant Review are reduced because they are overexposed to dishonest behavior. This fear is legitimate, but not very material, as the data presented earlier indicates.
Previous research has found that the average honesty scores of loss prevention officers in retail companies are higher than almost any other occupation we have measured. As expected, their subscale scores on the honesty of others tend to be lower than normal. But their other scores are noticeably higher than normal because they are continually exposed to issues of honesty and theft and they witness the consequences of dishonesty. Therefore, the effects of one’s job or prior experiences with dishonesty should not necessarily cause one to have a low score. As with all past experience, the impact on one’s character will depend on how the person responds to it and thinks about it.