examples of variables in research study

Scale: Nominal and ordinal.

The confounding variable could be the   and compels people to drink a lot of water and a cold drink to reduce heat and thirst caused due to the heat.

• Entertainment
• Online education
• Database management, storage, and retrieval

Frequently Asked Questions

What are the 10 types of variables in research.

The 10 types of variables in research are:

• Independent
• Confounding
• Categorical
• Extraneous.

What is an independent variable?

An independent variable, often termed the predictor or explanatory variable, is the variable manipulated or categorized in an experiment to observe its effect on another variable, called the dependent variable. It’s the presumed cause in a cause-and-effect relationship, determining if changes in it produce changes in the observed outcome.

What is a variable?

In research, a variable is any attribute, quantity, or characteristic that can be measured or counted. It can take on various values, making it “variable.” Variables can be classified as independent (manipulated), dependent (observed outcome), or control (kept constant). They form the foundation for hypotheses, observations, and data analysis in studies.

What is a dependent variable?

A dependent variable is the outcome or response being studied in an experiment or investigation. It’s what researchers measure to determine the effect of changes in the independent variable. In a cause-and-effect relationship, the dependent variable is presumed to be influenced or caused by the independent variable.

What is a variable in programming?

In programming, a variable is a symbolic name for a storage location that holds data or values. It allows data storage and retrieval for computational operations. Variables have types, like integer or string, determining the nature of data they can hold. They’re fundamental in manipulating and processing information in software.

What is a control variable?

A control variable in research is a factor that’s kept constant to ensure that it doesn’t influence the outcome. By controlling these variables, researchers can isolate the effects of the independent variable on the dependent variable, ensuring that other factors don’t skew the results or introduce bias into the experiment.

What is a controlled variable in science?

In science, a controlled variable is a factor that remains constant throughout an experiment. It ensures that any observed changes in the dependent variable are solely due to the independent variable, not other factors. By keeping controlled variables consistent, researchers can maintain experiment validity and accurately assess cause-and-effect relationships.

How many independent variables should an investigation have?

Ideally, an investigation should have one independent variable to clearly establish cause-and-effect relationships. Manipulating multiple independent variables simultaneously can complicate data interpretation.

However, in advanced research, experiments with multiple independent variables (factorial designs) are used, but they require careful planning to understand interactions between variables.

You May Also Like

Baffled by the concept of reliability and validity? Reliability refers to the consistency of measurement. Validity refers to the accuracy of measurement.

Textual analysis is the method of analysing and understanding the text. We need to look carefully at the text to identify the writer’s context and message.

A meta-analysis is a formal, epidemiological, quantitative study design that uses statistical methods to generalise the findings of the selected independent studies.

USEFUL LINKS

LEARNING RESOURCES

COMPANY DETAILS

• How It Works

Variables: Definition, Examples, Types of Variables in Research

What is a variable.

Within the context of a research investigation, concepts are generally referred to as variables. A variable is, as the name applies, something that varies.

Examples of Variable

These are all examples of variables because each of these properties varies or differs from one individual to another.

• income and expenses,
• family size,
• country of birth,
• capital expenditure,
• class grades,
• blood pressure readings,
• preoperative anxiety levels,
• eye color, and
• vehicle type.

What is Variable in Research?

A variable is any property, characteristic, number, or quantity that increases or decreases over time or can take on different values (as opposed to constants, such as n , that do not vary) in different situations.

When conducting research, experiments often manipulate variables. For example, an experimenter might compare the effectiveness of four types of fertilizers.

In this case, the variable is the ‘type of fertilizers.’ A social scientist may examine the possible effect of early marriage on divorce. Her early marriage is variable.

A business researcher may find it useful to include the dividend in determining the share prices . Here, the dividend is the variable.

Effectiveness, divorce, and share prices are variables because they also vary due to manipulating fertilizers, early marriage, and dividends.

11 Types of Variables in Research

Qualitative variables.

An important distinction between variables is the qualitative and quantitative variables.

Qualitative variables are those that express a qualitative attribute, such as hair color, religion, race, gender, social status, method of payment, and so on. The values of a qualitative variable do not imply a meaningful numerical ordering.

The value of the variable ‘religion’ (Muslim, Hindu.., etc..) differs qualitatively; no ordering of religion is implied. Qualitative variables are sometimes referred to as categorical variables.

For example, the variable sex has two distinct categories: ‘male’ and ‘female.’ Since the values of this variable are expressed in categories, we refer to this as a categorical variable.

Similarly, the place of residence may be categorized as urban and rural and thus is a categorical variable.

Categorical variables may again be described as nominal and ordinal.

Ordinal variables can be logically ordered or ranked higher or lower than another but do not necessarily establish a numeric difference between each category, such as examination grades (A+, A, B+, etc., and clothing size (Extra large, large, medium, small).

Nominal variables are those that can neither be ranked nor logically ordered, such as religion, sex, etc.

A qualitative variable is a characteristic that is not capable of being measured but can be categorized as possessing or not possessing some characteristics.

Quantitative Variables

Quantitative variables, also called numeric variables, are those variables that are measured in terms of numbers. A simple example of a quantitative variable is a person’s age.

Age can take on different values because a person can be 20 years old, 35 years old, and so on. Likewise, family size is a quantitative variable because a family might be comprised of one, two, or three members, and so on.

Each of these properties or characteristics referred to above varies or differs from one individual to another. Note that these variables are expressed in numbers, for which we call quantitative or sometimes numeric variables.

A quantitative variable is one for which the resulting observations are numeric and thus possess a natural ordering or ranking.

Discrete and Continuous Variables

Quantitative variables are again of two types: discrete and continuous.

Variables such as some children in a household or the number of defective items in a box are discrete variables since the possible scores are discrete on the scale.

For example, a household could have three or five children, but not 4.52 children.

Other variables, such as ‘time required to complete an MCQ test’ and ‘waiting time in a queue in front of a bank counter,’ are continuous variables.

The time required in the above examples is a continuous variable, which could be, for example, 1.65 minutes or 1.6584795214 minutes.

Of course, the practicalities of measurement preclude most measured variables from being continuous.

Discrete Variable

A discrete variable, restricted to certain values, usually (but not necessarily) consists of whole numbers, such as the family size and a number of defective items in a box. They are often the results of enumeration or counting.

A few more examples are;

• The number of accidents in the twelve months.
• The number of mobile cards sold in a store within seven days.
• The number of patients admitted to a hospital over a specified period.
• The number of new branches of a bank opened annually during 2001- 2007.
• The number of weekly visits made by health personnel in the last 12 months.

Continuous Variable

A continuous variable may take on an infinite number of intermediate values along a specified interval. Examples are:

• The sugar level in the human body;
• Blood pressure reading;
• Temperature;
• Height or weight of the human body;
• Rate of bank interest;
• Internal rate of return (IRR),
• Earning ratio (ER);
• Current ratio (CR)

No matter how close two observations might be, if the instrument of measurement is precise enough, a third observation can be found, falling between the first two.

A continuous variable generally results from measurement and can assume countless values in the specified range.

Dependent Variables and Independent Variable

In many research settings, two specific classes of variables need to be distinguished from one another: independent variable and dependent variable.

Many research studies aim to reveal and understand the causes of underlying phenomena or problems with the ultimate goal of establishing a causal relationship between them.

Look at the following statements:

• Low intake of food causes underweight.
• Smoking enhances the risk of lung cancer.
• Level of education influences job satisfaction.
• Advertisement helps in sales promotion.
• The drug causes improvement of health problems.
• Nursing intervention causes more rapid recovery.
• Previous job experiences determine the initial salary.
• Blueberries slow down aging.
• The dividend per share determines share prices.

In each of the above queries, we have two independent and dependent variables. In the first example, ‘low intake of food’ is believed to have caused the ‘problem of being underweight.’

It is thus the so-called independent variable. Underweight is the dependent variable because we believe this ‘problem’ (the problem of being underweight) has been caused by ‘the low intake of food’ (the factor).

Similarly, smoking, dividend, and advertisement are all independent variables, and lung cancer, job satisfaction, and sales are dependent variables.

In general, an independent variable is manipulated by the experimenter or researcher, and its effects on the dependent variable are measured.

Independent Variable

The variable that is used to describe or measure the factor that is assumed to cause or at least to influence the problem or outcome is called an independent variable.

The definition implies that the experimenter uses the independent variable to describe or explain its influence or effect of it on the dependent variable.

Variability in the dependent variable is presumed to depend on variability in the independent variable.

Depending on the context, an independent variable is sometimes called a predictor variable, regressor, controlled variable, manipulated variable, explanatory variable, exposure variable (as used in reliability theory), risk factor (as used in medical statistics), feature (as used in machine learning and pattern recognition) or input variable.

The explanatory variable is preferred by some authors over the independent variable when the quantities treated as independent variables may not be statistically independent or independently manipulable by the researcher.

If the independent variable is referred to as an explanatory variable, then the term response variable is preferred by some authors for the dependent variable.

Dependent Variable

The variable used to describe or measure the problem or outcome under study is called a dependent variable.

In a causal relationship, the cause is the independent variable, and the effect is the dependent variable. If we hypothesize that smoking causes lung cancer, ‘smoking’ is the independent variable and cancer the dependent variable.

A business researcher may find it useful to include the dividend in determining the share prices. Here dividend is the independent variable, while the share price is the dependent variable.

The dependent variable usually is the variable the researcher is interested in understanding, explaining, or predicting.

In lung cancer research, the carcinoma is of real interest to the researcher, not smoking behavior per se. The independent variable is the presumed cause of, antecedent to, or influence on the dependent variable.

Depending on the context, a dependent variable is sometimes called a response variable, regressand, predicted variable, measured variable, explained variable, experimental variable, responding variable, outcome variable, output variable, or label.

An explained variable is preferred by some authors over the dependent variable when the quantities treated as dependent variables may not be statistically dependent.

If the dependent variable is referred to as an explained variable, then the term predictor variable is preferred by some authors for the independent variable.

Levels of an Independent Variable

If an experimenter compares an experimental treatment with a control treatment, then the independent variable (a type of treatment) has two levels: experimental and control.

If an experiment were to compare five types of diets, then the independent variables (types of diet) would have five levels.

In general, the number of levels of an independent variable is the number of experimental conditions.

Background Variable

In almost every study, we collect information such as age, sex, educational attainment, socioeconomic status, marital status, religion, place of birth, and the like. These variables are referred to as background variables.

These variables are often related to many independent variables, so they indirectly influence the problem. Hence they are called background variables.

The background variables should be measured if they are important to the study. However, we should try to keep the number of background variables as few as possible in the interest of the economy.

Moderating Variable

In any statement of relationships of variables, it is normally hypothesized that in some way, the independent variable ’causes’ the dependent variable to occur.

In simple relationships, all other variables are extraneous and are ignored.

In actual study situations, such a simple one-to-one relationship needs to be revised to take other variables into account to explain the relationship better.

This emphasizes the need to consider a second independent variable that is expected to have a significant contributory or contingent effect on the originally stated dependent-independent relationship.

Such a variable is termed a moderating variable.

Suppose you are studying the impact of field-based and classroom-based training on the work performance of health and family planning workers. You consider the type of training as the independent variable.

If you are focusing on the relationship between the age of the trainees and work performance, you might use ‘type of training’ as a moderating variable.

Extraneous Variable

Most studies concern the identification of a single independent variable and measuring its effect on the dependent variable.

But still, several variables might conceivably affect our hypothesized independent-dependent variable relationship, thereby distorting the study. These variables are referred to as extraneous variables.

Extraneous variables are not necessarily part of the study. They exert a confounding effect on the dependent-independent relationship and thus need to be eliminated or controlled for.

An example may illustrate the concept of extraneous variables. Suppose we are interested in examining the relationship between the work status of mothers and breastfeeding duration.

It is not unreasonable in this instance to presume that the level of education of mothers as it influences work status might have an impact on breastfeeding duration too.

Education is treated here as an extraneous variable. In any attempt to eliminate or control the effect of this variable, we may consider this variable a confounding variable.

An appropriate way of dealing with confounding variables is to follow the stratification procedure, which involves a separate analysis of the different levels of lies in confounding variables.

For this purpose, one can construct two cross­tables for illiterate mothers and the other for literate mothers.

Suppose we find a similar association between work status and duration of breast­feeding in both the groups of mothers. In that case, we conclude that mothers’ educational level is not a confounding variable.

Intervening Variable

Often an apparent relationship between two variables is caused by a third variable.

For example, variables X and Y may be highly correlated, but only because X causes the third variable, Z, which in turn causes Y. In this case, Z is the intervening variable.

An intervening variable theoretically affects the observed phenomena but cannot be seen, measured, or manipulated directly; its effects can only be inferred from the effects of the independent and moderating variables on the observed phenomena.

We might view motivation or counseling as the intervening variable in the work-status and breastfeeding relationship.

Thus, motive, job satisfaction, responsibility, behavior, and justice are some of the examples of intervening variables.

Suppressor Variable

In many cases, we have good reasons to believe that the variables of interest have a relationship, but our data fail to establish any such relationship. Some hidden factors may suppress the true relationship between the two original variables.

Such a factor is referred to as a suppressor variable because it suppresses the relationship between the other two variables.

The suppressor variable suppresses the relationship by being positively correlated with one of the variables in the relationship and negatively correlated with the other. The true relationship between the two variables will reappear when the suppressor variable is controlled for.

Thus, for example, low age may pull education up but income down. In contrast, a high age may pull income up but education down, effectively canceling the relationship between education and income unless age is controlled for.

4 Relationships Between Variables

In dealing with relationships between variables in research, we observe a variety of dimensions in these relationships.

Positive and Negative Relationship

Symmetrical relationship, causal relationship, linear and non-linear relationship.

Two or more variables may have a positive, negative, or no relationship. In the case of two variables, a positive relationship is one in which both variables vary in the same direction.

However, they are said to have a negative relationship when they vary in opposite directions.

When a change in the other variable does not accompany the change or movement of one variable, we say that the variables in question are unrelated.

For example, if an increase in wage rate accompanies one’s job experience, the relationship between job experience and the wage rate is positive.

If an increase in an individual’s education level decreases his desire for additional children, the relationship is negative or inverse.

If the level of education does not have any bearing on the desire, we say that the variables’ desire for additional children and ‘education’ are unrelated.

Strength of Relationship

Once it has been established that two variables are related, we want to ascertain how strongly they are related.

A common statistic to measure the strength of a relationship is the so-called correlation coefficient symbolized by r. r is a unit-free measure, lying between -1 and +1 inclusive, with zero signifying no linear relationship.

As far as the prediction of one variable from the knowledge of the other variable is concerned, a value of r= +1 means a 100% accuracy in predicting a positive relationship between the two variables, and a value of r = -1 means a 100% accuracy in predicting a negative relationship between the two variables.

So far, we have discussed only symmetrical relationships in which a change in the other variable accompanies a change in either variable.

This relationship does not indicate which variable is the independent variable and which variable is the dependent variable.

In other words, you can label either of the variables as the independent variable.

Such a relationship is a symmetrical  relationship. In an asymmetrical relationship, a change in variable X (say) is accompanied by a change in variable Y, but not vice versa.

The amount of rainfall, for example, will increase productivity, but productivity will not affect the rainfall. This is an asymmetrical relationship.

Similarly, the relationship between smoking and lung cancer would be asymmetrical because smoking could cause cancer, but lung cancer could not cause smoking.

Indicating a relationship between two variables does not automatically ensure that changes in one variable cause changes in another.

It is, however, very difficult to establish the existence of causality between variables. While no one can ever be certain that variable A causes variable B , one can gather some evidence that increases our belief that A leads to B.

In an attempt to do so, we seek the following evidence:

• Is there a relationship between A and B?  When such evidence exists, it indicates a possible causal link between the variables.
• Is the relationship asymmetrical so that a change in A results in B but not vice-versa? In other words, does A occur before B? If we find that B occurs before A, we can have little confidence that A causes.
• Does a change in A result in a change in B regardless of the actions of other factors? Or, is it possible to eliminate other possible causes of B? Can one determine that C, D, and E (say) do not co-vary with B in a way that suggests possible causal connections?

A linear relationship is a straight-line relationship between two variables, where the variables vary at the same rate regardless of whether the values are low, high, or intermediate.

This is in contrast with the non-linear (or curvilinear) relationships, where the rate at which one variable changes in value may differ for different values of the second variable.

Whether a variable is linearly related to the other variable or not can simply be ascertained by plotting the K values against X values.

If the values, when plotted, appear to lie on a straight line, the existence of a linear relationship between X and Y is suggested.

Height and weight almost always have an approximately linear relationship, while age and fertility rates have a non-linear relationship.

Frequently Asked Questions about Variable

What is a variable within the context of a research investigation.

A variable, within the context of a research investigation, refers to concepts that vary. It can be any property, characteristic, number, or quantity that can increase or decrease over time or take on different values.

How is a variable used in research?

In research, a variable is any property or characteristic that can take on different values. Experiments often manipulate variables to compare outcomes. For instance, an experimenter might compare the effectiveness of different types of fertilizers, where the variable is the ‘type of fertilizers.’

What distinguishes qualitative variables from quantitative variables?

Qualitative variables express a qualitative attribute, such as hair color or religion, and do not imply a meaningful numerical ordering. Quantitative variables, on the other hand, are measured in terms of numbers, like a person’s age or family size.

How do discrete and continuous variables differ in terms of quantitative variables?

Discrete variables are restricted to certain values, often whole numbers, resulting from enumeration or counting, like the number of children in a household. Continuous variables can take on an infinite number of intermediate values along a specified interval, such as the time required to complete a test.

What are the roles of independent and dependent variables in research?

In research, the independent variable is manipulated by the researcher to observe its effects on the dependent variable. The independent variable is the presumed cause or influence, while the dependent variable is the outcome or effect that is being measured.

What is a background variable in a study?

Background variables are information collected in a study, such as age, sex, or educational attainment. These variables are often related to many independent variables and indirectly influence the main problem or outcome, hence they are termed background variables.

How does a suppressor variable affect the relationship between two other variables?

A suppressor variable can suppress or hide the true relationship between two other variables. It does this by being positively correlated with one of the variables and negatively correlated with the other. When the suppressor variable is controlled for, the true relationship between the two original variables can be observed.

What are Examples of Variables in Research?

Table of contents, introduction.

In writing your thesis, one of the first terms that you encounter is the word variable. Failure to understand the meaning and the usefulness of variables in your study will prevent you from doing excellent research. What are variables, and how do you use variables in your research?

I explain this key research concept below with lots of examples of variables commonly used in a study.

Understanding what variables mean is crucial in writing your thesis proposal because you will need these in constructing your conceptual framework  and in analyzing the data that you have gathered.

I will strengthen your understanding by providing examples of phenomena and their corresponding variables below.

Definition of Variable

Variables are those simplified portions of the complex phenomena that you intend to study. The word variable is derived from the root word “vary,” meaning, changing in amount, volume, number, form, nature, or type. These variables should be measurable, i.e., they can be counted or subjected to a scale.

Examples of Variables in Research: 6 Phenomena

The following are examples of phenomena from a global to a local perspective. The corresponding list of variables is given to illustrate how complex phenomena can be broken down into manageable pieces for better understanding and to subject the phenomena to research.

Phenomenon 1: Climate change

Examples of variables related to climate change :

Phenomenon 2: Crime and violence in the streets

Phenomenon 3: poor performance of students in college entrance exams.

Examples of variables related to poor academic performance :

Phenomenon 4: Fish kill

Examples of variables related to fish kill :

Phenomenon 5: Poor crop growth

Examples of variables related to poor crop growth :

Phenomenon 6:  How Content Goes Viral

But researchers devised ways to measure those variables by grouping the respondents’ answers on whether content is positive, interesting, prominent, among others (see the  full description here ).

Thus, the variables in the last phenomenon represent the  nominal scale of measuring variables .

Difference Between Independent and Dependent Variables

Independent variables.

The independent variables are those variables that may influence or affect the other variable, i.e., the dependent variable.

The five variables listed under crime and violence in the streets as the theme of a study are all dependent variables.

Dependent Variables

For example, in the first phenomenon on climate change, temperature as the independent variable influences sea level rise, the dependent variable. Increased temperature will cause the expansion of water in the sea. Thus, sea-level rise on a global scale will occur.

I will leave the classification of the other variables to you. Find out whether those are independent or dependent variables. Note, however, that some variables can be both independent or dependent variables, as the context of the study dictates.

Finding the relationship between variables

How will you know that one variable may cause the other to behave in a certain way?

At this point, I believe that the concept of the variable is now clear to you. Share this information with your peers, who may have difficulty in understanding what the variables are in research.

Related Posts

How to choose between a focus group, survey or interview: 10 nice tips, statistical analysis: how to choose a statistical test, data analytics by google: 4 important tips for webmasters and bloggers, about the author, patrick regoniel, 128 comments.

Great work. I’d just like to know in which situations are variables not used in scientific research please. thank you.

Dear Hamse, That depends on what variables you are studying. Are you doing a study on cause and effect?

I am requested to write 50 variables in my research as per my topic which is about street vending. I am really clueless.

Dear Grace, Good day. I don’t understand what you mean. But if your school requires that the independent and dependent variables be written in table form, I see no problem with that. It’s just a way for you to clearly show what variables you are analyzing. And you need to justify that.

SimplyEducate.Me Privacy Policy

Educational resources and simple solutions for your research journey

Independent vs Dependent Variables: Definitions & Examples

A variable is an important element of research. It is a characteristic, number, or quantity of any category that can be measured or counted and whose value may change with time or other parameters.  

Variables are defined in different ways in different fields. For instance, in mathematics, a variable is an alphabetic character that expresses a numerical value. In algebra, a variable represents an unknown entity, mostly denoted by a, b, c, x, y, z, etc. In statistics, variables represent real-world conditions or factors. Despite the differences in definitions, in all fields, variables represent the entity that changes and help us understand how one factor may or may not influence another factor.  

Variables in research and statistics are of different types—independent, dependent, quantitative (discrete or continuous), qualitative (nominal/categorical, ordinal), intervening, moderating, extraneous, confounding, control, and composite. In this article we compare the first two types— independent vs dependent variables .  

Table of Contents

What is a variable?  

Researchers conduct experiments to understand the cause-and-effect relationships between various entities. In such experiments, the entities whose values change are called variables. These variables describe the relationships among various factors and help in drawing conclusions in experiments. They help in understanding how some factors influence others. Some examples of variables include age, gender, race, income, weight, etc.   

As mentioned earlier, different types of variables are used in research. Of these, we will compare the most common types— independent vs dependent variables . The independent variable is the cause and the dependent variable is the effect, that is, independent variables influence dependent variables. In research, a dependent variable is the outcome of interest of the study and the independent variable is the factor that may influence the outcome. Let’s explain this with an independent and dependent variable example : In a study to analyze the effect of antibiotic use on microbial resistance, antibiotic use is the independent variable and microbial resistance is the dependent variable because antibiotic use affects microbial resistance.( 1)  

What is an independent variable?  

Here is a list of the important characteristics of independent variables .( 2,3)  

• An independent variable is the factor that is being manipulated in an experiment.  
• In a research study, independent variables affect or influence dependent variables and cause them to change.  
• Independent variables help gather evidence and draw conclusions about the research subject.  
• They’re also called predictors, factors, treatment variables, explanatory variables, and input variables.  
• On graphs, independent variables are usually placed on the X-axis.  
• Example: In a study on the relationship between screen time and sleep problems, screen time is the independent variable because it influences sleep (the dependent variable).  
• In addition, some factors like age are independent variables because other variables such as a person’s income will not change their age.  

Types of independent variables  

Independent variables in research are of the following two types:( 4)  

Quantitative  

Quantitative independent variables differ in amounts or scales. They are numeric and answer questions like “how many” or “how often.”  

Here are a few quantitative independent variables examples :  

• Differences in treatment dosages and frequencies: Useful in determining the appropriate dosage to get the desired outcome.  
• Varying salinities: Useful in determining the range of salinity that organisms can tolerate.  

Qualitative  

Qualitative independent variables are non-numerical variables.  

A few qualitative independent variables examples are listed below:  

• Different strains of a species: Useful in identifying the strain of a crop that is most resistant to a specific disease.  
• Varying methods of how a treatment is administered—oral or intravenous.  

A quantitative variable is represented by actual amounts and a qualitative variable by categories or groups.  

What is a dependent variable ?  

Here are a few characteristics of dependent variables: ( 3)  

• A dependent variable represents a quantity whose value depends on the independent variable and how it is changed.  
• The dependent variable is influenced by the independent variable under various circumstances.  
• It is also known as the response variable and outcome variable.  
• On graphs, dependent variables are placed on the Y-axis.  

Here are a few dependent variable examples :  

• In a study on the effect of exercise on mood, the dependent variable is mood because it may change with exercise.  
• In a study on the effect of pH on enzyme activity, the enzyme activity is the dependent variable because it changes with changing pH.   

Types of dependent variables  

Dependent variables are of two types:( 5)  

Continuous dependent variables

These variables can take on any value within a given range and are measured on a continuous scale, for example, weight, height, temperature, time, distance, etc.  

Categorical or discrete dependent variables

These variables are divided into distinct categories. They are not measured on a continuous scale so only a limited number of values are possible, for example, gender, race, etc.  

Differences between independent and dependent variables  

The following table compares independent vs dependent variables .  

Independent and dependent variable examples  

Listed below are a few examples of research questions from various disciplines and their corresponding independent and dependent variables.( 6)

  Independent vs dependent variables in research  

Experiments usually have at least two variables—independent and dependent. The independent variable is the entity that is being tested and the dependent variable is the result. Classifying independent and dependent variables as discrete and continuous can help in determining the type of analysis that is appropriate in any given research experiment, as shown in the table below. ( 7)  

  Here are some more research questions and their corresponding independent and dependent variables. ( 6)  

  How to identify independent vs dependent variables  

In addition to all the characteristics of independent and dependent variables listed previously, here are few simple steps to identify the variable types in a research question.( 8)  

• Keep in mind that there are no specific words that will always describe dependent and independent variables.  
• If you’re given a paragraph, convert that into a question and identify specific words describing cause and effect.  
• The word representing the cause is the independent variable and that describing the effect is the dependent variable.  

Let’s try out these steps with an example.  

A researcher wants to conduct a study to see if his new weight loss medication performs better than two bestseller alternatives. He wants to randomly select 20 subjects from Richmond, Virginia, aged 20 to 30 years and weighing above 60 pounds. Each subject will be randomly assigned to three treatment groups.  

To identify the independent and dependent variables, we convert this paragraph into a question, as follows: Does the new medication perform better than the alternatives? Here, the medications are the independent variable and their performances or effect on the individuals are the dependent variable.  

Visualizing independent vs dependent variables  

Data visualization is the graphical representation of information by using charts, graphs, and maps. Visualizations help in making data more understandable by making it easier to compare elements, identify trends and relationships (among variables), among other functions.  

Bar graphs, pie charts, and scatter plots are the best methods to graphically represent variables. While pie charts and bar graphs are suitable for depicting categorical data, scatter plots are appropriate for quantitative data. The independent variable is usually placed on the X-axis and the dependent variable on the Y-axis.  

Figure 1 is a scatter plot that depicts the relationship between the number of household members and their monthly grocery expenses. 9 The number of household members is the independent variable and the expenses the dependent variable. The graph shows that as the number of members increases the expenditure also increases.  

Key takeaways   

Let’s summarize the key takeaways about independent vs dependent variables from this article:  

• A variable is any entity being measured in a study.  
• A dependent variable is often the focus of a research study and is the response or outcome. It depends on or varies with changes in other variables.  
• Independent variables cause changes in dependent variables and don’t depend on other variables.  
• An independent variable can influence a dependent variable, but a dependent variable cannot influence an independent variable.  
• An independent variable is the cause and dependent variable is the effect.  

Frequently asked questions  

• What are the different types of variables used in research?  

The following table lists the different types of variables used in research.( 10)  

 2. Why is it important to differentiate between independent vs dependent variables ?  

  Differentiating between independent vs dependent variables is important to ensure the correct application in your own research and also the correct understanding of other studies. An incorrectly framed research question can lead to confusion and inaccurate results. An easy way to differentiate is to identify the cause and effect.  

 3. How are independent and dependent variables used in non-experimental research?  

  So far in this article we talked about variables in relation to experimental research, wherein variables are manipulated or measured to test a hypothesis, that is, to observe the effect on dependent variables. Let’s examine non-experimental research and how variable are used. 11 In non-experimental research, variables are not manipulated but are observed in their natural state. Researchers do not have control over the variables and cannot manipulate them based on their research requirements. For example, a study examining the relationship between income and education level would not manipulate either variable. Instead, the researcher would observe and measure the levels of each variable in the sample population. The level of control researchers have is the major difference between experimental and non-experimental research. Another difference is the causal relationship between the variables. In non-experimental research, it is not possible to establish a causal relationship because other variables may be influencing the outcome.  

  4. Are there any advantages and disadvantages of using independent vs dependent variables ?

  Here are a few advantages and disadvantages of both independent and dependent variables.( 12)

Advantages: 

• Dependent variables are not liable to any form of bias because they cannot be manipulated by researchers or other external factors.  
• Independent variables are easily obtainable and don’t require complex mathematical procedures to be observed, like dependent variables. This is because researchers can easily manipulate these variables or collect the data from respondents.  
• Some independent variables are natural factors and cannot be manipulated. They are also easily obtainable because less time is required for data collection.

Disadvantages: 

• Obtaining dependent variables is a very expensive and effort- and time-intensive process because these variables are obtained from longitudinal research by solving complex equations.  
• Independent variables are prone to researcher and respondent bias because they can be manipulated, and this may affect the study results.  

We hope this article has provided you with an insight into the use and importance of independent vs dependent variables , which can help you effectively use variables in your next research study.    

• Kaliyadan F, Kulkarni V. Types of variables, descriptive statistics, and sample size. Indian Dermatol Online J. 2019 Jan-Feb; 10(1): 82–86. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6362742/  
• What Is an independent variable? (with uses and examples). Indeed website. Accessed March 11, 2024. https://www.indeed.com/career-advice/career-development/what-is-independent-variable  
• Independent and dependent variables: Differences & examples. Statistics by Jim website. Accessed March 10, 2024. https://statisticsbyjim.com/regression/independent-dependent-variables/  
• Independent variable. Biology online website. Accessed March 9, 2024. https://www.biologyonline.com/dictionary/independent-variable#:~:text=The%20independent%20variable%20in%20research,how%20many%20or%20how%20often .  
• Dependent variables: Definition and examples. Clubz Tutoring Services website. Accessed March 10, 2024. https://clubztutoring.com/ed-resources/math/dependent-variable-definitions-examples-6-7-2/  
• Research topics with independent and dependent variables. Good research topics website. Accessed March 12, 2024. https://goodresearchtopics.com/research-topics-with-independent-and-dependent-variables/  
• Levels of measurement and using the correct statistical test. Univariate quantitative methods. Accessed March 14, 2024. https://web.pdx.edu/~newsomj/uvclass/ho_levels.pdf  
• Easiest way to identify dependent and independent variables. Afidated website. Accessed March 15, 2024. https://www.afidated.com/2014/07/how-to-identify-dependent-and.html  
• Choosing data visualizations. Math for the people website. Accessed March 14, 2024. https://web.stevenson.edu/mbranson/m4tp/version1/environmental-racism-choosing-data-visualization.html  
• Trivedi C. Types of variables in scientific research. Concepts Hacked website. Accessed March 15, 2024. https://conceptshacked.com/variables-in-scientific-research/  
• Variables in experimental and non-experimental research. Statistics solutions website. Accessed March 14, 2024. https://www.statisticssolutions.com/variables-in-experimental-and-non-experimental-research/#:~:text=The%20independent%20variable%20would%20be,state%20instead%20of%20manipulating%20them .  
• Dependent vs independent variables: 11 key differences. Formplus website. Accessed March 15, 2024. https://www.formpl.us/blog/dependent-independent-variables

Researcher.Life is a subscription-based platform that unifies the best AI tools and services designed to speed up, simplify, and streamline every step of a researcher’s journey. The Researcher.Life All Access Pack is a one-of-a-kind subscription that unlocks full access to an AI writing assistant, literature recommender, journal finder, scientific illustration tool, and exclusive discounts on professional publication services from Editage.  

Based on 21+ years of experience in academia, Researcher.Life All Access empowers researchers to put their best research forward and move closer to success. Explore our top AI Tools pack, AI Tools + Publication Services pack, or Build Your Own Plan. Find everything a researcher needs to succeed, all in one place –  Get All Access now starting at just $17 a month !    

Related Posts

What is Research? Definition, Types, Methods, and Examples

Language and Cultural Barriers in Research: How to Bridge the Gap

Our websites may use cookies to personalize and enhance your experience. By continuing without changing your cookie settings, you agree to this collection. For more information, please see our University Websites Privacy Notice .

Neag School of Education

Educational Research Basics by Del Siegle

Each person/thing we collect data on is called an OBSERVATION (in our work these are usually people/subjects. Currently, the term participant rather than subject is used when describing the people from whom we collect data).

OBSERVATIONS (participants) possess a variety of CHARACTERISTICS .

If a CHARACTERISTIC of an OBSERVATION (participant) is the same for every member of the group (doesn’t vary) it is called a CONSTANT .

If a CHARACTERISTIC of an OBSERVATION (participant) differs for group members it is called a VARIABLE . In research we don’t get excited about CONSTANTS (since everyone is the same on that characteristic); we’re more interested in VARIABLES. Variables can be classified as QUANTITATIVE or QUALITATIVE (also known as CATEGORICAL).

QUANTITATIVE variables are ones that exist along a continuum that runs from low to high. Ordinal, interval, and ratio variables are quantitative.  QUANTITATIVE variables are sometimes called CONTINUOUS VARIABLES because they have a variety (continuum) of characteristics. Height in inches and scores on a test would be examples of quantitative variables.

QUALITATIVE variables do not express differences in amount, only differences. They are sometimes referred to as CATEGORICAL variables because they classify by categories. Nominal variables such as gender, religion, or eye color are CATEGORICAL variables. Generally speaking, categorical variables

A special case of a CATEGORICAL variable is a DICHOTOMOUS VARIABLE. DICHOTOMOUS variables have only two CHARACTERISTICS (male or female). When naming QUALITATIVE variables, it is important to name the category rather than the levels (i.e., gender is the variable name, not male and female).

Variables have different purposes or roles…

Independent (Experimental, Manipulated, Treatment, Grouping) Variable- That factor which is measured, manipulated, or selected by the experimenter to determine its relationship to an observed phenomenon. “In a research study, independent variables are antecedent conditions that are presumed to affect a dependent variable. They are either manipulated by the researcher or are observed by the researcher so that their values can be related to that of the dependent variable. For example, in a research study on the relationship between mosquitoes and mosquito bites, the number of mosquitoes per acre of ground would be an independent variable” (Jaeger, 1990, p. 373)

While the independent variable is often manipulated by the researcher, it can also be a classification where subjects are assigned to groups. In a study where one variable causes the other, the independent variable is the cause. In a study where groups are being compared, the independent variable is the group classification.

Dependent (Outcome) Variable- That factor which is observed and measured to determine the effect of the independent variable, i.e., that factor that appears, disappears, or varies as the experimenter introduces, removes, or varies the independent variable. “In a research study, the independent variable defines a principal focus of research interest. It is the consequent variable that is presumably affected by one or more independent variables that are either manipulated by the researcher or observed by the researcher and regarded as antecedent conditions that determine the value of the dependent variable. For example, in a study of the relationship between mosquitoes and mosquito bites, the number of mosquito bites per hour would be the dependent variable” (Jaeger, 1990, p. 370). The dependent variable is the participant’s response.

The dependent variable is the outcome. In an experiment, it may be what was caused or what changed as a result of the study. In a comparison of groups, it is what they differ on.

Moderator Variable- That factor which is measured, manipulated, or selected by the experimenter to discover whether it modifies the relationship of the independent variable to an observed phenomenon. It is a special type of independent variable.

The independent variable’s relationship with the dependent variable may change under different conditions. That condition is the moderator variable. In a study of two methods of teaching reading, one of the methods of teaching reading may work better with boys than girls. Method of teaching reading is the independent variable and reading achievement is the dependent variable. Gender is the moderator variable because it moderates or changes the relationship between the independent variable (teaching method) and the dependent variable (reading achievement).

Suppose we do a study of reading achievement where we compare whole language with phonics, and we also include students’ social economic status (SES) as a variable. The students are randomly assigned to either whole language instruction or phonics instruction. There are students of high and low SES in each group.

Let’s assume that we found that whole language instruction worked better than phonics instruction with the high SES students, but phonics instruction worked better than whole language instruction with the low SES students. Later you will learn in statistics that this is an interaction effect. In this study, language instruction was the independent variable (with two levels: phonics and whole language). SES was the moderator variable (with two levels: high and low). Reading achievement was the dependent variable (measured on a continuous scale so there aren’t levels).

With a moderator variable, we find the type of instruction did make a difference, but it worked differently for the two groups on the moderator variable. We select this moderator variable because we think it is a variable that will moderate the effect of the independent on the dependent. We make this decision before we start the study.

If the moderator had not been in the study above, we would have said that there was no difference in reading achievement between the two types of reading instruction. This would have happened because the average of the high and low scores of each SES group within a reading instruction group would cancel each other an produce what appears to be average reading achievement in each instruction group (i.e., Phonics: Low—6 and High—2; Whole Language:   Low—2 and High—6; Phonics has an average of 4 and Whole Language has an average of 4. If we just look at the averages (without regard to the moderator), it appears that the instruction types produced similar results).

Extraneous Variable- Those factors which cannot be controlled. Extraneous variables are independent variables that have not been controlled. They may or may not influence the results. One way to control an extraneous variable which might influence the results is to make it a constant (keep everyone in the study alike on that characteristic). If SES were thought to influence achievement, then restricting the study to one SES level would eliminate SES as an extraneous variable.

Here are some examples similar to your homework:

Null Hypothesis: Students who receive pizza coupons as a reward do not read more books than students who do not receive pizza coupon rewards. Independent Variable: Reward Status Dependent Variable: Number of Books Read

High achieving students do not perform better than low achieving student when writing stories regardless of whether they use paper and pencil or a word processor. Independent Variable: Instrument Used for Writing Moderator Variable: Ability Level of the Students Dependent Variable:  Quality of Stories Written When we are comparing two groups, the groups are the independent variable. When we are testing whether something influences something else, the influence (cause) is the independent variable. The independent variable is also the one we manipulate. For example, consider the hypothesis “Teachers given higher pay will have more positive attitudes toward children than teachers given lower pay.” One approach is to ask ourselves “Are there two or more groups being compared?” The answer is “Yes.” “What are the groups?” Teachers who are given higher pay and teachers who are given lower pay. Therefore, the independent variable is teacher pay (it has two levels– high pay and low pay). The dependent variable (what the groups differ on) is attitude towards school.

We could also approach this another way. “Is something causing something else?” The answer is “Yes.” “What is causing what?” Teacher pay is causing attitude towards school. Therefore, teacher pay is the independent variable (cause) and attitude towards school is the dependent variable (outcome).

Research Questions and Hypotheses

The research question drives the study. It should specifically state what is being investigated. Statisticians often convert their research questions to null and alternative hypotheses. The null hypothesis states that no relationship (correlation study) or difference (experimental study) exists. Converting research questions to hypotheses is a simple task. Take the questions and make it a positive statement that says a relationship exists (correlation studies) or a difference exists (experiment study) between the groups and we have the alternative hypothesis. Write a statement  that a relationship does not exist or a difference does not exist and we have the null hypothesis.

Format for sample research questions and accompanying hypotheses:

Research Question for Relationships: Is there a relationship between height and weight? Null Hypothesis:  There is no relationship between height and weight. Alternative Hypothesis:   There is a relationship between height and weight.

When a researcher states a nondirectional hypothesis in a study that compares the performance of two groups, she doesn’t state which group she believes will perform better. If the word “more” or “less” appears in the hypothesis, there is a good chance that we are reading a directional hypothesis. A directional hypothesis is one where the researcher states which group she believes will perform better.  Most researchers use nondirectional hypotheses.

We usually write the alternative hypothesis (what we believe might happen) before we write the null hypothesis (saying it won’t happen).

Directional Research Question for Differences: Do boys like reading more than girls? Null Hypothesis:   Boys do not like reading more than girls. Alternative Hypothesis:   Boys do like reading more than girls.

Nondirectional Research Question for Differences: Is there a difference between boys’ and girls’ attitude towards reading? –or– Do boys’ and girls’ attitude towards reading differ? Null Hypothesis:   There is no difference between boys’ and girls’ attitude towards reading.  –or–  Boys’ and girls’ attitude towards reading do not differ. Alternative Hypothesis:   There is a difference between boys’ and girls’ attitude towards reading.  –or–  Boys’ and girls’ attitude towards reading differ.

Del Siegle, Ph.D. Neag School of Education – University of Connecticut [email protected] www.delsiegle.com

The Plagiarism Checker Online For Your Academic Work

Start Plagiarism Check

Editing & Proofreading for Your Research Paper

Get it proofread now

Online Printing & Binding with Free Express Delivery

Configure binding now

• Academic essay overview
• The writing process
• Structuring academic essays
• Types of academic essays
• Academic writing overview
• Sentence structure
• Academic writing process
• Improving your academic writing
• Titles and headings
• APA style overview
• APA citation & referencing
• APA structure & sections
• Citation & referencing
• Structure and sections
• APA examples overview
• Commonly used citations
• Other examples
• British English vs. American English
• Chicago style overview
• Chicago citation & referencing
• Chicago structure & sections
• Chicago style examples
• Citing sources overview
• Citation format
• Citation examples
• College essay overview
• Application
• How to write a college essay
• Types of college essays
• Commonly confused words
• Definitions
• Dissertation overview
• Dissertation structure & sections
• Dissertation writing process
• Graduate school overview
• Application & admission
• Study abroad
• Master degree
• Harvard referencing overview
• Language rules overview
• Grammatical rules & structures
• Parts of speech
• Punctuation
• Methodology overview
• Analyzing data
• Experiments
• Observations
• Inductive vs. Deductive
• Qualitative vs. Quantitative
• Types of validity
• Types of reliability
• Sampling methods
• Theories & Concepts
• Types of research studies
• Types of variables
• MLA style overview
• MLA examples
• MLA citation & referencing
• MLA structure & sections
• Plagiarism overview
• Plagiarism checker
• Types of plagiarism
• Printing production overview
• Research bias overview
• Types of research bias
• Example sections
• Types of research papers
• Research process overview
• Problem statement
• Research proposal
• Research topic
• Statistics overview
• Levels of measurment
• Frequency distribution
• Measures of central tendency
• Measures of variability
• Hypothesis testing
• Parameters & test statistics
• Types of distributions
• Correlation
• Effect size
• Hypothesis testing assumptions
• Types of ANOVAs
• Types of chi-square
• Statistical data
• Statistical models
• Spelling mistakes
• Tips overview
• Academic writing tips
• Dissertation tips
• Sources tips
• Working with sources overview
• Evaluating sources
• Finding sources
• Including sources
• Types of sources

Your Step to Success

Plagiarism Check within 10min

Printing & Binding with 3D Live Preview

Types of Variables in Research – Definition & Examples

How do you like this article cancel reply.

Save my name, email, and website in this browser for the next time I comment.

A fundamental component in statistical investigations is the methodology you employ in selecting your research variables. The careful selection of appropriate variable types can significantly enhance the robustness of your experimental design . This piece explores the diverse array of variable classifications within the field of statistical research. Additionally, understanding the different types of variables in research can greatly aid in shaping your experimental hypotheses and outcomes.

Inhaltsverzeichnis

• 1 Types of Variables in Research – In a Nutshell
• 2 Definition: Types of variables in research
• 3 Types of variables in research – Quantitative vs. Categorical
• 4 Types of variables in research – Independent vs. Dependent
• 5 Other useful types of variables in research

Types of Variables in Research – In a Nutshell

• A variable is an attribute of an item of analysis in research.
• The types of variables in research can be categorized into: independent vs. dependent , or categorical vs. quantitative .
• The types of variables in research (correlational) can be classified into predictor or outcome variables.
• Other types of variables in research are confounding variables , latent variables , and composite variables.

Definition: Types of variables in research

A variable is a trait of an item of analysis in research. Types of variables in research are imperative, as they describe and measure places, people, ideas , or other research objects . There are many types of variables in research. Therefore, you must choose the right types of variables in research for your study.

Note that the correct variable will help with your research design , test selection, and result interpretation.

In a study testing whether some genders are more stress-tolerant than others, variables you can include are the level of stressors in the study setting, male and female subjects, and productivity levels in the presence of stressors.

Also, before choosing which types of variables in research to use, you should know how the various types work and the ideal statistical tests and result interpretations you will use for your study. The key is to determine the type of data the variable contains and the part of the experiment the variable represents.

Types of variables in research – Quantitative vs. Categorical

Data is the precise extent of a variable in statistical research that you record in a data sheet. It is generally divided into quantitative and categorical classes.

Quantitative or numerical data represents amounts, while categorical data represents collections or groupings.

The type of data contained in your variable will determine the types of variables in research. For instance, variables consisting of quantitative data are called quantitative variables, while those containing categorical data are called categorical variables. The section below explains these two types of variables in research better.

Quantitative variables

The scores you record when collecting quantitative data usually represent real values you can add, divide , subtract , or multiply . There are two types of quantitative variables: discrete variables and continuous variables .

The table below explains the elements that set apart discrete and continuous types of variables in research:

Categorical variables

Categorical variables contain data representing groupings. Additionally, the data in categorical variables is sometimes recorded as numbers . However, the numbers represent categories instead of real amounts.

There are three categorical types of variables in research: nominal variables, ordinal variables , and binary variables . Here is a tabular summary.

It is worth mentioning that some categorical variables can function as multiple types. For example, in some studies, you can use ordinal variables as quantitative variables if the scales are numerical and not discrete.

Data sheet of quantitative and categorical variables

A data sheet is where you record the data on the variables in your experiment.

In a study of the salt-tolerance levels of various plant species, you can record the data on salt addition and how the plant responds in your datasheet.

The key is to gather the information and draw a conclusion over a specific period and filling out a data sheet along the process.

Below is an example of a data sheet containing binary, nominal, continuous , and ordinal types of variables in research.

Types of variables in research – Independent vs. Dependent

The purpose of experiments is to determine how the variables affect each other. As stated in our experiment above, the study aims to find out how the quantity of salt introduce in the water affects the plant’s growth and survival.

Therefore, the researcher manipulates the independent variables and measures the dependent variables . Additionally, you may have control variables that you hold constant.

The table below summarizes independent variables, dependent variables , and control variables .

Data sheet of independent and dependent variables

In salt-tolerance research, there is one independent variable (salt amount) and three independent variables. All other variables are neither dependent nor independent.

Below is a data sheet based on our experiment:

Types of variables in correlational research

The types of variables in research may differ depending on the study.

In correlational research , dependent and independent variables do not apply because the study objective is not to determine the cause-and-effect link between variables.

However, in correlational research, one variable may precede the other, as illness leads to death, and not vice versa. In such an instance, the preceding variable, like illness, is the predictor variable, while the other one is the outcome variable.

Other useful types of variables in research

The key to conducting effective research is to define your types of variables as independent and dependent. Next, you must determine if they are categorical or numerical types of variables in research so you can choose the proper statistical tests for your study.

Below are other types of variables in research worth understanding.

What is the definition for independent and dependent variables?

An autonomous or independent variable is the one you believe is the origin of the outcome, while the dependent variable is the one you believe affects the outcome of your study.

What are quantitative and categorical variables?

Knowing the types of variables in research that you can work with will help you choose the best statistical tests and result representation techniques. It will also help you with your study design.

Discrete and continuous variables: What is their difference?

Discrete variables are types of variables in research that represent counts, like the quantities of objects. In contrast, continuous variables are types of variables in research that represent measurable quantities like age, volume, and weight.

We use cookies on our website. Some of them are essential, while others help us to improve this website and your experience.

• External Media

Individual Privacy Preferences

Cookie Details Privacy Policy Imprint

Here you will find an overview of all cookies used. You can give your consent to whole categories or display further information and select certain cookies.

Accept all Save

Essential cookies enable basic functions and are necessary for the proper function of the website.

Show Cookie Information Hide Cookie Information

Statistics cookies collect information anonymously. This information helps us to understand how our visitors use our website.

Content from video platforms and social media platforms is blocked by default. If External Media cookies are accepted, access to those contents no longer requires manual consent.

Privacy Policy Imprint

• Bipolar Disorder
• Therapy Center
• When To See a Therapist
• Types of Therapy
• Best Online Therapy
• Best Couples Therapy
• Best Family Therapy
• Managing Stress
• Sleep and Dreaming
• Understanding Emotions
• Self-Improvement
• Healthy Relationships
• Student Resources
• Personality Types
• Guided Meditations
• Verywell Mind Insights
• 2024 Verywell Mind 25
• Mental Health in the Classroom
• Editorial Process
• Meet Our Review Board
• Crisis Support

Types of Variables in Psychology Research

Examples of Independent and Dependent Variables

Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."

 James Lacy, MLS, is a fact-checker and researcher.

Dependent and Independent Variables

• Intervening Variables
• Extraneous Variables
• Controlled Variables
• Confounding Variables
• Operationalizing Variables

Frequently Asked Questions

Variables in psychology are things that can be changed or altered, such as a characteristic or value. Variables are generally used in psychology experiments to determine if changes to one thing result in changes to another.

Variables in psychology play a critical role in the research process. By systematically changing some variables in an experiment and measuring what happens as a result, researchers are able to learn more about cause-and-effect relationships.

The two main types of variables in psychology are the independent variable and the dependent variable. Both variables are important in the process of collecting data about psychological phenomena.

This article discusses different types of variables that are used in psychology research. It also covers how to operationalize these variables when conducting experiments.

Students often report problems with identifying the independent and dependent variables in an experiment. While this task can become more difficult as the complexity of an experiment increases, in a psychology experiment:

• The independent variable is the variable that is manipulated by the experimenter. An example of an independent variable in psychology: In an experiment on the impact of sleep deprivation on test performance, sleep deprivation would be the independent variable. The experimenters would have some of the study participants be sleep-deprived while others would be fully rested.
• The dependent variable is the variable that is measured by the experimenter. In the previous example, the scores on the test performance measure would be the dependent variable.

So how do you differentiate between the independent and dependent variables? Start by asking yourself what the experimenter is manipulating. The things that change, either naturally or through direct manipulation from the experimenter, are generally the independent variables. What is being measured? The dependent variable is the one that the experimenter is measuring.

Intervening Variables in Psychology

Intervening variables, also sometimes called intermediate or mediator variables, are factors that play a role in the relationship between two other variables. In the previous example, sleep problems in university students are often influenced by factors such as stress. As a result, stress might be an intervening variable that plays a role in how much sleep people get, which may then influence how well they perform on exams.

Extraneous Variables in Psychology

Independent and dependent variables are not the only variables present in many experiments. In some cases, extraneous variables may also play a role. This type of variable is one that may have an impact on the relationship between the independent and dependent variables.

For example, in our previous example of an experiment on the effects of sleep deprivation on test performance, other factors such as age, gender, and academic background may have an impact on the results. In such cases, the experimenter will note the values of these extraneous variables so any impact can be controlled for.

There are two basic types of extraneous variables:

• Participant variables : These extraneous variables are related to the individual characteristics of each study participant that may impact how they respond. These factors can include background differences, mood, anxiety, intelligence, awareness, and other characteristics that are unique to each person.
• Situational variables : These extraneous variables are related to things in the environment that may impact how each participant responds. For example, if a participant is taking a test in a chilly room, the temperature would be considered an extraneous variable. Some participants may not be affected by the cold, but others might be distracted or annoyed by the temperature of the room.

Other extraneous variables include the following:

• Demand characteristics : Clues in the environment that suggest how a participant should behave
• Experimenter effects : When a researcher unintentionally suggests clues for how a participant should behave

Controlled Variables in Psychology

In many cases, extraneous variables are controlled for by the experimenter. A controlled variable is one that is held constant throughout an experiment.

In the case of participant variables, the experiment might select participants that are the same in background and temperament to ensure that these factors don't interfere with the results. Holding these variables constant is important for an experiment because it allows researchers to be sure that all other variables remain the same across all conditions.  

Using controlled variables means that when changes occur, the researchers can be sure that these changes are due to the manipulation of the independent variable and not caused by changes in other variables.

It is important to also note that a controlled variable is not the same thing as a control group . The control group in a study is the group of participants who do not receive the treatment or change in the independent variable.

All other variables between the control group and experimental group are held constant (i.e., they are controlled). The dependent variable being measured is then compared between the control group and experimental group to see what changes occurred because of the treatment.

Confounding Variables in Psychology

If a variable cannot be controlled for, it becomes what is known as a confounding variabl e. This type of variable can have an impact on the dependent variable, which can make it difficult to determine if the results are due to the influence of the independent variable, the confounding variable, or an interaction of the two.

Operationalizing Variables in Psychology

An operational definition describes how the variables are measured and defined in the study. Before conducting a psychology experiment , it is essential to create firm operational definitions for both the independent variable and dependent variables.

For example, in our imaginary experiment on the effects of sleep deprivation on test performance, we would need to create very specific operational definitions for our two variables. If our hypothesis is "Students who are sleep deprived will score significantly lower on a test," then we would have a few different concepts to define:

• Students : First, what do we mean by "students?" In our example, let’s define students as participants enrolled in an introductory university-level psychology course.
• Sleep deprivation : Next, we need to operationally define the "sleep deprivation" variable. In our example, let’s say that sleep deprivation refers to those participants who have had less than five hours of sleep the night before the test.
• Test variable : Finally, we need to create an operational definition for the test variable. For this example, the test variable will be defined as a student’s score on a chapter exam in the introductory psychology course.

Once all the variables are operationalized, we're ready to conduct the experiment.

Variables play an important part in psychology research. Manipulating an independent variable and measuring the dependent variable allows researchers to determine if there is a cause-and-effect relationship between them.

A Word From Verywell

Understanding the different types of variables used in psychology research is important if you want to conduct your own psychology experiments. It is also helpful for people who want to better understand what the results of psychology research really mean and become more informed consumers of psychology information .

Independent and dependent variables are used in experimental research. Unlike some other types of research (such as correlational studies ), experiments allow researchers to evaluate cause-and-effect relationships between two variables.

Researchers can use statistical analyses to determine the strength of a relationship between two variables in an experiment. Two of the most common ways to do this are to calculate a p-value or a correlation. The p-value indicates if the results are statistically significant while the correlation can indicate the strength of the relationship.

In an experiment on how sugar affects short-term memory, sugar intake would be the independent variable and scores on a short-term memory task would be the independent variable.

In an experiment looking at how caffeine intake affects test anxiety, the amount of caffeine consumed before a test would be the independent variable and scores on a test anxiety assessment would be the dependent variable.

Just as with other types of research, the independent variable in a cognitive psychology study would be the variable that the researchers manipulate. The specific independent variable would vary depending on the specific study, but it might be focused on some aspect of thinking, memory, attention, language, or decision-making.

American Psychological Association. Operational definition . APA Dictionary of Psychology.

American Psychological Association. Mediator . APA Dictionary of Psychology.

Altun I, Cınar N, Dede C. The contributing factors to poor sleep experiences in according to the university students: A cross-sectional study .  J Res Med Sci . 2012;17(6):557-561. PMID:23626634

Skelly AC, Dettori JR, Brodt ED. Assessing bias: The importance of considering confounding .  Evid Based Spine Care J . 2012;3(1):9-12. doi:10.1055/s-0031-1298595

• Evans, AN & Rooney, BJ. Methods in Psychological Research. Thousand Oaks, CA: SAGE Publications; 2014.
• Kantowitz, BH, Roediger, HL, & Elmes, DG. Experimental Psychology. Stamfort, CT: Cengage Learning; 2015.

By Kendra Cherry, MSEd Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."

In order to continue enjoying our site, we ask that you confirm your identity as a human. Thank you very much for your cooperation.

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

• Knowledge Base

Methodology

• What Is Quantitative Research? | Definition, Uses & Methods

What Is Quantitative Research? | Definition, Uses & Methods

Published on June 12, 2020 by Pritha Bhandari . Revised on June 22, 2023.

Quantitative research is the process of collecting and analyzing numerical data. It can be used to find patterns and averages, make predictions, test causal relationships, and generalize results to wider populations.

Quantitative research is the opposite of qualitative research , which involves collecting and analyzing non-numerical data (e.g., text, video, or audio).

Quantitative research is widely used in the natural and social sciences: biology, chemistry, psychology, economics, sociology, marketing, etc.

• What is the demographic makeup of Singapore in 2020?
• How has the average temperature changed globally over the last century?
• Does environmental pollution affect the prevalence of honey bees?
• Does working from home increase productivity for people with long commutes?

Table of contents

Quantitative research methods, quantitative data analysis, advantages of quantitative research, disadvantages of quantitative research, other interesting articles, frequently asked questions about quantitative research.

You can use quantitative research methods for descriptive, correlational or experimental research.

• In descriptive research , you simply seek an overall summary of your study variables.
• In correlational research , you investigate relationships between your study variables.
• In experimental research , you systematically examine whether there is a cause-and-effect relationship between variables.

Correlational and experimental research can both be used to formally test hypotheses , or predictions, using statistics. The results may be generalized to broader populations based on the sampling method used.

To collect quantitative data, you will often need to use operational definitions that translate abstract concepts (e.g., mood) into observable and quantifiable measures (e.g., self-ratings of feelings and energy levels).

Note that quantitative research is at risk for certain research biases , including information bias , omitted variable bias , sampling bias , or selection bias . Be sure that you’re aware of potential biases as you collect and analyze your data to prevent them from impacting your work too much.

Here's why students love Scribbr's proofreading services

Discover proofreading & editing

Once data is collected, you may need to process it before it can be analyzed. For example, survey and test data may need to be transformed from words to numbers. Then, you can use statistical analysis to answer your research questions .

Descriptive statistics will give you a summary of your data and include measures of averages and variability. You can also use graphs, scatter plots and frequency tables to visualize your data and check for any trends or outliers.

Using inferential statistics , you can make predictions or generalizations based on your data. You can test your hypothesis or use your sample data to estimate the population parameter .

First, you use descriptive statistics to get a summary of the data. You find the mean (average) and the mode (most frequent rating) of procrastination of the two groups, and plot the data to see if there are any outliers.

You can also assess the reliability and validity of your data collection methods to indicate how consistently and accurately your methods actually measured what you wanted them to.

Quantitative research is often used to standardize data collection and generalize findings . Strengths of this approach include:

• Replication

Repeating the study is possible because of standardized data collection protocols and tangible definitions of abstract concepts.

• Direct comparisons of results

The study can be reproduced in other cultural settings, times or with different groups of participants. Results can be compared statistically.

• Large samples

Data from large samples can be processed and analyzed using reliable and consistent procedures through quantitative data analysis.

• Hypothesis testing

Using formalized and established hypothesis testing procedures means that you have to carefully consider and report your research variables, predictions, data collection and testing methods before coming to a conclusion.

Despite the benefits of quantitative research, it is sometimes inadequate in explaining complex research topics. Its limitations include:

• Superficiality

Using precise and restrictive operational definitions may inadequately represent complex concepts. For example, the concept of mood may be represented with just a number in quantitative research, but explained with elaboration in qualitative research.

• Narrow focus

Predetermined variables and measurement procedures can mean that you ignore other relevant observations.

• Structural bias

Despite standardized procedures, structural biases can still affect quantitative research. Missing data , imprecise measurements or inappropriate sampling methods are biases that can lead to the wrong conclusions.

• Lack of context

Quantitative research often uses unnatural settings like laboratories or fails to consider historical and cultural contexts that may affect data collection and results.

If you want to know more about statistics , methodology , or research bias , make sure to check out some of our other articles with explanations and examples.

• Chi square goodness of fit test
• Degrees of freedom
• Null hypothesis
• Discourse analysis
• Control groups
• Mixed methods research
• Non-probability sampling
• Inclusion and exclusion criteria

Research bias

• Rosenthal effect
• Implicit bias
• Cognitive bias
• Selection bias
• Negativity bias
• Status quo bias

Quantitative research deals with numbers and statistics, while qualitative research deals with words and meanings.

Quantitative methods allow you to systematically measure variables and test hypotheses . Qualitative methods allow you to explore concepts and experiences in more detail.

In mixed methods research , you use both qualitative and quantitative data collection and analysis methods to answer your research question .

Data collection is the systematic process by which observations or measurements are gathered in research. It is used in many different contexts by academics, governments, businesses, and other organizations.

Operationalization means turning abstract conceptual ideas into measurable observations.

For example, the concept of social anxiety isn’t directly observable, but it can be operationally defined in terms of self-rating scores, behavioral avoidance of crowded places, or physical anxiety symptoms in social situations.

Before collecting data , it’s important to consider how you will operationalize the variables that you want to measure.

Reliability and validity are both about how well a method measures something:

• Reliability refers to the  consistency of a measure (whether the results can be reproduced under the same conditions).
• Validity   refers to the  accuracy of a measure (whether the results really do represent what they are supposed to measure).

If you are doing experimental research, you also have to consider the internal and external validity of your experiment.

Hypothesis testing is a formal procedure for investigating our ideas about the world using statistics. It is used by scientists to test specific predictions, called hypotheses , by calculating how likely it is that a pattern or relationship between variables could have arisen by chance.

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

Bhandari, P. (2023, June 22). What Is Quantitative Research? | Definition, Uses & Methods. Scribbr. Retrieved June 18, 2024, from https://www.scribbr.com/methodology/quantitative-research/

Is this article helpful?

Pritha Bhandari

Other students also liked, descriptive statistics | definitions, types, examples, inferential statistics | an easy introduction & examples, get unlimited documents corrected.

✔ Free APA citation check included ✔ Unlimited document corrections ✔ Specialized in correcting academic texts

Higher Education News , Tips for Online Students , Tips for Students

A Comprehensive Guide to Different Types of Research

Updated: June 18, 2024

Published: June 15, 2024

When embarking on a research project, selecting the right methodology can be the difference between success and failure. With various methods available, each suited to different types of research, it’s essential you make an informed choice. This blog post will provide tips on how to choose a research methodology that best fits your research goals .

We’ll start with definitions: Research is the systematic process of exploring, investigating, and discovering new information or validating existing knowledge. It involves defining questions, collecting data, analyzing results, and drawing conclusions.

Meanwhile, a research methodology is a structured plan that outlines how your research is to be conducted. A complete methodology should detail the strategies, processes, and techniques you plan to use for your data collection and analysis.

Research Methods

The first step of a research methodology is to identify a focused research topic, which is the question you seek to answer. By setting clear boundaries on the scope of your research, you can concentrate on specific aspects of a problem without being overwhelmed by information. This will produce more accurate findings. 

Along with clarifying your research topic, your methodology should also address your research methods. Let’s look at the four main types of research: descriptive, correlational, experimental, and diagnostic.

Descriptive Research

Descriptive research is an approach designed to describe the characteristics of a population systematically and accurately. This method focuses on answering “what” questions by providing detailed observations about the subject. Descriptive research employs surveys, observational studies , and case studies to gather qualitative or quantitative data. 

A real-world example of descriptive research is a survey investigating consumer behavior toward a competitor’s product. By analyzing the survey results, the company can gather detailed insights into how consumers perceive a competitor’s product, which can inform their marketing strategies and product development.

Correlational Research

Correlational research examines the statistical relationship between two or more variables to determine whether a relationship exists. Correlational research is particularly useful when ethical or practical constraints prevent experimental manipulation. It is often employed in fields such as psychology, education, and health sciences to provide insights into complex real-world interactions, helping to develop theories and inform further experimental research.

An example of correlational research is the study of the relationship between smoking and lung cancer. Researchers observe and collect data on individuals’ smoking habits and the incidence of lung cancer to determine if there is a correlation between the two variables. This type of research helps identify patterns and relationships, indicating whether increased smoking is associated with higher rates of lung cancer.

Experimental Research

Experimental research is a scientific approach where researchers manipulate one or more independent variables to observe their effect on a dependent variable. This method is designed to establish cause-and-effect relationships. Fields like psychology , medicine, and social sciences frequently employ experimental research to test hypotheses and theories under controlled conditions. 

A real-world example of experimental research is Pavlov’s Dog experiment. In this experiment, Ivan Pavlov demonstrated classical conditioning by ringing a bell each time he fed his dogs. After repeating this process multiple times, the dogs began to salivate just by hearing the bell, even when no food was presented. This experiment helped to illustrate how certain stimuli can elicit specific responses through associative learning.

Diagnostic Research

Diagnostic research tries to accurately diagnose a problem by identifying its underlying causes. This type of research is crucial for understanding complex situations where a precise diagnosis is necessary for formulating effective solutions. It involves methods such as case studies and data analysis and often integrates both qualitative and quantitative data to provide a comprehensive view of the issue at hand. 

An example of diagnostic research is studying the causes of a specific illness outbreak. During an outbreak of a respiratory virus, researchers might conduct diagnostic research to determine the factors contributing to the spread of the virus. This could involve analyzing patient data, testing environmental samples, and evaluating potential sources of infection. The goal is to identify the root causes and contributing factors to develop effective containment and prevention strategies.

Using an established research method is imperative, no matter if you are researching for marketing , technology , healthcare , engineering, or social science. A methodology lends legitimacy to your research by ensuring your data is both consistent and credible. A well-defined methodology also enhances the reliability and validity of the research findings, which is crucial for drawing accurate and meaningful conclusions. 

Additionally, methodologies help researchers stay focused and on track, limiting the scope of the study to relevant questions and objectives. This not only improves the quality of the research but also ensures that the study can be replicated and verified by other researchers, further solidifying its scientific value.

How to Choose a Research Methodology

Choosing the best research methodology for your project involves several key steps to ensure that your approach aligns with your research goals and questions. Here’s a simplified guide to help you make the best choice.

Understand Your Goals

Clearly define the objectives of your research. What do you aim to discover, prove, or understand? Understanding your goals helps in selecting a methodology that aligns with your research purpose.

Consider the Nature of Your Data

Determine whether your research will involve numerical data, textual data, or both. Quantitative methods are best for numerical data, while qualitative methods are suitable for textual or thematic data.

Understand the Purpose of Each Methodology

Becoming familiar with the four types of research – descriptive, correlational, experimental, and diagnostic – will enable you to select the most appropriate method for your research. Many times, you will want to use a combination of methods to gather meaningful data. 

Evaluate Resources and Constraints

Consider the resources available to you, including time, budget, and access to data. Some methodologies may require more resources or longer timeframes to implement effectively.

Review Similar Studies

Look at previous research in your field to see which methodologies were successful. This can provide insights and help you choose a proven approach.

By following these steps, you can select a research methodology that best fits your project’s requirements and ensures robust, credible results.

Completing Your Research Project

Upon completing your research, the next critical step is to analyze and interpret the data you’ve collected. This involves summarizing the key findings, identifying patterns, and determining how these results address your initial research questions. By thoroughly examining the data, you can draw meaningful conclusions that contribute to the body of knowledge in your field. 

It’s essential that you present these findings clearly and concisely, using charts, graphs, and tables to enhance comprehension. Furthermore, discuss the implications of your results, any limitations encountered during the study, and how your findings align with or challenge existing theories.

Your research project should conclude with a strong statement that encapsulates the essence of your research and its broader impact. This final section should leave readers with a clear understanding of the value of your work and inspire continued exploration and discussion in the field.

Now that you know how to perform quality research , it’s time to get started! Applying the right research methodologies can make a significant difference in the accuracy and reliability of your findings. Remember, the key to successful research is not just in collecting data, but in analyzing it thoughtfully and systematically to draw meaningful conclusions. So, dive in, explore, and contribute to the ever-growing body of knowledge with confidence. Happy researching!

Related Articles

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• J Korean Med Sci
• v.37(16); 2022 Apr 25

A Practical Guide to Writing Quantitative and Qualitative Research Questions and Hypotheses in Scholarly Articles

Edward barroga.

1 Department of General Education, Graduate School of Nursing Science, St. Luke’s International University, Tokyo, Japan.

Glafera Janet Matanguihan

2 Department of Biological Sciences, Messiah University, Mechanicsburg, PA, USA.

The development of research questions and the subsequent hypotheses are prerequisites to defining the main research purpose and specific objectives of a study. Consequently, these objectives determine the study design and research outcome. The development of research questions is a process based on knowledge of current trends, cutting-edge studies, and technological advances in the research field. Excellent research questions are focused and require a comprehensive literature search and in-depth understanding of the problem being investigated. Initially, research questions may be written as descriptive questions which could be developed into inferential questions. These questions must be specific and concise to provide a clear foundation for developing hypotheses. Hypotheses are more formal predictions about the research outcomes. These specify the possible results that may or may not be expected regarding the relationship between groups. Thus, research questions and hypotheses clarify the main purpose and specific objectives of the study, which in turn dictate the design of the study, its direction, and outcome. Studies developed from good research questions and hypotheses will have trustworthy outcomes with wide-ranging social and health implications.

INTRODUCTION

Scientific research is usually initiated by posing evidenced-based research questions which are then explicitly restated as hypotheses. 1 , 2 The hypotheses provide directions to guide the study, solutions, explanations, and expected results. 3 , 4 Both research questions and hypotheses are essentially formulated based on conventional theories and real-world processes, which allow the inception of novel studies and the ethical testing of ideas. 5 , 6

It is crucial to have knowledge of both quantitative and qualitative research 2 as both types of research involve writing research questions and hypotheses. 7 However, these crucial elements of research are sometimes overlooked; if not overlooked, then framed without the forethought and meticulous attention it needs. Planning and careful consideration are needed when developing quantitative or qualitative research, particularly when conceptualizing research questions and hypotheses. 4

There is a continuing need to support researchers in the creation of innovative research questions and hypotheses, as well as for journal articles that carefully review these elements. 1 When research questions and hypotheses are not carefully thought of, unethical studies and poor outcomes usually ensue. Carefully formulated research questions and hypotheses define well-founded objectives, which in turn determine the appropriate design, course, and outcome of the study. This article then aims to discuss in detail the various aspects of crafting research questions and hypotheses, with the goal of guiding researchers as they develop their own. Examples from the authors and peer-reviewed scientific articles in the healthcare field are provided to illustrate key points.

DEFINITIONS AND RELATIONSHIP OF RESEARCH QUESTIONS AND HYPOTHESES

A research question is what a study aims to answer after data analysis and interpretation. The answer is written in length in the discussion section of the paper. Thus, the research question gives a preview of the different parts and variables of the study meant to address the problem posed in the research question. 1 An excellent research question clarifies the research writing while facilitating understanding of the research topic, objective, scope, and limitations of the study. 5

On the other hand, a research hypothesis is an educated statement of an expected outcome. This statement is based on background research and current knowledge. 8 , 9 The research hypothesis makes a specific prediction about a new phenomenon 10 or a formal statement on the expected relationship between an independent variable and a dependent variable. 3 , 11 It provides a tentative answer to the research question to be tested or explored. 4

Hypotheses employ reasoning to predict a theory-based outcome. 10 These can also be developed from theories by focusing on components of theories that have not yet been observed. 10 The validity of hypotheses is often based on the testability of the prediction made in a reproducible experiment. 8

Conversely, hypotheses can also be rephrased as research questions. Several hypotheses based on existing theories and knowledge may be needed to answer a research question. Developing ethical research questions and hypotheses creates a research design that has logical relationships among variables. These relationships serve as a solid foundation for the conduct of the study. 4 , 11 Haphazardly constructed research questions can result in poorly formulated hypotheses and improper study designs, leading to unreliable results. Thus, the formulations of relevant research questions and verifiable hypotheses are crucial when beginning research. 12

CHARACTERISTICS OF GOOD RESEARCH QUESTIONS AND HYPOTHESES

Excellent research questions are specific and focused. These integrate collective data and observations to confirm or refute the subsequent hypotheses. Well-constructed hypotheses are based on previous reports and verify the research context. These are realistic, in-depth, sufficiently complex, and reproducible. More importantly, these hypotheses can be addressed and tested. 13

There are several characteristics of well-developed hypotheses. Good hypotheses are 1) empirically testable 7 , 10 , 11 , 13 ; 2) backed by preliminary evidence 9 ; 3) testable by ethical research 7 , 9 ; 4) based on original ideas 9 ; 5) have evidenced-based logical reasoning 10 ; and 6) can be predicted. 11 Good hypotheses can infer ethical and positive implications, indicating the presence of a relationship or effect relevant to the research theme. 7 , 11 These are initially developed from a general theory and branch into specific hypotheses by deductive reasoning. In the absence of a theory to base the hypotheses, inductive reasoning based on specific observations or findings form more general hypotheses. 10

TYPES OF RESEARCH QUESTIONS AND HYPOTHESES

Research questions and hypotheses are developed according to the type of research, which can be broadly classified into quantitative and qualitative research. We provide a summary of the types of research questions and hypotheses under quantitative and qualitative research categories in Table 1 .

Research questions in quantitative research

In quantitative research, research questions inquire about the relationships among variables being investigated and are usually framed at the start of the study. These are precise and typically linked to the subject population, dependent and independent variables, and research design. 1 Research questions may also attempt to describe the behavior of a population in relation to one or more variables, or describe the characteristics of variables to be measured ( descriptive research questions ). 1 , 5 , 14 These questions may also aim to discover differences between groups within the context of an outcome variable ( comparative research questions ), 1 , 5 , 14 or elucidate trends and interactions among variables ( relationship research questions ). 1 , 5 We provide examples of descriptive, comparative, and relationship research questions in quantitative research in Table 2 .

Hypotheses in quantitative research

In quantitative research, hypotheses predict the expected relationships among variables. 15 Relationships among variables that can be predicted include 1) between a single dependent variable and a single independent variable ( simple hypothesis ) or 2) between two or more independent and dependent variables ( complex hypothesis ). 4 , 11 Hypotheses may also specify the expected direction to be followed and imply an intellectual commitment to a particular outcome ( directional hypothesis ) 4 . On the other hand, hypotheses may not predict the exact direction and are used in the absence of a theory, or when findings contradict previous studies ( non-directional hypothesis ). 4 In addition, hypotheses can 1) define interdependency between variables ( associative hypothesis ), 4 2) propose an effect on the dependent variable from manipulation of the independent variable ( causal hypothesis ), 4 3) state a negative relationship between two variables ( null hypothesis ), 4 , 11 , 15 4) replace the working hypothesis if rejected ( alternative hypothesis ), 15 explain the relationship of phenomena to possibly generate a theory ( working hypothesis ), 11 5) involve quantifiable variables that can be tested statistically ( statistical hypothesis ), 11 6) or express a relationship whose interlinks can be verified logically ( logical hypothesis ). 11 We provide examples of simple, complex, directional, non-directional, associative, causal, null, alternative, working, statistical, and logical hypotheses in quantitative research, as well as the definition of quantitative hypothesis-testing research in Table 3 .

Research questions in qualitative research

Unlike research questions in quantitative research, research questions in qualitative research are usually continuously reviewed and reformulated. The central question and associated subquestions are stated more than the hypotheses. 15 The central question broadly explores a complex set of factors surrounding the central phenomenon, aiming to present the varied perspectives of participants. 15

There are varied goals for which qualitative research questions are developed. These questions can function in several ways, such as to 1) identify and describe existing conditions ( contextual research question s); 2) describe a phenomenon ( descriptive research questions ); 3) assess the effectiveness of existing methods, protocols, theories, or procedures ( evaluation research questions ); 4) examine a phenomenon or analyze the reasons or relationships between subjects or phenomena ( explanatory research questions ); or 5) focus on unknown aspects of a particular topic ( exploratory research questions ). 5 In addition, some qualitative research questions provide new ideas for the development of theories and actions ( generative research questions ) or advance specific ideologies of a position ( ideological research questions ). 1 Other qualitative research questions may build on a body of existing literature and become working guidelines ( ethnographic research questions ). Research questions may also be broadly stated without specific reference to the existing literature or a typology of questions ( phenomenological research questions ), may be directed towards generating a theory of some process ( grounded theory questions ), or may address a description of the case and the emerging themes ( qualitative case study questions ). 15 We provide examples of contextual, descriptive, evaluation, explanatory, exploratory, generative, ideological, ethnographic, phenomenological, grounded theory, and qualitative case study research questions in qualitative research in Table 4 , and the definition of qualitative hypothesis-generating research in Table 5 .

Qualitative studies usually pose at least one central research question and several subquestions starting with How or What . These research questions use exploratory verbs such as explore or describe . These also focus on one central phenomenon of interest, and may mention the participants and research site. 15

Hypotheses in qualitative research

Hypotheses in qualitative research are stated in the form of a clear statement concerning the problem to be investigated. Unlike in quantitative research where hypotheses are usually developed to be tested, qualitative research can lead to both hypothesis-testing and hypothesis-generating outcomes. 2 When studies require both quantitative and qualitative research questions, this suggests an integrative process between both research methods wherein a single mixed-methods research question can be developed. 1

FRAMEWORKS FOR DEVELOPING RESEARCH QUESTIONS AND HYPOTHESES

Research questions followed by hypotheses should be developed before the start of the study. 1 , 12 , 14 It is crucial to develop feasible research questions on a topic that is interesting to both the researcher and the scientific community. This can be achieved by a meticulous review of previous and current studies to establish a novel topic. Specific areas are subsequently focused on to generate ethical research questions. The relevance of the research questions is evaluated in terms of clarity of the resulting data, specificity of the methodology, objectivity of the outcome, depth of the research, and impact of the study. 1 , 5 These aspects constitute the FINER criteria (i.e., Feasible, Interesting, Novel, Ethical, and Relevant). 1 Clarity and effectiveness are achieved if research questions meet the FINER criteria. In addition to the FINER criteria, Ratan et al. described focus, complexity, novelty, feasibility, and measurability for evaluating the effectiveness of research questions. 14

The PICOT and PEO frameworks are also used when developing research questions. 1 The following elements are addressed in these frameworks, PICOT: P-population/patients/problem, I-intervention or indicator being studied, C-comparison group, O-outcome of interest, and T-timeframe of the study; PEO: P-population being studied, E-exposure to preexisting conditions, and O-outcome of interest. 1 Research questions are also considered good if these meet the “FINERMAPS” framework: Feasible, Interesting, Novel, Ethical, Relevant, Manageable, Appropriate, Potential value/publishable, and Systematic. 14

As we indicated earlier, research questions and hypotheses that are not carefully formulated result in unethical studies or poor outcomes. To illustrate this, we provide some examples of ambiguous research question and hypotheses that result in unclear and weak research objectives in quantitative research ( Table 6 ) 16 and qualitative research ( Table 7 ) 17 , and how to transform these ambiguous research question(s) and hypothesis(es) into clear and good statements.

a These statements were composed for comparison and illustrative purposes only.

b These statements are direct quotes from Higashihara and Horiuchi. 16

a This statement is a direct quote from Shimoda et al. 17

The other statements were composed for comparison and illustrative purposes only.

CONSTRUCTING RESEARCH QUESTIONS AND HYPOTHESES

To construct effective research questions and hypotheses, it is very important to 1) clarify the background and 2) identify the research problem at the outset of the research, within a specific timeframe. 9 Then, 3) review or conduct preliminary research to collect all available knowledge about the possible research questions by studying theories and previous studies. 18 Afterwards, 4) construct research questions to investigate the research problem. Identify variables to be accessed from the research questions 4 and make operational definitions of constructs from the research problem and questions. Thereafter, 5) construct specific deductive or inductive predictions in the form of hypotheses. 4 Finally, 6) state the study aims . This general flow for constructing effective research questions and hypotheses prior to conducting research is shown in Fig. 1 .

Research questions are used more frequently in qualitative research than objectives or hypotheses. 3 These questions seek to discover, understand, explore or describe experiences by asking “What” or “How.” The questions are open-ended to elicit a description rather than to relate variables or compare groups. The questions are continually reviewed, reformulated, and changed during the qualitative study. 3 Research questions are also used more frequently in survey projects than hypotheses in experiments in quantitative research to compare variables and their relationships.

Hypotheses are constructed based on the variables identified and as an if-then statement, following the template, ‘If a specific action is taken, then a certain outcome is expected.’ At this stage, some ideas regarding expectations from the research to be conducted must be drawn. 18 Then, the variables to be manipulated (independent) and influenced (dependent) are defined. 4 Thereafter, the hypothesis is stated and refined, and reproducible data tailored to the hypothesis are identified, collected, and analyzed. 4 The hypotheses must be testable and specific, 18 and should describe the variables and their relationships, the specific group being studied, and the predicted research outcome. 18 Hypotheses construction involves a testable proposition to be deduced from theory, and independent and dependent variables to be separated and measured separately. 3 Therefore, good hypotheses must be based on good research questions constructed at the start of a study or trial. 12

In summary, research questions are constructed after establishing the background of the study. Hypotheses are then developed based on the research questions. Thus, it is crucial to have excellent research questions to generate superior hypotheses. In turn, these would determine the research objectives and the design of the study, and ultimately, the outcome of the research. 12 Algorithms for building research questions and hypotheses are shown in Fig. 2 for quantitative research and in Fig. 3 for qualitative research.

EXAMPLES OF RESEARCH QUESTIONS FROM PUBLISHED ARTICLES

• EXAMPLE 1. Descriptive research question (quantitative research)
• - Presents research variables to be assessed (distinct phenotypes and subphenotypes)
• “BACKGROUND: Since COVID-19 was identified, its clinical and biological heterogeneity has been recognized. Identifying COVID-19 phenotypes might help guide basic, clinical, and translational research efforts.
• RESEARCH QUESTION: Does the clinical spectrum of patients with COVID-19 contain distinct phenotypes and subphenotypes? ” 19
• EXAMPLE 2. Relationship research question (quantitative research)
• - Shows interactions between dependent variable (static postural control) and independent variable (peripheral visual field loss)
• “Background: Integration of visual, vestibular, and proprioceptive sensations contributes to postural control. People with peripheral visual field loss have serious postural instability. However, the directional specificity of postural stability and sensory reweighting caused by gradual peripheral visual field loss remain unclear.
• Research question: What are the effects of peripheral visual field loss on static postural control ?” 20
• EXAMPLE 3. Comparative research question (quantitative research)
• - Clarifies the difference among groups with an outcome variable (patients enrolled in COMPERA with moderate PH or severe PH in COPD) and another group without the outcome variable (patients with idiopathic pulmonary arterial hypertension (IPAH))
• “BACKGROUND: Pulmonary hypertension (PH) in COPD is a poorly investigated clinical condition.
• RESEARCH QUESTION: Which factors determine the outcome of PH in COPD?
• STUDY DESIGN AND METHODS: We analyzed the characteristics and outcome of patients enrolled in the Comparative, Prospective Registry of Newly Initiated Therapies for Pulmonary Hypertension (COMPERA) with moderate or severe PH in COPD as defined during the 6th PH World Symposium who received medical therapy for PH and compared them with patients with idiopathic pulmonary arterial hypertension (IPAH) .” 21
• EXAMPLE 4. Exploratory research question (qualitative research)
• - Explores areas that have not been fully investigated (perspectives of families and children who receive care in clinic-based child obesity treatment) to have a deeper understanding of the research problem
• “Problem: Interventions for children with obesity lead to only modest improvements in BMI and long-term outcomes, and data are limited on the perspectives of families of children with obesity in clinic-based treatment. This scoping review seeks to answer the question: What is known about the perspectives of families and children who receive care in clinic-based child obesity treatment? This review aims to explore the scope of perspectives reported by families of children with obesity who have received individualized outpatient clinic-based obesity treatment.” 22
• EXAMPLE 5. Relationship research question (quantitative research)
• - Defines interactions between dependent variable (use of ankle strategies) and independent variable (changes in muscle tone)
• “Background: To maintain an upright standing posture against external disturbances, the human body mainly employs two types of postural control strategies: “ankle strategy” and “hip strategy.” While it has been reported that the magnitude of the disturbance alters the use of postural control strategies, it has not been elucidated how the level of muscle tone, one of the crucial parameters of bodily function, determines the use of each strategy. We have previously confirmed using forward dynamics simulations of human musculoskeletal models that an increased muscle tone promotes the use of ankle strategies. The objective of the present study was to experimentally evaluate a hypothesis: an increased muscle tone promotes the use of ankle strategies. Research question: Do changes in the muscle tone affect the use of ankle strategies ?” 23

EXAMPLES OF HYPOTHESES IN PUBLISHED ARTICLES

• EXAMPLE 1. Working hypothesis (quantitative research)
• - A hypothesis that is initially accepted for further research to produce a feasible theory
• “As fever may have benefit in shortening the duration of viral illness, it is plausible to hypothesize that the antipyretic efficacy of ibuprofen may be hindering the benefits of a fever response when taken during the early stages of COVID-19 illness .” 24
• “In conclusion, it is plausible to hypothesize that the antipyretic efficacy of ibuprofen may be hindering the benefits of a fever response . The difference in perceived safety of these agents in COVID-19 illness could be related to the more potent efficacy to reduce fever with ibuprofen compared to acetaminophen. Compelling data on the benefit of fever warrant further research and review to determine when to treat or withhold ibuprofen for early stage fever for COVID-19 and other related viral illnesses .” 24
• EXAMPLE 2. Exploratory hypothesis (qualitative research)
• - Explores particular areas deeper to clarify subjective experience and develop a formal hypothesis potentially testable in a future quantitative approach
• “We hypothesized that when thinking about a past experience of help-seeking, a self distancing prompt would cause increased help-seeking intentions and more favorable help-seeking outcome expectations .” 25
• “Conclusion
• Although a priori hypotheses were not supported, further research is warranted as results indicate the potential for using self-distancing approaches to increasing help-seeking among some people with depressive symptomatology.” 25
• EXAMPLE 3. Hypothesis-generating research to establish a framework for hypothesis testing (qualitative research)
• “We hypothesize that compassionate care is beneficial for patients (better outcomes), healthcare systems and payers (lower costs), and healthcare providers (lower burnout). ” 26
• Compassionomics is the branch of knowledge and scientific study of the effects of compassionate healthcare. Our main hypotheses are that compassionate healthcare is beneficial for (1) patients, by improving clinical outcomes, (2) healthcare systems and payers, by supporting financial sustainability, and (3) HCPs, by lowering burnout and promoting resilience and well-being. The purpose of this paper is to establish a scientific framework for testing the hypotheses above . If these hypotheses are confirmed through rigorous research, compassionomics will belong in the science of evidence-based medicine, with major implications for all healthcare domains.” 26
• EXAMPLE 4. Statistical hypothesis (quantitative research)
• - An assumption is made about the relationship among several population characteristics ( gender differences in sociodemographic and clinical characteristics of adults with ADHD ). Validity is tested by statistical experiment or analysis ( chi-square test, Students t-test, and logistic regression analysis)
• “Our research investigated gender differences in sociodemographic and clinical characteristics of adults with ADHD in a Japanese clinical sample. Due to unique Japanese cultural ideals and expectations of women's behavior that are in opposition to ADHD symptoms, we hypothesized that women with ADHD experience more difficulties and present more dysfunctions than men . We tested the following hypotheses: first, women with ADHD have more comorbidities than men with ADHD; second, women with ADHD experience more social hardships than men, such as having less full-time employment and being more likely to be divorced.” 27
• “Statistical Analysis
• ( text omitted ) Between-gender comparisons were made using the chi-squared test for categorical variables and Students t-test for continuous variables…( text omitted ). A logistic regression analysis was performed for employment status, marital status, and comorbidity to evaluate the independent effects of gender on these dependent variables.” 27

EXAMPLES OF HYPOTHESIS AS WRITTEN IN PUBLISHED ARTICLES IN RELATION TO OTHER PARTS

• EXAMPLE 1. Background, hypotheses, and aims are provided
• “Pregnant women need skilled care during pregnancy and childbirth, but that skilled care is often delayed in some countries …( text omitted ). The focused antenatal care (FANC) model of WHO recommends that nurses provide information or counseling to all pregnant women …( text omitted ). Job aids are visual support materials that provide the right kind of information using graphics and words in a simple and yet effective manner. When nurses are not highly trained or have many work details to attend to, these job aids can serve as a content reminder for the nurses and can be used for educating their patients (Jennings, Yebadokpo, Affo, & Agbogbe, 2010) ( text omitted ). Importantly, additional evidence is needed to confirm how job aids can further improve the quality of ANC counseling by health workers in maternal care …( text omitted )” 28
• “ This has led us to hypothesize that the quality of ANC counseling would be better if supported by job aids. Consequently, a better quality of ANC counseling is expected to produce higher levels of awareness concerning the danger signs of pregnancy and a more favorable impression of the caring behavior of nurses .” 28
• “This study aimed to examine the differences in the responses of pregnant women to a job aid-supported intervention during ANC visit in terms of 1) their understanding of the danger signs of pregnancy and 2) their impression of the caring behaviors of nurses to pregnant women in rural Tanzania.” 28
• EXAMPLE 2. Background, hypotheses, and aims are provided
• “We conducted a two-arm randomized controlled trial (RCT) to evaluate and compare changes in salivary cortisol and oxytocin levels of first-time pregnant women between experimental and control groups. The women in the experimental group touched and held an infant for 30 min (experimental intervention protocol), whereas those in the control group watched a DVD movie of an infant (control intervention protocol). The primary outcome was salivary cortisol level and the secondary outcome was salivary oxytocin level.” 29
• “ We hypothesize that at 30 min after touching and holding an infant, the salivary cortisol level will significantly decrease and the salivary oxytocin level will increase in the experimental group compared with the control group .” 29
• EXAMPLE 3. Background, aim, and hypothesis are provided
• “In countries where the maternal mortality ratio remains high, antenatal education to increase Birth Preparedness and Complication Readiness (BPCR) is considered one of the top priorities [1]. BPCR includes birth plans during the antenatal period, such as the birthplace, birth attendant, transportation, health facility for complications, expenses, and birth materials, as well as family coordination to achieve such birth plans. In Tanzania, although increasing, only about half of all pregnant women attend an antenatal clinic more than four times [4]. Moreover, the information provided during antenatal care (ANC) is insufficient. In the resource-poor settings, antenatal group education is a potential approach because of the limited time for individual counseling at antenatal clinics.” 30
• “This study aimed to evaluate an antenatal group education program among pregnant women and their families with respect to birth-preparedness and maternal and infant outcomes in rural villages of Tanzania.” 30
• “ The study hypothesis was if Tanzanian pregnant women and their families received a family-oriented antenatal group education, they would (1) have a higher level of BPCR, (2) attend antenatal clinic four or more times, (3) give birth in a health facility, (4) have less complications of women at birth, and (5) have less complications and deaths of infants than those who did not receive the education .” 30

Research questions and hypotheses are crucial components to any type of research, whether quantitative or qualitative. These questions should be developed at the very beginning of the study. Excellent research questions lead to superior hypotheses, which, like a compass, set the direction of research, and can often determine the successful conduct of the study. Many research studies have floundered because the development of research questions and subsequent hypotheses was not given the thought and meticulous attention needed. The development of research questions and hypotheses is an iterative process based on extensive knowledge of the literature and insightful grasp of the knowledge gap. Focused, concise, and specific research questions provide a strong foundation for constructing hypotheses which serve as formal predictions about the research outcomes. Research questions and hypotheses are crucial elements of research that should not be overlooked. They should be carefully thought of and constructed when planning research. This avoids unethical studies and poor outcomes by defining well-founded objectives that determine the design, course, and outcome of the study.

Disclosure: The authors have no potential conflicts of interest to disclose.

Author Contributions:

• Conceptualization: Barroga E, Matanguihan GJ.
• Methodology: Barroga E, Matanguihan GJ.
• Writing - original draft: Barroga E, Matanguihan GJ.
• Writing - review & editing: Barroga E, Matanguihan GJ.

• - Google Chrome

Intended for healthcare professionals

• My email alerts
• BMA member login
• Username * Password * Forgot your log in details? Need to activate BMA Member Log In Log in via OpenAthens Log in via your institution

Search form

• Advanced search
• Search responses
• Search blogs
• ROBVALU: a tool for...

ROBVALU: a tool for assessing risk of bias in studies about people’s values, utilities, or importance of health outcomes

• Related content
• Peer review
• Samer G Karam , doctoral student 1 2 ,
• Yuan Zhang , assistant clinical professor 1 2 ,
• Hector Pardo-Hernandez , researcher 3 4 ,
• Uwe Siebert , professor 5 6 7 ,
• Laura Koopman , senior adviser 8 ,
• Jane Noyes , professor 9 ,
• Jean-Eric Tarride , professor 1 10 11 ,
• Adrienne L Stevens , manager 12 ,
• Vivian Welch , senior investigator 13 ,
• Zuleika Saz-Parkinson , project adviser 14 ,
• Brendalynn Ens , director (retired) 15 ,
• Tahira Devji , medical student 16 ,
• Feng Xie , professor 1 10 ,
• Glen Hazlewood , associate professor 17 18 ,
• Lawrence Mbuagbaw , associate professor 1 19 20 21 22 23 ,
• Pablo Alonso-Coello , senior researcher 3 4 24 ,
• Jan L Brozek , associate professor 1 2 ,
• Holger J Schünemann , professor 1 25
• 1 Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON, Canada
• 2 Michael G DeGroote Cochrane Canada and McMaster GRADE Centres, McMaster University, Hamilton, ON, Canada
• 3 Iberoamerican Cochrane Centre, Sant Antoni Maria Claret, Barcelona, Spain
• 4 Centro de Investigación Biomédica en Red de Epidemiología y Salud Pública (CIBERESP), Madrid, Spain
• 5 Department of Public Health, Health Services Research and Health Technology Assessment, Institute of Public Health, Medical Decision Making and Health Technology Assessment, UMIT TIROL-University for Health Sciences and Technology, Hall in Tirol, Austria
• 6 Center for Health Decision Science and Departments of Epidemiology and Health Policy and Management, Harvard T H Chan School of Public Health, Boston, MA, USA
• 7 Institute for Technology Assessment and Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
• 8 Department of Specialist Medical Care, National Health Care Institute, Diemen, Netherlands
• 9 School of Medical and Health Sciences, Bangor University, Wales, UK
• 10 Centre for Health Economics and Policy Analysis, McMaster University Faculty of Health Sciences, Hamilton, ON, Canada
• 11 Programs for Assessment of Technologies in Health, St Joseph’s Healthcare Hamilton, Hamilton, ON, Canada
• 12 Centre for Immunisation Programmes, Public Health Agency of Canada, ON, Canada
• 13 Bruyère Research Institute and, School of Epidemiology and Public Health, University of Ottawa, Ottawa, ON, Canada
• 14 European Commission, Joint Research Centre, Ispra, Italy
• 15 Implementation Support and Knowledge Mobilisation, Canadian Agency for Drugs and Technologies in Health, Ottawa, ON, Canada
• 16 Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada.
• 17 Department of Medicine, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
• 18 Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
• 19 Department of Anaesthesia, McMaster University, Hamilton, ON, Canada
• 20 Department of Paediatrics, McMaster University, Hamilton, ON, Canada
• 21 Biostatistics Unit, Father Sean O’Sullivan Research Centre, St Joseph’s Healthcare, Hamilton, ON, Canada
• 22 Centre for Development of Best Practices in Health, Yaoundé Central Hospital, Yaoundé, Cameroon
• 23 Division of Epidemiology and Biostatistics, Department of Global Health, Stellenbosch University, Cape Town, South Africa
• 24 Institut de Recerca Sant Pau (IR SANT PAU), Sant Quintí, Barcelona, Spain
• 25 Clinical Epidemiology and Research Centre (CERC), Humanitas University and Humanitas Research Hospital, Via Rita Levi Montalcini 4, 20090 Pieve Emanuele, Milan, Italy
• Correspondence to: H J Schünemann schuneh{at}mcmaster.ca
• Accepted 9 April 2024

People’s values are an important driver in healthcare decision making. The certainty of an intervention’s effect on benefits and harms relies on two factors: the certainty in the measured effect on an outcome in terms of risk difference and the certainty in its value, also known as utility or importance. The GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) working group has proposed a set of questions to assess the risk of bias in a body of evidence from studies investigating how people value outcomes. However, these questions do not address risk of bias in individual studies that, similar to risk-of-bias tools for other research studies, is required to evaluate such evidence. Thus, the Risk of Bias in studies of Values and Utilities (ROBVALU) tool was developed. ROBVALU has good psychometric properties and will be useful when assessing individual studies in measuring values, utilities, or the importance of outcomes. As such, ROBVALU can be used to assess risk of bias in studies included in systematic reviews and health guidelines. It also can support health research assessments, where the risk of bias of input variables determines the certainty in model outputs. These assessments include, for example, decision analysis and cost utility or cost effectiveness analysis for health technology assessment, health policy, and reimbursement decision making.

Healthcare decision making relies on evidence on the relative effectiveness, safety, and cost effectiveness of an intervention evaluated in appropriate studies. 1 2 Choosing between different interventions (such as preventive, diagnostic, or treatment strategies) depends on the importance or value that people place on specific health states or health outcomes. 2 Values have a major role at different levels of decision making, from the individual level to the healthcare system level. In this context, people’s values reflect the importance they place on outcomes of interest that result from decisions about using an intervention—for example, taking a certain test or starting a new treatment regimen. 2 We use the term “people” when talking about value because the term is inclusive to patients, healthcare providers, policy makers, and the general public.

Utility instruments are widely used to elicit the absolute value of a health outcome, and provide an index measure anchored on a scale with 1 reflecting perfect health and 0 reflecting being dead. 3 4 Various methods are used to establish values, including direct measures of utility, indirect measurements of utility, or qualitative research. 2 5 The visual analogue scale (VAS) is one of the simplest measures to elicit these values. People are asked to rate a health state on a VAS that is then converted to a utility value. 6 7 While the scale directly measures the importance of an outcome, concerns exist about how accurate and valid it might be. 2 Other direct measures such as the standard gamble and time trade-off require people to choose between their current health state and a treatment option that could result in perfect health or in immediate death. 4 8 Discrete choice experiments ask people to choose between two or more treatment options where the choices differ in terms of their attributes, that are defined by the investigators. 9 The relative importance of each attribute is then inferred by analysing the responses, assuming that patients choose the option with the highest value. 9 Indirect methods of measuring utility values include validated, health related, quality-of-life instruments, such as the EQ-5D and the Health Utilities Index. 10 The EQ-5D requires respondents to answer questions across five domains that are converted to a utility value using validated scoring systems. 11 12

Summary points

Assessing the risk of bias in individual studies is an essential step to determine overall certainty of evidence in a systematic review or health technology assessment and for guideline development

The Risk of Bias in Values and Utilities (ROBVALU) tool assesses risk of bias in quantitative studies of people’s values, utilities, or importance of outcomes

A sequential mixed methods approach was used to develop ROBVALU, initially based on signalling questions and subdomains developed by the GRADE working group to assess risk of bias; a modified Delphi approach was used for final refinement of the tool

ROBVALU covers four separate subdomains through which bias might be introduced; individual subdomain judgments inform the overall risk of bias of studies

ROBVALU has demonstrated high validity and reliability

General application of utility values in research

These utility values allow researchers to weigh the benefits and harms of an option and, thus, they also are important in health economics and health technology assessments. 3 13 For instance, in decision analysis, they are required to calculate quality adjusted life years. Confidence in studies that report on values needs to be ascertained for decision making in guideline recommendations, health technology assessments, or coverage decision. 14 For example, in a systematic review on people with chronic obstructive pulmonary disease, we found moderate certainty that patients value adverse events as important, but on average valued them as less important than symptom relief. 15 We also found moderate certainty that exacerbation and hospital admission owing to exacerbation are the outcomes that patients with chronic obstructive pulmonary disease rate as most important. In another example, a systematic review on patients’ values on venous thromboembolism, we found that people with cancer placed more importance on a reduction in new or recurrent venous thromboembolism than on a decrease in major or minor bleeding events. 16

The Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) Evidence to Decision frameworks is a widely used approach in guidelines, health technology assessment, and other decisions. The frameworks require judgments about the certainty in how much people value the main outcomes: “Is there important uncertainty about . . . how much people value the main outcomes?” 17 18 A key determinant of certainty is internal validity—that is, how well individual studies were designed and conducted (ie, internal validity, which GRADE and Cochrane label as the risk-of-bias (ROB) domain).

Risk of bias

Similar to other study designs, threats to internal validity arising from the study design, conduct, analysis, and reporting of the study introduce ROB in research on utility values. 2 Poor study quality could result in indirectness which encompasses applicability and external validity, often as a result of PICO (patient/population, intervention, comparison, and outcomes) elements. Another quality issue is low sample size or no sample size calculation, which could result in imprecision. ROB assessment tools are developed to assess biases that result in threats of internal validity and would not measure indirectness and precision. Quality assessment tools and reporting checklists often include all factors of a study’s qualities and safeguards, but these tools differ from a ROB assessment tool that aims to present a ROB judgment for a study. A key factor that might introduce bias in values studies is the instrument used to measure utilities of the people in the study. Bias means that a value people place on an outcome in a research study (eg, a value of 0.5 for stroke) would be systematically different from the true value that people would place on that outcome. For example, the true unbiased value might be 0.3 and, thus, use of biased estimates would provide inaccurate answers in the modelling and health decision making context.

ROB assessment tools exist for many study designs, including the Cochrane Risk of Bias 2 (RoB 2) for randomised trials, 19 ROBINS-I for non-randomised studies of the effects of interventions, 20 and ROBINS-E for studies about exposures. 21 22 Critical appraisal tools to assess the quality of a study are also study design specific, such as the Newcastle-Ottawa scale and the Joanna Briggs Institute’s critical appraisal tool for cross sectional studies. 23 24 These tools are regularly used by researchers to assess the quality of individual studies or to assess ROB, but they were not developed for studies on utility values. These checklists invariably include questions specific to the study design, which would not always be appropriate to answer in studies about people’s values (eg, “Were there deviations from the intended intervention that arose because of the trial context?” or “Was the exposure measured in a valid and reliable way?”). 19 21 22 For studies on utility values, a major concern that is not adequately addressed by any commonly used ROB tool is the method used to elicit people’s values. The measurement instrument needs to be valid and reliable, be used appropriately, use valid health outcomes, and explore proper understanding of the instrument. No validated tool is available for the nuanced assessment of ROB in individual studies measuring utility values. 9 20 25 26

To properly implement evidence based decision making and formulate evidence based recommendations in clinical or public health guidelines, evaluation of ROB is crucial in studies of values, utilities, or importance of outcomes. However, owing to the absence of specialised and validated tools to assess ROB, this evaluation is rarely done. Thus, our goal was to develop, validate, and describe a pragmatic tool for studies measuring the value people place on health outcomes with appropriate guidance to apply it correctly.

Development of the ROBVALU tool and guidance

We used a sequential, mixed methods approach to develop ROBVALU and related guidance document (supplement S1), 27 starting with a qualitative approach and followed by a quantitative phase to assess the psychometric properties of the tool ( fig 1 ). In the qualitative phase, we first considered the ROB signalling questions (appendix table A1) and subdomains that we had developed for GRADE guidance to assess ROB about values across studies in a body of evidence. 2 For that GRADE guidance, we iteratively developed the subdomains and signalling questions starting with a list of 23 items identified as part of a systematic survey project. 26 The core research group reviewed the 23 items to identify any missing item that might be relevant for the single study ROBVALU tool. After thorough group discussions, a decision was made not to add any new items or subdomains to avoid complexity, thereby improving applicability, feasibility, and adoption of the tool.

Tool development process for the Risk of Bias in Values and Utilities (ROBVALU) tool. GRADE=Grading of Recommendations, Assessment, Development, and Evaluation

• Download figure
• Open in new tab
• Download powerpoint

We first structured a preliminary version of the tool and added simple considerations to help answer the signalling questions. These signalling questions were categorised into four subdomains: selection of participants into the study, completeness of data, measurement instrument, and data analysis. We used a 4 point, Likert-type scale (ie, yes, probably yes, probably no, no) to judge the individual items, to avoid a neutral option of a 5 point Likert scale when studies lack sufficient information to make a proper judgment. In each subdomain, the tool asked how important and how serious the ROB issue is. The core research group iteratively revised the tool and accompanying guidance document. An advisory group of experts provided feedback and suggested appropriate changes to establish face and content validity (supplement S2).

Participant testing

We used purposeful sampling to recruit 15 participants with experience in critical appraisal, systematic reviews, or guidelines for user testing and semi-structured interviews (supplement S3). The participants had a broad level of expertise, from masters level students to senior researchers with experience in health research ranging from six months to 30 years (appendix table A2). All users received the ROBVALU tool and the accompanying guidance document (supplement S1). We instructed the participants to complete three to four assessments and every sample study was assessed by four users independently, 11 studies in total were assessed (appendix table A3). Based on feedback received in the semi-structured interview after user testing, we iteratively revised and improved the guidance document throughout the project with a focus on the wordings, spelling, and grammatical structure of the guidance document. The ROBVALU tool demonstrated good psychometric properties with an overall intraclass correlation coefficient of 0.87 and the four subdomains showed good to excellent reliability ranging from 0.80 to 0.91 ( table 1 and supplement S4). We also calculated the inter-rater reliability of the global ROB judgment using the ROBVALU tool with Kendall’s W, which showed substantial agreement of 0.62 (supplement S4). We invited four expert participants in the field to provide a global judgment for ROB without using the ROBVALU, with each expert rating three to four studies. When we added expert participant responses of the global ROB judgment, the Kendall’s W dropped to 0.45, showing moderate agreement (supplement S4). However, only four global judgment responses were more than one level of seriousness higher or lower than the expert participant judgment (appendix table A4).

Reliability of the Risk of Bias in Values and Utilities (ROBVALU) tool. CI=confidence interval

• View inline

Modified Delphi process

Finally, following our protocol, we used purposeful sampling to invite 20 experts in values, utilities, health technology assessment, and health decision science to participate in a modified Delphi process for final refinement of the tool (supplement S5, fig S8). 28 29 30 We used our extensive network of global colleagues working in the field of study to identify and invite the expert panel. Ten voting members accepted the invite to participate in the Delphi panel, and four members of the working group participated as non-voting members. We shared the ROBVALU tool draft, guidance document, and results of our participant testing with the panel members.

The first round of the Delphi process involved an anonymous survey to determine the signalling questions to be included. The second round took place via recorded video conferences with the aim of identifying common themes and reaching consensus on simplifying and harmonising language across the tool. The third and final round of the Delphi process included an anonymous survey for final consensus on the wording of the signalling questions and the proposed methods for providing a global ROB judgment. We used Google forms to prepare the surveys; the first survey used a 7 point Likert scale (ie, strongly agree, agree, somewhat agree, neutral, somewhat agree, disagree, and strongly disagree) to rate each item, with 70% agreement set as the cut-off threshold to retain or remove a signalling question. The final survey used a 3 point scale (ie, agree, neutral, and disagree) with a 70% agreement set as the cut-off threshold to retain the signalling question.

We had a 100% response rate in the first round of the Delphi process, with 80-100% consensus to retain all signalling questions. We also collected feedback from open ended questions for suggested edits for the signalling questions (supplement S6). In the second round of the Delphi process, we presented the ROBVALU tool, psychometric properties, exploratory factor analysis, and results of the first round of the Delphi to the panel members. After deliberating on the tool’s properties, agreement was reached to edit some signalling questions to simplify the language or to harmonise the language across the tool, which resulted in minor changes only. We also discussed how to make a final judgment for ROB for a study.

We had a 100% response rate in the third and final Delphi round, with 80-100% consensus on the tool’s signalling questions, including those with minor adjustments to the wording. We also established a consensus of >70% that the overall ROB judgment should match the most severe ROB judgment on an item, unless appraisers can provide justifications to rate the overall ROB lower (eg, many concerns on many items) or higher (eg, concern seems not to have an important influence on overall ROB). For example, if multiple subdomains were rated as very serious, the final judgment could be rated as extremely serious (supplement S7).

Risk-of-bias subdomains

ROBVALU includes seven key signalling questions across four subdomains: selection of participants into the study, completeness of data, measurement instrument, and data analysis ( table 2 ).

Subdomains and considerations in the Risk of Bias in Values and Utilities (ROBVALU) tool

Selection of participants into the study

Precise research questions include a clear definition of the target population. The study population of any empirical study must be representative for this target population, and is therefore, a critical component because bias in the selection will lead to biased estimates of the values people place on outcomes in the target population. 2 When assessing selection bias, users should consider the study’s sampling strategy, in particular if the achieved sample population deviates from the intended sample population, 2 because this might lead to biased estimates for the study’s population of interest owing to threats to internal validity. If the achieved sample population does not deviate from the intended sample population but differs from the population researchers intend to extrapolate the results to, this difference will result in a lack of generalisability. We refer to this lack of generalisability as indirectness, which encompasses applicability and external validity. The ROBVALU tool is not intended to deal with indirectness, a different domain in assessing the certainty of a body of evidence according to GRADE, but we are developing a tool that is specific to indirectness separately.

Completeness of data

When judging completeness of data, reviewers need to consider the response rate of the study population, the attrition rate if follow-up was involved, and the differential responders compared with non-responders. 2 High response rates and low proportion of loss to follow-up are clearly preferable, and a high proportion of non-response or dropout rates could be problematic. 2 Participants providing responses could plausibly differ from those who do not, and researchers should consider that results coming only from those participants who responded or completed follow-up might be misleading. 2

Measurement instrument

Reliable and valid instruments should be used to measure the relative importance of outcomes in values, preferences, and utility studies. 2 Using unreliable or poorly validated instruments can result in biased measurements of the outcome. Similarly, utility values for specific health states based on instruments not sufficiently validated that are used as input parameters for decision analytical models can result in biased estimates, such as quality adjusted life years derived from state transition models. 31 32 Researchers conducting primary empirical studies should provide information regarding the measurement properties of their chosen instrument. 2

Researchers should also demonstrate that the instrument has been used correctly and in a consistent manner across all participants in a study. For example, if the standard gamble is to be administered by an interviewer, but a subset of participants used self-administration, this could result in biased utility estimates that could be due to systematic differences between the two groups. In addition, an optimal representation of the outcome or health state should be presented or described in a way that accurately reflects the attribute the researchers intended to measure. This information could include a detailed explanation of how the outcome defines the experience, the probability of the outcome, durations, and possible consequences. Finally, researchers should evaluate whether participants had a proper understanding of the instrument to complete the tasks.

Data analysis

Studies should explore heterogeneity in values when appropriate and present results for the different subgroups. The data analysis plan and exploration of heterogeneity should be outlined a priori before collection of data. A causal framework that helps delineate health state and outcome interactions with possible confounding factors will help make assumptions explicit. If heterogeneity is found, the evaluator needs to consider whether the adjustment, stratification, or model selection used in the study reporting on values was appropriate. 2 Adjusting for important confounding factors (such as age if it is associated with the intervention and influences the estimated values) or reporting values in a stratified manner reduces biased estimates of the value placed on an outcome. In addition, self-inflicted biases, including selection bias or immortal time bias should be controlled for appropriately using modern causal inference methods (eg, target trial emulation or g methods for time varying confounding). 33

ROBVALU tool application

The assessment of ROB in studies evaluating the value people place on outcomes follows seven steps:

Specify the research or review question.

Specify the outcome being assessed.

Identify the sampling frame, the response rate and/or attrition rate, the measurement instrument used, and the data analysis plan.

Answer the signalling questions of the four subdomains.

Make a judgment if the four subdomains have important ROB concerns.

Formulate a ROB judgment for the four subdomains.

Formulate an overall ROB judgment for the study outcome being assessed.

The ROBVALU tool (supplement S8) provides users with space to record vital information of the study being assessed, and signalling questions to all four subdomains that must be answered. We validated a 4 point Likert-type scale (yes, probably yes, probably no, no) to respond to the individual signalling questions (items). When rating individual signalling questions, we suggest following the flowchart in figure 2 for consistent answers between raters. In each subdomain, the tool asks to specify how important the ROB issue is on a 4 point Likert-type scale (yes, probably yes, probably no, no), and how serious the overall ROB issue is on a 4 point Likert-type scale (not serious, serious, very serious, extremely serious). Responses to the signalling questions should provide the basis for the subdomain level judgment, of how important and how serious the ROB issues are in the study. Raters should provide a rationale for the response as free text, to justify their judgments. We suggest that the final judgment for each subdomain inversely correlates with the signalling question judgment. For example, in the measurement instrument subdomain, if the answer to “Was the instrument administered in the intended way?” was “No,” then the answer to “Are there important risk of bias issues concerning the measurement instruments?” should be “Yes.” If raters believe that the lowest signalling question judgment does not reflect the overall subdomain judgment, they might choose not to deem the results of the study at ROB for that subdomain, but they are asked to provide explanations for why they would not do this.

Rating individual signalling questions in the Risk of Bias in Values and Utilities (ROBVALU) tool

The global ROB judgment for a study corresponds to the lowest subdomain judgment ( table 3 ), because any domain level bias will lower our confidence in the study results. If users do not believe that the lowest subdomain judgment reflects the global ROB judgment, they should provide a justification. For example, if a study has a low response rate resulting in very serious ROB domain judgment and the study results are comparable to better quality studies, a reviewer might consider that the subdomain judgment does not reflect the global ROB judgment. Box 1 presents an illustrative example of a completed assessment (supplement S9).

Response options for judgments on risk of bias at an overall study level, according to the Risk of Bias in Values and Utilities (ROBVALU) tool

Example application of the Risk of Bias in Values and Utilities (ROBVALU) tool to assess risk of bias in values assigned to exacerbation of chronic obstructive pulmonary disease 34

In a study of 65 men and women with chronic obstructive pulmonary disease, researchers assessed the utility value that participants placed on an exacerbation, at seven study sites in the US when they visited an outpatient clinic within 48 hours of symptom onset. 34 Eligible participants were at least 40 years old and were current or former smokers with a history of at least 10 pack years. Of 65 participants, 59 completed the study, three were lost to follow-up, and three were ineligible. Utility values were measured using the EQ-5D.

An assessment using the ROBVALU tool revealed the following (supplement 9):

Selection of participants into the study would likely lead to risk of bias.

Exacerbations that required hospital admission were considered severe and were excluded from this study and might importantly bias the estimates. Thus, the population was deemed to be probably not representative of the intended population.

Completeness of data was present:

Only three patients were lost to follow-up, which did not cause risk of bias.

Measurement instrument caused some concern about risk of bias:

It was not clear whether the instrument was used in a valid and reliable manner, but it was applied in the intended way using a valid representation of the outcome. Patients also appeared to show an understanding of the instrument that was used and did not encounter difficulties, but this was not reported.

Data analysis did not cause concern for risk of bias:

Adjustment, stratification, and model selection was appropriate based on a plan created a priori.

ROBVALU assessment

Overall risk of bias was deemed serious because of issues related to the selection of participants into the study and the way the measurement instrument was used.

We have developed and validated the ROBVALU tool, a new instrument to assess ROB in studies measuring the value, utility, or relative importance that people place on health outcome. We followed a sequential mixed methods approach, by first adapting the signalling questions from the GRADE guidance for judging ROB across studies. ROBVALU differs from existing GRADE guidance by specifically assessing ROB in individual studies as opposed to across studies. 2 We iteratively revised the tool with our core group and an advisory group. The final draft tool contains 15 items in four subdomains: selection of participants, completeness of data, measurement instrument, and data analysis. We conducted a validation exercise with 15 participants that showed good reliability. Additional refinement using a modified Delphi process established construct validity on the final content of the tool.

Strengths and limitations

Assessing ROB is an essential step to assess the overall certainty of the evidence in a systematic review or health technology assessment and to develop a guideline. This assessment has often relied on adapting ROB tools not specifically designed for this type of research. 26 However, the lack of validation could lead to unreliable certainty of the evidence assessments, both for single studies and for a body of evidence. By using ROBVALU, evaluators can incorporate the ROB assessment into their meta-analysis, such as performing a sensitivity analysis to evaluate how studies with higher ROB might affect the study’s conclusion or primary outcomes. An advantage of the ROBVALU tool is the use of standardised GRADE terminology and judgments to facilitate assessment when establishing the certainty of the evidence. The ROBVALU tool can also be used to assess ROB in all elicitation studies of values, utilities, and importance of outcomes that use discrete choice, ranking, indifference, and rating methods. 35 Finally, the tool can be used in individual studies that use indirect methods to elicit people’s preferences, such as quality of life and EQ-5D scores.

This study and the derived tool also has several limitations. The new tool focuses on assessing values quantitively. For any given intervention, there is usually qualitative literature exploring what patients want to achieve and what they value (or not) from interventions; this information could be important for decision making. While some of the signalling questions might be used for qualitative studies, other signalling questions will not apply. Further exploration with qualitative studies should be performed to assess how ROBVALU can be adapted for that particular use, or whether a different tool is required. Furthermore, an exploratory factor analysis showed that one item in the tool had relatively poor fit (Was a valid representation of the outcome (health state) used?), but this poor fit could be due to the relatively small sample size. However, we retained this item because of feedback from the Delphi panel, who deemed it important. External validation of ROBVALU’s reliability by different users and on different studies will help refine the guidance and the tool.

Future implications

ROBVALU allows researchers to appraise individual studies reporting utilities, values, or the importance of outcomes for risk of bias. For example, in health technology assessments, the certainty of input variables from an individual study determines the certainty of outputs from decision analytical models (eg, cost utility and cost effectiveness analyses). 32 36 ROBVALU should also help with evaluating ROB as part of a systematic review, health technology assessment, or formal health guideline, to develop recommendations and make judgments across the overall body of this type of evidence (eg, assessing overall certainty of the evidence when following the GRADE approach).

Ethics statements

Ethical approval.

This international study was designed and coordinated at McMaster University after approval by the Hamilton Integrated Research Ethics Board (project ID 5634), and interviews and meetings were conducted in person or over video conference. All participants provided informed consent.

Contributors: The authors are epidemiologists, statisticians, systematic reviewers, and health services researchers, many of whom are involved with methods research and GRADE. Development of ROBVALU was informed by GRADE guideline 19, previously published tools for assessing risk of bias in intervention studies, systematic reviews of available tools to assess risk of bias in values and preferences, and the authors’ experience of developing similar tools to assess risk of bias. All authors contributed to development of the ROBVALU tool and to writing associated guidance. SGK, YZ, JLB, and HJS designed the study and formed the core group. YZ, JLB, and HJS conceived of the project. HJS oversaw the project and is guarantor. SGK, YZ, TD, JLB, and HJS drafted the ROBVALU tool. JN, PAC, FX, and US formed the advisory group. SGK led working groups and conducted the semi-structured interviews. SGK and LM analysed the data. HP-H, GH, YZ, and PAC assessed studies. PAC, FX, BE, ZSP, VW, ALS, J-ET, JN, LK, and US participated in the Delphi process as voting members, and HJS, YZ, SGK, and JLB were non-voting members. SGK and HJS drafted the manuscript. YZ, JLB, and HJS obtained funding for the study. All authors reviewed and commented on drafts of the manuscript. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted.

Funding: The study was funded by the Canadian Institutes of Health Research (grant 401310 to HJS and JLB). The funders had no role in considering the study design or in the collection, analysis, interpretation of data, writing of the report, or decision to submit the article for publication.

Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/disclosure-of-interest/ and declare: support from the Canadian Institutes of Health Research for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.

Provenance and peer review: Not commissioned; externally peer reviewed.

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/ .

• ↵ Boyd CM, Singh S, Varadhan R, et al. Methods for benefit and harm assessment in systematic reviews. 2012. https://www.ncbi.nlm.nih.gov/books/NBK115750/pdf/Bookshelf_NBK115750.pdf
• Alonso-Coello P ,
• Guyatt GH ,
• Pieterse AH ,
• Stiggelbout AM
• McDonough CM ,
• Tosteson AN
• Torrance GW ,
• Rashidi AA ,
• Bleichrodt H ,
• Johannesson M
• Bridges JF ,
• Hauber AB ,
• Marshall D ,
• Horsman J ,
• Furlong W ,
• Slaughter KB ,
• Bambhroliya AB ,
• Schünemann HJ ,
• Piggott T ,
• Morgan RL ,
• Etxeandia-Ikobaltzeta I ,
• Brundisini F ,
• GRADE Working Group
• Kallenbach M ,
• Meerpohl J ,
• Sterne JAC ,
• Savović J ,
• Sterne JA ,
• Hernán MA ,
• Reeves BC ,
• Thayer KA ,
• Santesso N ,
• Higgins JPT ,
• Rooney AA ,
• ↵ Wells GA, Shea B, O’Connell D, et al. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. 2000.
• ↵ Joanna Briggs Institute. The Joanna Briggs Institute critical appraisal tools for use in JBI systematic reviews checklist for analytical cross sectional studies. 2017.
• Mokkink LB ,
• Terwee CB ,
• Patrick DL ,
• Yepes-Nuñez JJ ,
• Creswell JW ,
• ↵ Helmer -Hirschberg O. Analysis of the future: The Delphi method. Rand, 1967.
• Murphy MK ,
• Lamping DL ,
• Siebert U ,
• Bayoumi AM ,
• ISPOR-SMDM Modeling Good Research Practices Task Force
• Arvandi M ,
• Goossens LM ,
• Nivens MC ,
• Rutten-van Mölken MP
• Soekhai V ,
• Whichello C ,
• Levitan B ,
• Briggs AH ,