Research Design
Research Design
Research Design
question. The design of your study can be thought of as a blueprint detailing what will be done and how this will be accomplished. Key aspects of research design include: research methodology; participant/sample collection and assignment (if different conditions are being explored); and data collection procedures and instruments. Research Methods Research methods are generalized and established ways of approaching research questions (e.g., qualitative vs. quantitative methods). Not all methods can be applied to all research questions, so the choice of method is limited by the area of research that you wish to explore. Difference between method and methodology The words 'method' and 'methodology' may sound similar, but there is a big difference between them. A method is the way in which you complete a task, or the steps you take to complete a task. Methodology is the study of a method or methods. Data Collection Tools Data Collection tools are helpful because they provide a picture of your classroom/work environment. The goal for using tools is to help the researcher clarify information, process knowledge, and identify opportunities for continuous improvement. Components of a Research Manuscript Methods Participants- thorough description, including demographic information, injury or disorder characteristics, mean time since onset Measures- include a detailed description of all measures used, including their reliability and validity information Procedure- Include all procedures in detail, so that someone else could replicate your study exactly; include recruitment, research design, and types of statistical analyses
X - An "X" means that at this point we have administered a treatment. A treatment consists of manipulating the independent variable. The treatments may be numbered: First treatment, X1; second treatment, X2; third treatment, X3; nth treatment, Xn. O - An "O" means that at this point we have measured the dependent variable (taken an observation).
The nature of the sample (random or non-random) and how subjects were assigned to groups (random or non-random) is indicated by a letter in the upper left corner of the diagram.
R - The letter "R" in a box means that we have used random selection of subjects. If a design does not have this glyph in front of it this means that subjects were selected non-randomly. A - If we add an "A" to the "R" this means we have used random assignment of subjects to groups. Thus, we could have R, or A, or RA. To use assignment you need to have a differences question and two or more groups.
Research Design Diagrams Finally, we need to introduce you to some terms and shorthand conventions that are used to diagram the various designs.
R = random sampling and random assignment to O = observation (measurement of performance on dependent variable) X = independent variable Classic true experimental design - Control group, Random selection, pre-test and post-test. R-O-X-O; this first group is the experimental condition, rec eiving manipulation R-O----O; this second group is the control condition, receiving no manipulation Post test only, Control group design (Omitted Pre-Test) - A pre-test can influence the outcome of the study because the subjects become aware of what you are. RXO R O Solomon four group research design - In this design you have two groups that receive the pre-test and two that do not. Therefore you know if the pre-test had an effect on the outcome. ROXO ROO RXO RO
The most common quasi-experimental design is the Comparison Group Pre-test/Post-test Design. This design is the same as the classic controlled experimental design except that the subjects cannot be randomly assigned to either the experimental or the control group, or the researcher cannot control which group will get the treatment. In other words, participants do not all have the same chance of being in the control or the experimental groups, or of receiving or not receiving the treatment. Basic Design Elements. Most research designs can be constructed from four basic elements: 1. Time. A causal relationship, by its very nature, implies that some time has elapsed between the occurrence of the cause and the consequent effect. While for some phenomena the elapsed time might be measured in microseconds and therefore might be unnoticeable to a casual observer, we normally assume that the cause and effect in social science arenas do not occur simultaneously, In design notation we indicate this temporal element horizontally - whatever symbol is used to indicate the presumed cause would be placed to the left of the symbol indicating measurement of the effect. Thus, as we read from left to right in design notation we are reading across time. Complex designs might involve a lengthy sequence of observations and programs or treatments across time. 2. Program(s) or Treatment(s). The presumed cause may be a program or treatment under the explicit control of the researcher or the occurrence of some natural event or program not explicitly controlled. In design notation we usually depict a presumed cause with the symbol "X". When multiple programs or treatments are being studied using the same design, we can keep the programs distinct by using subscripts such as "X1" or "X2". For a comparison group (i.e., one which does not receive the program under study) no "X" is used. 3. Observation(s) or Measure(s). Measurements are typically depicted in design notation with the symbol "O". If the same measurement or observation is taken at every point in time in a design, then this "O" will be sufficient. Similarly, if the same set of measures is given at every point in time in this study, the "O" can be used to depict the entire set of measures. However, if different measures are given at different
You will diagram the research design using a matrix where events are the columns and groups are the rows. An event is the occurrence of one of three possibilities: a treatment, no treatment, or an observation. A treatment event is when the independent variable (IV) is manipulated, i.e., from the above example, when subjects are given a hot bath or a massage. A no treatment event is one where nothing is done to the IV. An observation event is when the dependent variable (DV) is measured. Experimental Design A study design used to test cause-and-effect relationships between variables. The classic experimental design specifies an experimental group and a control group. The independent variable is administered to the experimental group and not to the control group, and both groups are measured on the same dependent variable. Subsequent experimental designs have used more groups and more measurements over longer periods. True experiments must have control, randomization, and manipulation. Comparison Group Design
times it is useful to subscript the "O" to indicate which measurement is being given at which point in time. 4. Groups or Individuals. The final design element consists of the intact groups or the individuals who participate in various conditions. Typically, there will be one or more program and comparison groups. In design notation, each group is indicated on a separate line. Furthermore, the manner in which groups are assigned to the conditions can be indicated by an appropriate symbol at the beginning of each line. Here, "R" will represent a group which was randomly assigned, "N" will depict a group which was nonrandomly assigned (i.e., a nonequivalent group or cohort) and a "C" will indicate that the group was assigned using a cutoff score on a measurement. Pre-test There are many situations where a pre-test is impossible because the participants have already been exposed to the treatment, or it would be too expensive or too timeconsuming. For large enough groups, this design can control for most of the same threats to internal and external validity as the classic controlled experimental design. For example, it eliminates the threat to internal validity of pre-testing by eliminating the pre-test. It may also decrease the problem of experimental mortality by shortening the length of the study (no pre-test). For small groups, however, a pre-test is necessary. Also, a pre-test is necessary if the researcher wants to determine the exact amount of change attributable to the independent variable alone. If the treatment effect is unlikely to wash out between measurements, a control group has to be used. Control group - this group is used to produce comparisons. The treatment of interest is deliberately withheld or manipulated to provide a baseline performance with which to compare the experimental or treatment group's performance. Not used for quasi-experiments and one-shot case studies Human subject research/ethical principles The Code's standards concerning the treatment of human subjects include federal regulations and ethics guidelines emphasized by most professional science organizations:
Research should cause no harm to subjects, at no point should subjects feel distressed. Deception needs to be left out of the research process, under no circumstance should a researcher lie to their subjects. Participation in research should be voluntary, and therefore subjects must give their informed consent to participate in the research. Researchers should be very cautious when dealing with vulnerable clients (persons who are mentally ill, incarcerated people, or minors) they should make sure to get the proper consent. Researchers should fully disclose their identity. Anonymity or confidentiality must be maintained for individual research participants unless it is voluntary and explicitly waived. Actively attempt to remove from the research records any elements that might indicate the subjects identities. And finally, benefits from a research project should outweigh any foreseeable risks.[5] The specific structure of a protection program is secondary to its performance of several essential functions. These functions include: 1. comprehensive review of protocols, (including scientific, financial conflict of interest, and ethical reviews), 2. ethically sound participant-investigator interactions, 3. ongoing (and risk appropriate) safety monitoring throughout the conduct of the study, and 4. quality improvement (QI) and compliance activities/[6] Some principles Jones states in regards to electronic information gathering principles follows: 1. Openness: Existence of data banks should be publicly known 2. Individual Access and Correction: People should have access to the data collected about themselves. 3. Collection Limitation and Relevance: Personal data should be collected for one specific, legitimate purpose. 4. Use Limitations: Information should be used only for purposes specified at the time of collection. 5. Disclosure Limitation: Personal data is not to be communicated externally without consent of the subject who supplied the data. 6. Security: Personal data should be reasonably guarded against risks such as loss, unauthorized access, modification, or disclosure.