RESEARCH METHODS

Choose methods because they answer the question.

Methodology is not a glossary of research terms. It is the reasoned explanation of how credible evidence will be generated, why a particular design is appropriate, and what limitations remain after those choices are made.

01 · WHAT DETERMINES YOUR METHODOLOGY?

Methodological choices should follow the study, not precede it.

A research topic alone does not determine whether a study is quantitative, qualitative or mixed methods. The appropriate methodological direction emerges from the research problem, research question, purpose, evidence required, degree of researcher control, time dimension, setting, unit of analysis, ethical feasibility and practical constraints.

Research problem→Question→Purpose→Evidence needed→Methodological approach→Design
Methodological determinantQuestion to askWhat it helps determine
Nature of the problemIs the issue about magnitude, relationship, meaning, experience or process?Broad methodological direction
Research questionWhat exactly must be answered?Quantitative, qualitative or mixed
PurposeDescribe, explore, explain, compare, predict or evaluate?Research design
Evidence requiredNumbers, narratives, observations, documents, digital interaction or combinations?Data strategy
Researcher interventionWill anything be deliberately changed or introduced?Observational vs experimental
Time dimensionOne point, repeated observations, before/after or historical?Cross-sectional, longitudinal or time-series design
Unit of analysisIndividuals, households, organisations, documents, communities or online groups?Design and sampling
SettingPhysical, institutional, community, archival or digital?Possible methodological family
Existing evidenceIs suitable secondary data already available?Primary vs secondary analysis
FeasibilityCan the design be completed ethically with available time, expertise and resources?Practical design choice

02 · FIRST DECISION

Quantitative, qualitative or mixed methods?

Quantitative

Usually appropriate when the study asks how many, how much, how often, whether groups differ, whether variables are associated, what predicts an outcome, or whether an intervention produces measurable change.

Qualitative

Usually appropriate when the study asks how people experience something, what it means to them, why a process operates as it does, or how practices, identities and meanings are constructed.

Mixed methods

Useful when the study needs both a measurable pattern and a contextual explanation, and when the quantitative and qualitative strands are deliberately integrated.

03 · SAME TOPIC, DIFFERENT METHODS

The question changes the methodology.

Topic: Social media use among university students.

Research questionEvidence neededLikely direction
What relationship exists between daily social-media use and academic performance?Measurable exposure, measurable outcome, statistical associationQuantitative → cross-sectional/correlational
How do students describe the influence of social media on their study routines?Experiences, meanings, contextQualitative → interviews/focus groups
To what extent is social-media use associated with performance, and how do students explain the influence?Statistical pattern + contextual explanationMixed methods

04 · PURPOSE OF THE STUDY

What is the study trying to accomplish?

PurposeTypical questionPossible direction
DescriptiveWhat proportion of SMEs use mobile-money services?Quantitative descriptive survey
ExploratoryHow do informal traders experience the transition to digital payments?Qualitative exploratory study
RelationalIs supervisory support associated with intention to leave?Quantitative correlational design
PredictiveWhich organisational factors predict employee turnover intention?Quantitative regression-based design
EvaluativeDoes a structured training programme improve knowledge scores?Experimental or quasi-experimental
ExplanatoryWhy do some rural entrepreneurs abandon mobile banking after adoption?Qualitative or mixed methods depending on evidence required

05 · QUANTITATIVE RESEARCH

Measurement, comparison, association and prediction.

Quantitative research is not simply “research with numbers.” Its logic is that concepts relevant to the research question are operationalised into measurable observations that can be analysed statistically.

DesignMain purposeExample
Descriptive surveyDescribe characteristics or prevalenceHow many teachers use AI tools?
Cross-sectionalMeasure variables at one pointIs workload associated with burnout?
CorrelationalExamine statistical relationshipsIs supervisory support related to retention?
CohortFollow groups through timeDoes exposure predict a later outcome?
Case-controlCompare prior exposure between cases and controlsWas exposure more common among cases?
LongitudinalExamine change over timeHow does engagement change during postgraduate study?
Randomised experimentTest an intervention under random allocationDoes training improve performance?
Quasi-experimentalEvaluate intervention without full randomisationDid a policy change improve outcomes?
Interrupted time seriesTest whether an intervention disrupted an established trendDid service utilisation change after a funding reduction?

06 · QUALITATIVE RESEARCH

Understand meaning, experience, process and context.

ApproachMain focus
PhenomenologyLived experience
Case studyIntensive examination of a bounded case
EthnographyCulture, behaviour and social practices
NetnographyOnline cultures and digital communities
Grounded theoryDeveloping theory from data
Narrative researchStories and personal accounts
Participatory researchResearch conducted collaboratively with participants
Action researchStudying and improving practice simultaneously
Discourse analysisLanguage, meaning and social power
Qualitative content analysisPatterns within textual or visual material

Reporting standards such as SRQR and COREQ help researchers report qualitative sampling, researcher roles, data collection and analytic procedures transparently.

07 · NETNOGRAPHY & DIGITAL RESEARCH

When the research setting is online.

Netnography adapts ethnographic principles to digital communities and cultures. It is useful where interaction, identity, trust, norms or meaning are constructed primarily through online environments such as WhatsApp communities, Facebook groups, Reddit communities, gaming spaces or professional networks.

Example question

How do young entrepreneurs construct trust and legitimacy within informal WhatsApp business communities?

Potential evidenceEthical issue to consider
Posts, comments, shared images, interaction patterns, recurring languagePublic versus private expectations
Community norms and digital practicesConsent and traceability of quotations
Researcher observation and field notesUsernames, screenshots and platform rules

Netnography should not be reduced to “collecting social-media posts.” The method requires attention to culture, interaction, researcher positioning and ethics.

08 · MIXED METHODS

Integration is what makes a study mixed.

DesignSequenceTypical purpose
ConvergentQUAN + QUALObtain complementary views at roughly the same stage
Explanatory sequentialQUAN → QUALUse qualitative evidence to explain quantitative findings
Exploratory sequentialQUAL → QUANUse qualitative findings to develop concepts, measures or a later quantitative phase

09 · OBSERVATIONAL, EXPERIMENTAL & TIME-BASED DESIGNS

Control and time change what the study can claim.

Observational

The researcher observes conditions as they exist. Examples include cross-sectional, cohort, case-control and secondary-data studies.

Experimental

The researcher deliberately introduces an intervention and, in a true randomised trial, allocates participants randomly.

Quasi-experimental

An intervention occurs, but full randomisation is not possible.

Time also matters. Cross-sectional designs measure within a limited period; longitudinal designs observe change over time; retrospective designs use prior records; before-and-after and interrupted time-series designs evaluate change around an intervention or event.

10 · UNIT OF ANALYSIS & EXISTING DATA

Who or what is actually being studied?

The unit of analysis may be individuals, households, organisations, communities, policies, documents, countries, social-media posts or online communities. A methodology should match that unit.

Example

“How is climate adaptation represented in Zimbabwean agricultural policy documents?” may be better answered through document, content or discourse analysis than through a participant questionnaire.

Researchers should also ask whether credible secondary data already exist. A study of monthly HIV service utilisation before and after a funding change, for example, may be better suited to secondary quantitative analysis and interrupted time series than to collecting a new convenience survey.

11 · SAMPLING

A large sample does not automatically make a study representative.

A university may have 8,000 students and a voluntary online survey may collect 1,500 responses. The sample may still overrepresent students who use social media frequently, have reliable internet or are particularly interested in the topic.

For sample-size calculations and statistical planning, use the F1RMA Sample Size & Statistical Planning calculators.

12 · QUESTIONNAIRE DESIGN

Good questions begin with measurement purpose.

Questionnaire design should begin with the evidence required to answer the research question. If the study examines supervisory support, the researcher may need to consider availability, feedback, guidance, fairness or recognition before writing individual items.

Weak item

My supervisor is knowledgeable and supportive.

Stronger item

My supervisor provides useful guidance when I experience difficulties in my work.

Cognitive interviewing can help identify questions that researchers and respondents interpret differently before full deployment.

13 · RELIABILITY & VALIDITY

Consistency does not prove correct measurement.

Reliability concerns consistency. Validity concerns whether the interpretation made from the measurement is justified. A weighing scale that always adds five kilograms may produce consistent results while remaining inaccurate.

14 · QUALITATIVE ANALYSIS

Quotations are evidence, not the final analysis.

Raw evidenceCodeCategoryThemeInterpretation
“Sometimes I wait two weeks before my supervisor responds.”Delayed responsesCommunication delaysFragmented supervisory supportSupport is inconsistent across time.
“One meeting tells me to change it, the next tells me to change it back.”Conflicting feedbackInconsistent guidanceFragmented supervisory supportStudents experience unstable academic direction.

A transparent analytical trail is: raw evidence → code → category → theme → interpretation.

15 · STATISTICAL INTERPRETATION

Statistical significance is not practical significance.

If a study reports r = .08, p < .001, n = 4,000, the result is statistically significant but the observed correlation is weak. A complete interpretation considers effect size, confidence intervals, design, measurement quality, sample size and substantive importance.

FIELDWORK & REAL DATA COLLECTION TOOLKIT

Translate the methodology into a controlled field operation.

Real data collection introduces practical risks that may never appear clearly in a written methodology: inconsistent interviewing, weak consent procedures, broken skip logic, duplicate submissions, device failure, poor supervision and late discovery of data-quality problems.

Prepare→Train→Pilot→Deploy→Supervise→Validate→Secure→Close

16 · PREPARE THE FIELDWORK PACKAGE

Do not enter the field with only a questionnaire.

Fieldwork componentWhat should be ready
Final instrumentApproved questionnaire, interview guide or observation tool
Consent processParticipant information and consent procedure
Sampling planEligibility and selection rules
Enumerator manualInstructions for administering each section
Digital formTested electronic questionnaire where applicable
Validation rulesRequired fields, ranges, skip logic and consistency checks
Field scheduleTeam, location and deployment plan
Escalation planWho handles ethical, safety and technical problems
Quality-control planDaily review, back-checks and anomaly detection

17 · ENUMERATOR TRAINING

Enumerator training is part of data quality.

Enumerators should understand the study purpose, eligibility rules, consent, confidentiality, each question, skip logic, neutral probing, refusals, device use and escalation procedures before interviewing real participants.

Study briefing→Instrument walkthrough→Role-play→Device practice→Mock interview→Field readiness

18 · PILOT BEFORE DEPLOYMENT

Test both the instrument and the operation.

Pilot test

Checks wording, flow, response options, duration, skip logic and recruitment procedures.

Field dry run

Checks whether participants can be found, devices work, forms sync, IDs are correct and supervisors can monitor submissions.

19 · DIGITAL DATA COLLECTION PLATFORMS

Choose technology because it fits the field environment.

PlatformTypical useUseful capability
KoboToolboxAcademic, development and humanitarian field surveysOffline mobile collection and form logic
ODKFlexible field data collectionOffline forms, GPS, media, calculations and multilingual support
REDCapInstitutional and health researchStructured research-data workflows
SurveyCTOManaged field survey operationsMonitoring and quality-control features
QualtricsWeb-based surveysAdvanced online questionnaire design
Google/Microsoft FormsSimple surveysEasy setup for uncomplicated forms

20 · BUILD THE E-FORM CAREFULLY

Digital data collection is more than typing questions onto a screen.

Validation

Restrict impossible entries, such as age 248 where eligibility is 18–80.

Skip logic

Hide irrelevant questions based on earlier answers.

Unique IDs

Give each record a non-identifying study identifier.

Metadata

Where justified, record enumerator ID, start/end time, date or location.

Controlled options

Use coded choices where standardisation reduces entry inconsistency.

Multilingual forms

Review translations before deployment rather than improvising during interviews.

21 · OFFLINE FIELDWORK

Connectivity should not be assumed.

A field system should be tested for the sequence download form → collect offline → save securely → synchronise when connectivity returns.

Charged deviceChargerPower bankBackup deviceField manualConsent materialsSupervisor contact

22 · FIELD SUPERVISION

Deployment requires active monitoring.

EnumeratorTargetCompletedAverage durationMissing itemsStatus
E01201817 min2Review
E02202021 min0Good
E0320268 min0Investigate

Unusually high productivity or very short interview duration does not prove fabrication, but it is a quality-control signal that should be investigated.

23 · BACK-CHECKS & END-OF-DAY REVIEW

Find field problems while they can still be corrected.

Back-checks

Verify a subset of interviews where appropriate: did the interview happen, was the participant eligible, and were major procedures followed?

Daily review

Check expected records, duplicates, impossible values, consent, skip logic, interview duration and unusual enumerator patterns.

24 · FIELDWORK INCIDENT LOG

Document operational problems rather than hiding them.

DateIncidentLocationActionEscalated toOutcome
12 OctParticipant became distressedSite AInterview stoppedSupervisorProtocol followed
13 OctTablet could not syncSite BStored offlineData managerUploaded later
14 OctWrong form version usedSite CCollection stoppedPIRecords reviewed

25 · DATA SECURITY & CLOSING THE FIELD

Protect participants and preserve the audit trail.

During fieldwork

Use device locks, role-based accounts, secure synchronisation, appropriate encryption, controlled identifiers and clear incident-reporting procedures.

Before analysis

Reconcile IDs, remove test records, document exclusions, archive raw data, preserve an untouched original and create a working analysis copy.

26 · COMPLETE METHODOLOGICAL DECISION CHAIN

The method should remain connected to the original question.

Problem→Question→Purpose→Evidence→Approach→Design→Sampling→Instrument→Pilot→Fieldwork→Quality control→Analysis→Interpretation

REFERENCES & FURTHER READING

Creswell, J. W., & Creswell, J. D. (2022). Research design: Qualitative, quantitative, and mixed methods approaches (6th ed.). SAGE Publications. Publisher page

Creswell, J. W., & Plano Clark, V. L. (2025). Designing and conducting mixed methods research (4th ed.). SAGE Publications. Publisher page

Kozinets, R. V. (2019). Netnography: The essential guide to qualitative social media research (3rd ed.). SAGE Publications.

O'Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014). Standards for reporting qualitative research: A synthesis of recommendations. Academic Medicine, 89(9), 1245–1251. SRQR

Tong, A., Sainsbury, P., & Craig, J. (2007). Consolidated criteria for reporting qualitative research (COREQ): A 32-item checklist for interviews and focus groups. International Journal for Quality in Health Care, 19(6), 349–357. COREQ

EQUATOR Network. (n.d.). Reporting guidelines for main study types. EQUATOR Network

Centers for Disease Control and Prevention. (n.d.). Collaborating Center for Questionnaire Design and Evaluation Research. CDC CCQDER

World Health Organization. (n.d.). WHO STEPS surveillance manuals and data collection resources. WHO STEPS

KoboToolbox. (n.d.). Collecting data using KoboCollect. KoboToolbox documentation

ODK. (n.d.). Getting started with ODK. ODK documentation