Kai Mallari's Notes'

Research Response SOP

9 min read

A systematic process for answering questions with ideas and evidence. This framework ensures research contributions are useful, credible, and ready to integrate into your knowledge system.

Core principle: Research without structure produces isolated facts. Research with structure produces connected knowledge that compounds over time.

This is Step 1 in the pipeline—it takes the prioritized question list from Question Generation SOP and produces documented answers ready for processing into Atomic Notes via the Q-I-ST Framework.

Why This Matters

Without this structure:

  • Ideas get lost because they’re not clearly connected to the question being asked
  • Research findings can’t be verified because sources aren’t cited
  • Time gets wasted reformatting or clarifying submissions later
  • Valuable insights don’t get the attention they deserve
  • Knowledge stays isolated instead of connecting to what you already know

With this structure:

  • Every answer traces back to a specific question
  • Every claim connects to verifiable evidence
  • Answers are ready to become Atomic Notes
  • Knowledge accumulates and compounds

The Seven-Step Process

InputsA research question (ideally from Question Generation SOP), access to credible sources, and a place to document your response.

Step 1: Question selected and understood

Read the research question carefully. In your own words, write what you think the question is asking. If you’re unsure, clarify before proceeding.

Example: If the question is “Why does early specialization hurt long-term performance?”, you might write: “This is asking about the downsides of focusing too early in one area instead of exploring multiple areas first.”

This connects to Per-Note Questions—you’re confirming that you understand what question this research will answer.

Step 2: Your idea clearly stated

Write your answer to the question as a single, clear statement. This is your Idea—the core insight you want to share.

Format: “I believe [your answer] because [brief reason].”

Example: “I believe early specialization hurts long-term performance because it prevents people from developing the broad pattern-recognition skills that come from varied experience.”

This statement will become an Idea note in the Q-I-ST Framework. It should be atomic—one clear claim that can stand alone. See Atomic Notes for the principle: each idea should fit on an index card.

Step 3: Supporting evidence identified

Find 2-3 pieces of credible evidence that support your idea. Evidence can be:

  • Scientific studies or peer-reviewed research
  • Expert quotes from recognized authorities
  • Real-world examples or case studies
  • Statistical data from reliable sources

For each piece of evidence, note:

  • What it shows
  • Where it came from (source)
  • Why it supports your idea

In Q-I-ST Framework terms, these become Supplementary Tools—the quotes, studies, and anecdotes that give weight to your Ideas.

Step 4: Sources properly documented

For each piece of evidence, provide verification so others can review and explore further.

Option A: Attach the source directly

  • Include the full PDF, article, or document
  • Name the file clearly (e.g., “Epstein_2019_Range_Ch3.pdf”)
  • Reference the attachment by filename in your notes

Option B: Provide a complete citation

  • Author name(s)
  • Title of work
  • Publication year
  • Source (journal, book, website)
  • Link or DOI if available

Example citation: “Epstein, D. (2019). Range: Why Generalists Triumph in a Specialized World. Riverhead Books.”

You can mix both options—attach what you have, cite what you don’t.

Step 5: Connection between idea and evidence made explicit

Write 1-2 sentences explaining how each piece of evidence supports your idea. Don’t assume the connection is obvious.

Format: “[Evidence] supports my idea because [explanation of connection].”

Example: “Epstein’s research on late specializers in sports supports my idea because it shows that athletes who sampled multiple sports before specializing had longer careers and greater long-term success than those who specialized early.”

This explicit connection is what transforms raw evidence into usable knowledge. It’s the “why it matters” that makes the evidence meaningful.

Step 6: Alternative perspectives considered

Briefly note if there’s research that contradicts your idea, or if your idea only applies in certain contexts. This shows intellectual honesty and helps refine the thinking.

Example: “However, some domains like chess or music may benefit from earlier specialization due to the time required to develop technical mastery.”

This connects to The Idea Compass East direction: “What opposes this?” Understanding the limits and counterarguments strengthens your idea by defining its boundaries.

Step 7: Submission formatted consistently

Use this structure for your final response:

QUESTION: [Restate the question]

MY IDEA: [Your clear answer]

EVIDENCE 1:
- What it shows: [Brief description]
- Source: [Citation OR "See attached: filename.pdf"]
- Why it matters: [Connection to your idea]

EVIDENCE 2:
- What it shows: [Brief description]
- Source: [Citation OR "See attached: filename.pdf"]
- Why it matters: [Connection to your idea]

EVIDENCE 3 (if applicable):
- What it shows: [Brief description]
- Source: [Citation OR "See attached: filename.pdf"]
- Why it matters: [Connection to your idea]

LIMITATIONS/ALTERNATIVE VIEWS:
[Brief note on context or contradicting evidence]

ATTACHMENTS (if applicable):
- filename1.pdf
- filename2.pdf

What Makes a Source Credible?

A credible source is one you can trust to provide accurate, reliable information. Evaluate sources using these criteria:

Author Expertise

Good signsWarning signs
PhD in relevant fieldNo credentials listed
Works at university/research institutionCredentials unrelated to topic
Has published peer-reviewed workAnonymous authorship

Information Type: Party Distance

TypeWhat it isExamplesStrength / Weakness
First-PartyCreated by those directly involvedOriginal research, eyewitness accounts, company reportsDirect access / May have personal bias
Second-PartyInterprets first-party sourcesLiterature reviews, meta-analyses, expert commentaryProvides synthesis / Interpretation may introduce bias
Third-PartyReports on first/second-partyNews articles, textbooks, WikipediaMore accessible / Further removed, may oversimplify

For research: Prioritize first and second-party sources. Use third-party sources to find leads to better sources.

Bias & Incentive

Ask: “What does this source have to gain from this conclusion?”

Types of bias to watch for:

  • Financial: Does the source have financial stake in the outcome?
  • Ideological: Does the source have a strong political or philosophical position?
  • Confirmation: Is the source only presenting evidence that supports one view?
  • Institutional: Is the source beholden to an organization with specific interests?

Red flags: Source is funded by parties who benefit from conclusions, only cites supporting evidence, uses sensational language designed to provoke emotional response.

Normative vs. Positive Statements

TypeWhat it isExample
Positive (Facts)Describes what is—can be tested”Unemployment increased by 2% last quarter”
Normative (Values)Describes what should be—based on values”The government should reduce unemployment”

For evidence: Prioritize positive statements that can be verified. Be aware when normative statements are presented as facts.

Publication & Peer Review

Strongest credibility:

  • Peer-reviewed academic journals
  • Books from academic publishers
  • Reports from established research institutions

Moderate credibility:

  • Reputable newspapers/magazines
  • Industry reports from established organizations
  • Government statistical agencies

Use with caution:

  • Blogs
  • Wikipedia (good starting point, not final source)
  • Social media
  • Advocacy organization publications

Quick Credibility Checklist

Before citing a source, ask:

  • ☐ Can I identify the author and their credentials?
  • ☐ Is this a first or second-party source (preferred) or third-party?
  • ☐ What bias or incentive might influence this source?
  • ☐ Does the source separate facts (positive) from opinions (normative)?
  • ☐ Has this been peer-reviewed or vetted by experts?
  • ☐ Is the information current enough for this topic?
  • ☐ Does this directly support my idea, or am I stretching the connection?

If you can’t check most of these boxes, keep looking for better sources.

Processing Research into Atomic Notes

Once you have a completed research response, it’s ready to become permanent notes using the Q-I-ST Framework:

Research componentBecomesNote type
The question you answeredQuestion note#question
Your idea/answerIdea note#idea
Each piece of evidenceSupplementary Tool note#study, #quote, #anecdote

The linking structure:

Question note
    └── answered by → Idea note
                          └── supported by → Supplementary Tool notes

See Atomic Notes for why separation matters: a single study can support multiple ideas, a question can have multiple answers. Keeping them atomic lets you recombine freely.

Connect your new notes using The Idea Compass:

  • North: Where does this come from? (Prerequisites, foundations)
  • East: What opposes this? (Your limitations section feeds this)
  • West: What’s similar? (Parallel concepts, analogies)
  • South: Where does this lead? (Implications, applications)

The Complete Pipeline

[[Question Generation Framework]]
    ↓ produces
Prioritized question list
    ↓ feeds into
Research Response SOP (this note)
    ↓ produces
Documented answers with evidence
    ↓ processed via
[[Q-I-ST Framework]]
    ↓ becomes
[[Atomic Notes]] (Questions, Ideas, Supplementary Tools)
    ↓ connected via
[[The Idea Compass]] and [[Per-Note Questions]]
    ↓ accumulates into
Connected knowledge that compounds

Each step builds on the previous. Questions drive research. Research produces answers. Answers become notes. Notes connect to everything else you know.

FAQs

  • What if I can’t find research that directly addresses the question?

    Look for related research that addresses similar mechanisms or principles, then explain the connection. If truly nothing exists, note this and propose why the gap exists.

  • How technical should my evidence be?

    Credible, but accessible. If citing a complex study, translate the finding into plain language. The full citation allows others to dive deeper if needed.

  • Can I cite non-academic sources?

    Yes, if they’re credible (industry reports, expert interviews, high-quality journalism). Clearly note when a source is non-academic. Prioritize peer-reviewed research when available.

  • What if my idea is partially right but needs refinement?

    Perfect—include it in the “Limitations/Alternative Views” section. Good research acknowledges nuance.

  • How long should my response be?

    Focus on quality over length. Typically:

    • Idea: 1-3 sentences
    • Evidence: 3-5 sentences per piece
    • Total: Usually 300-500 words

  • Should I attach sources or cite them?

    Attach when you have easy access to the full document (especially PDFs of research papers). Cite when you don’t have the file or when it’s easily accessible online. When in doubt, attach—it makes verification easier.

Common Traps

Collecting without connecting. Evidence without explicit connection to your idea is just a pile of facts. Always explain why the evidence matters.

Stretching the connection. If you have to work hard to explain how evidence supports your idea, it probably doesn’t. Find better evidence or refine your idea.

Skipping the limitations. Acknowledging what your idea doesn’t explain makes it stronger, not weaker. Ideas without boundaries are vague. Ideas with clear scope are useful.

Citing third-party summaries. When possible, go to the original source. “According to a Forbes article about a Harvard study” is weaker than citing the Harvard study directly.

North: Where does this comes from?

East: What opposes this?

South: Where this leads?

West: What is similar?

Graph View

Backlinks