The agent fieldbook

Research with an agent and keep the receipts

Turn a broad question into a source-backed decision. Trace claims, resolve disagreements, and make uncertainty useful.

Jump to the exercise
A constellation of connected evidencetrace it back
Follow the evidence, one useful step at a time.

What you’ll be able to do

  • Frame a question with scope, dates, and a decision.
  • Trace important claims to sources that actually support them.
  • Produce a recommendation with visible uncertainty and a stopping rule.

1. Ask a question that can change a decision

State what you are trying to decide, who the answer is for, and which constraints matter. ‘Tell me about AI scheduling tools’ invites a survey with no finish line. ‘Compare three scheduling tools for a five-person team that needs shared availability and calendar export’ tells the agent which facts to seek. Name the date, region, and product version when they could change the answer.

Separate discovery from confirmation. During discovery, the agent can help identify options and useful comparison criteria. During confirmation, it should verify the claims that determine your choice. Mixing the phases can make an early guess look like an established conclusion. Give each phase a deliverable and a time budget, then decide whether further research could realistically change the next action.

Worked example

Illustrative research brief

Compare the three shortlisted tools for a small design team. Verify shared availability, calendar export, and administrator controls using current official documentation. Return a comparison, a recommendation conditional on any unknowns, and a list of claims we should test in a trial. Do not sign up or purchase.

2. Decide which source can answer each claim

Match the source to the question. Official documentation can establish what a vendor says its product supports. A trial can establish whether a feature works in your account and environment. A customer report can reveal a failure worth investigating, but it does not establish how often that failure occurs. A research paper can support a finding within its methods and population, not every broader claim attached to it.

Ask the agent to create a small evidence plan before collecting dozens of links. For each decisive question, name the preferred source, the freshness requirement, and a fallback if the source is inaccessible. Treat a search snippet as a pointer to inspect. If the agent cannot open the underlying source, that limitation should stay visible in the final answer. A link that looks credible is not proof that the linked text supports the claim.

Try it yourself

Practice source triage

Inspect sample claims and sources. Decide what the evidence supports, what needs another source, and what remains unknown.

The integration supports exporting CSV files.

Current official documentation explicitly lists CSV export and shows the export procedure.

How should this claim appear in the answer?

Illustrative claims. No real vendor or policy is being evaluated.

3. Keep a small ledger of claims and evidence

Ask for a working table with one claim per row. Include the claim, source title, direct link, publication or update date when available, access date, and a short note explaining the support. Add a status such as verified in the source, inferred, disputed, or unknown. This table makes it easier to catch a recommendation that rests on an assumption disguised as a fact.

Keep the claim narrow enough for the source to support it. ‘The product offers export’ could conceal an export restricted to one plan, file type, or operating system. Capture the condition in the claim itself. For numbers, record the denominator, time period, units, and comparison baseline. Recalculate simple totals independently when they influence your decision. A mathematically correct percentage can still answer the wrong question.

  1. Extract

    Record the smallest factual claim needed for the decision and its specific supporting source.

  2. Qualify

    Attach relevant dates, versions, account conditions, populations, and limitations to the claim.

  3. Verify

    Open the source and check the surrounding context. Mark unsupported claims as unknown instead of smoothing over the gap.

4. Investigate disagreements and copied evidence

When sources disagree, first check whether they are describing the same thing. Differences in date, plan, region, version, sample, or definition often explain the conflict. Preserve both claims until you can identify the reason. Ask the agent to explain the disagreement in plain language and name the observation that would resolve it. Do not average incompatible numbers simply to produce a tidy answer.

Check whether apparently independent sources share the same origin. Five articles repeating one announcement provide less independent evidence than their link count suggests. Open unfamiliar publishers in a separate search and investigate who is behind them, a practice known as lateral reading. For scholarly work, verify bibliographic details and check for corrections or retractions using the publisher and relevant metadata services. A real citation still needs to support the actual claim.

Worked example

Illustrative disagreement

A review says a tool cannot export calendars, while its current documentation describes an export feature. Check the review date, feature release date, plan, and export format. The appropriate conclusion may be that the review predates the feature, or that the two sources describe different kinds of export.

5. Audit the claims that carry the recommendation

Spend your review effort on claims that could change the decision. Open the cited source for each decisive claim. Confirm that the page exists, the text is relevant, and the agent preserved its conditions. Check a few less important claims as a sample. If those reveal repeated errors, expand the audit and reconsider whether the report is ready to use.

Ask for a short distinction between what the sources establish and what the agent recommends. The recommendation can involve judgment: a less capable tool may be preferable because your team can adopt it easily. That judgment should point to your stated priorities. Request the strongest evidence against the recommendation and the unresolved fact most likely to reverse it. Useful research makes the decision's weak points visible.

6. Deliver a decision record with an expiry condition

Finish with a concise answer, the supporting comparison, and the evidence ledger. Include the research date and the scope that you actually covered. State inaccessible sources and open questions alongside their practical effect. ‘Administrator controls were not confirmed, so test that requirement before purchase’ is more actionable than a generic statement that more research is needed.

Stop when the remaining uncertainty will not change the immediate decision, or when a hands-on trial is a better way to resolve it. Save the brief and evidence so that someone can revisit the work later. Give unstable claims an expiry condition, such as a plan change or a new product release. When refreshing the report, verify those claims directly instead of treating the previous agent answer as a new source.

When things go wrong

Start with the failure you can observe.

The report has many links but little support.

Choose one decisive claim and trace it to the exact source passage. Require a claim ledger, then remove links that do not support the associated statement.

The sources disagree and the agent picks a side.

Compare dates, definitions, versions, and populations first. Keep the conclusion conditional if the evidence does not resolve the difference.

Research continues without improving the decision.

Name the one uncertainty that could change your next action. Investigate that question or move to a practical trial, then stop the broad search.

Put it into practice

0 / 5

Use this checklist on your next real task.

Your checklist is saved in this browser. Exercise inputs are not saved.

Sources & further reading

Primary references for the ideas in this chapter. Product behavior can change; check the documentation for the version you use.

Edited October 7, 2026 · Examples are illustrative unless attributed.