Module 13 Activity Worksheet

Module

Module 13: Machine Learning in Neuroscience

Capability Target

Design and critique an ML analysis pipeline for connectomics that includes feature rationale, evaluation plan, leakage controls, and interpretation limits.

Studio Activity Instructions

Evidence and Reasoning Notes

• Claim:
• Evidence:
• Limitation:

Rubric Check

• Minimum pass
  • Feature and split decisions are justified.
  • Metrics include at least one biologically targeted criterion.
  • Limitation statement is specific and actionable.
• Strong performance
  • Identifies and mitigates likely leakage channels.
  • Uses error analysis to propose next data improvements.
  • Distinguishes exploratory model from deployment-ready model.
• Common failure modes
  • Leakage-prone random splits for spatially correlated data.
  • Overfocus on aggregate accuracy.
  • Claims of biological insight unsupported by model diagnostics.

Exit Prompt

For one candidate model, write:

1. one plausible leakage pathway,
2. one metric blind spot,
3. one limitation you would report publicly.