Python: Automate sample validation

[TaoChenOSU]

Motivation and Context

Our samples are entry point for many customers, so we need to ensure that they run correctly. With changes coming in fast, we often forget to validate if our samples are affected by the changes. We need a way to catch regressions and fix them promptly.

Description

Add a GH workflow to run daily to ensure samples are working as expected.

Contribution Checklist

• The code builds clean without any errors or warnings
• The PR follows the Contribution Guidelines
• All unit tests pass, and I have added new tests where possible
• Is this a breaking change? If yes, add "[BREAKING]" prefix to the title of the PR.

[markwallace-microsoft]

Python Test Coverage Report •

File	Stmts	Miss	Cover	Missing
packages/orchestrations/agent_framework_orchestrations
_handoff.py	387	59	84%	105–106, 108, 163–173, 175, 177, 179, 184, 281, 287, 319, 342, 364, 420, 445, 503, 535, 593–594, 626, 634, 638–639, 677–679, 684–686, 802, 805, 812, 817, 879, 884, 891, 901, 903, 922, 924, 1006–1007, 1039–1040, 1122, 1129, 1201–1202, 1204
TOTAL	22149	3474	84%

Python Unit Test Overview

Tests	Skipped	Failures	Errors	Time
4265	240 💤	0 ❌	0 🔥	1m 14s ⏱️

[Copilot]

Pull request overview

Adds an automated, workflow-driven system to validate Python samples on a daily cadence, aiming to catch regressions early and surface results as build artifacts.

Changes:

• Introduces a new _sample_validation package that discovers runnable samples, orchestrates concurrent validation via a nested workflow, and generates a report.
• Adds a scheduled GitHub Actions workflow to run sample validation per sample area (01-get-started, 02-agents, etc.) and upload reports as artifacts.
• Includes a few related cleanups/fixes in existing samples and orchestration code.

Reviewed changes

Copilot reviewed 15 out of 15 changed files in this pull request and generated 9 comments.

Show a summary per file

File	Description
python/samples/_sample_validation/workflow.py	Top-level workflow composition wiring discovery → nested workflow creation → execution → report.
python/samples/_sample_validation/run_dynamic_validation_workflow_executor.py	Executes the nested workflow, streams progress events, and fans results back into the parent workflow.
python/samples/_sample_validation/report.py	Builds/prints report summary and yields the final Report output.
python/samples/_sample_validation/models.py	Defines config and result/report datamodels used across the validation pipeline.
python/samples/_sample_validation/discovery.py	Discovers sample scripts (filters for files with if __name__ == "__main__" guards).
python/samples/_sample_validation/create_dynamic_workflow_executor.py	Constructs nested coordinator/worker/collector workflow and runs Copilot agents per sample.
python/samples/_sample_validation/const.py	Defines workflow event type constants.
python/samples/_sample_validation/main.py	CLI entrypoint to run validation and optionally save report artifacts.
python/samples/_sample_validation/init.py	Package exports and usage documentation.
python/samples/_sample_validation/README.md	Architecture and usage documentation for the validation system.
python/samples/_run_all_samples.py	Removes previous sample runner script in favor of the new validation system.
python/samples/02-agents/context_providers/redis/redis_conversation.py	Removes an unused import.
python/samples/01-get-started/04_memory.py	Ensures the sample context provider calls BaseContextProvider constructor with the expected source id.
python/packages/orchestrations/agent_framework_orchestrations/_handoff.py	Updates the synthetic handoff tool signature/body and minor formatting.
.github/workflows/python-sample-validation.yml	Adds scheduled/manual workflow to run sample validation across sample areas and upload reports.