Skip to content

Commit 15d8640

Browse files
alliscodeCopilot
andcommitted
Foundry Evals integration for Python
Merged and refactored eval module per Eduard's PR review: - Merge _eval.py + _local_eval.py into single _evaluation.py - Convert EvalItem from dataclass to regular class - Rename to_dict() to to_eval_data() - Convert _AgentEvalData to TypedDict - Simplify check system: unified async pattern with isawaitable - Parallelize checks and evaluators with asyncio.gather - Add all/any mode to tool_called_check - Fix bool(passed) truthy bug in _coerce_result - Remove deprecated function_evaluator/async_function_evaluator aliases - Remove _MinimalAgent, tighten evaluate_agent signature - Set self.name in __init__ (LocalEvaluator, FoundryEvals) - Limit FoundryEvals to AsyncOpenAI only - Type project_client as AIProjectClient - Remove NotImplementedError continuous eval code - Add evaluation samples in 02-agents/ and 03-workflows/ - Update all imports and tests (167 passing) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
1 parent 7c85f98 commit 15d8640

21 files changed

Lines changed: 7105 additions & 75 deletions

python/packages/azure-ai/agent_framework_azure_ai/__init__.py

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,11 @@
1111
AzureAIInferenceEmbeddingSettings,
1212
RawAzureAIInferenceEmbeddingClient,
1313
)
14+
from ._foundry_evals import (
15+
FoundryEvals,
16+
evaluate_foundry_target,
17+
evaluate_traces,
18+
)
1419
from ._foundry_memory_provider import FoundryMemoryProvider
1520
from ._project_provider import AzureAIProjectAgentProvider
1621
from ._shared import AzureAISettings
@@ -31,8 +36,11 @@
3136
"AzureAIProjectAgentOptions",
3237
"AzureAIProjectAgentProvider",
3338
"AzureAISettings",
39+
"FoundryEvals",
3440
"FoundryMemoryProvider",
3541
"RawAzureAIClient",
3642
"RawAzureAIInferenceEmbeddingClient",
3743
"__version__",
44+
"evaluate_foundry_target",
45+
"evaluate_traces",
3846
]

0 commit comments

Comments
 (0)