docs: sync eval install hints and operator guides#3491
Merged
Conversation
Sync the baked-in amplihack-agent-eval revision hints with the actual pyproject pin, add a day-zero operator guide, and add a plain-English component guide for the eval stack. Refs: #3490 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Repo Guardian - PassedAll 8 changed files passed the ephemeral content review.
No meeting notes, sprint retrospectives, one-off scripts, or point-in-time snapshots were found.
|
Use an interactive prompt plus EH_CONN for Event Hubs credentials in the operator guide so the examples do not encourage pasting secrets directly into command lines. Refs: #3490 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Repo Guardian - PassedAll 8 changed files passed the ephemeral content review.
No meeting notes, sprint retrospectives, one-off scripts, or point-in-time snapshots were found.
|
Teach the local Azure eval compatibility wrappers to read EH_CONN and hub names from the environment, stop the Aspire AppHost from forwarding the Event Hubs secret in command arguments, and update the operator guide to use the safer wrapper path and secret prompts. Refs: #3490 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Repo Guardian - PassedAll 14 changed files passed the ephemeral content review.
No meeting notes, sprint retrospectives, one-off scripts, or point-in-time snapshots were found.
|
Treat equals-style wrapper flags as explicit input when injecting env-backed defaults and correct the compile-deps metadata count to match the current pyproject dependency list. Refs: #3490 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Repo Guardian - PassedAll 14 changed files passed the ephemeral content review.
No meeting notes, sprint retrospectives, one-off scripts, or point-in-time snapshots were found.
|
Owner
Author
Step 16b Reviewer PassNo blocking issues found.
|
Owner
Author
Step 16c Security ReviewNo blocking security issues found.
|
Owner
Author
Step 16d Philosophy ReviewNo blocking philosophy issues found.
|
Contributor
🤖 PM Architect PR Triage AnalysisPR: #3491 ✅ Workflow Compliance (Steps 11-12)❌ NON-COMPLIANT - PR needs workflow completion Step 11 (Review): ❌ Incomplete
Step 12 (Feedback): ✅ Completed
Blocking Issues:
🏷️ ClassificationPriority:
Complexity:
🔍 Change Scope AnalysisPrimary Purpose: Documentation update Unrelated Changes: Affected Files: Recommendation: Consider splitting this PR into separate focused PRs for each concern 💡 Recommendations
📊 Statistics
🤖 Generated by PM Architect automation using Claude Agent SDK |
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Repo Guardian - PassedAll 14 changed files passed the ephemeral content review.
No meeting notes, sprint retrospectives, one-off scripts, or point-in-time snapshots were found.
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
amplihack-agent-evalinstall-hint revisions with the actualpyproject.tomlpinamplihack,amplihack-agent-eval, Event Hubs, Container Apps, and Aspire fit together--question-setflagsCloses #3490.
Step 13: Local Testing Results
Test Environment: clean worktree
feat/issue-3490-sync-eval-docsat/home/azureuser/src/amplihack/worktrees/docs-eval-operator-guide-20260324Tests Executed
PYTHONPATH=src /home/azureuser/src/amplihack/.venv/bin/python deploy/azure_hive/eval_distributed.py --help-> the wrapper command loads successfully and exposes the expected distributed-runner surface while keepingEH_CONNenv-backed. ✅cd deploy/azure_hive/aspire && dotnet run apphost.cs-> the file-based Aspire AppHost built successfully and launched the local dashboard onhttps://localhost:17193. ✅Regression Checks
python -m pre_commit run --files src/amplihack/eval/progressive_test_suite.py src/amplihack/eval/long_horizon_memory.py docs/EVAL_SYSTEM_ARCHITECTURE.md docs/atlas/compile-deps/README.md docs/hive_mind/EVAL.md docs/hive_mind/EVAL_OPERATOR_GUIDE.md docs/hive_mind/EVAL_COMPONENTS.md mkdocs.yml deploy/azure_hive/eval_distributed.py deploy/azure_hive/eval_distributed_security.py deploy/azure_hive/eval_retrieval_smoke.py deploy/azure_hive/aspire/apphost.cs deploy/azure_hive/tests/test_aspire_apphost.py deploy/azure_hive/tests/test_eval_wrapper_entrypoints.py-> passedPYTHONPATH=src /home/azureuser/src/amplihack/.venv/bin/python -m pytest --import-mode=importlib -q deploy/azure_hive/tests/test_eval_wrapper_entrypoints.py deploy/azure_hive/tests/test_aspire_apphost.py tests/eval/test_progressive_suite.py tests/eval/test_long_horizon_memory.py --maxfail=1->93 passeddotnet build deploy/azure_hive/aspire/apphost.cs -v minimal-> passedscripts/validate_docs_navigation.py) -> passedscripts/validate_gh_pages_links.py --local docs/ --pragmatic) -> passedIssues Found
--question-set; those examples were removed and the docs now point readers toamplihack-agent-evalwhen they need question-set selection--flag valueand--flag=valueforms