Skip to content

Make live Core HTTP benchmarks opt-in - #5371

Merged
Tomas Varon (tvaron3) merged 4 commits into
mainfrom
tvaron3-replace-retired-httpbin-dependency
Sep 29, 2026
Merged

Tomas Varon (tvaron3) merged 4 commits into
mainfrom
tvaron3-replace-retired-httpbin-dependency

Conversation

@tvaron3

@tvaron3 Tomas Varon (tvaron3) commented Sep 28, 2026 •

Copy link
Copy Markdown
Member

Summary

The SDK-hosted httpbin service at azuresdkforcpp.azurewebsites.net was intentionally retired. Core's four live HTTP transport benchmarks still require it, causing Linux and Windows CI failures, including those affecting #5334. This separate Core-only fix follows the explicit opt-in approach in Azure/azure-sdk-for-cpp#7216.

  • Replace the retired endpoint constant in the unpublished azure_core_examples helper with validated AZSDKRUSTTEST_HTTPBIN_URL configuration, add configuration tests, and regenerate its API artifact.
  • Register all four live transport benchmarks only when configured. An unset variable prints an explicit notice that no HTTP requests were tested. Invalid configuration and request failures retain actionable errors instead of skipping.
  • Update core_ureq_client to require the same configuration and allow an explicitly configured local HTTP service.
  • Document the endpoint contract, commands, skip behavior, and existing macOS exclusion in the Core README.

No fallback public endpoint or automatic server provisioning is introduced. Offline benchmarks, published Core APIs, recorded telemetry tests, and native cursor code remain unchanged.

Remove the required dependency on the retired SDK-hosted httpbin service. Follow the explicit endpoint configuration approach in Azure/azure-sdk-for-cpp#7216 to unblock Core benchmark failures affecting #5334.

Use AZURE_CORE_HTTPBIN_URL in the transport benchmarks and ureq example. Report unconfigured and macOS-skipped runs explicitly, and preserve errors for invalid configuration and failed requests.

Replace the unpublished example helper's endpoint constant with validated configuration and tests, regenerate its API artifact, and document setup and execution limits in the Core README. Published APIs and recorded telemetry tests remain unchanged.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 1 pipeline(s).
2 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Comment thread sdk/core/azure_core/benches/http_transport_benchmarks.rs Outdated
Use AZSDKRUSTTEST_HTTPBIN_URL to identify the SDK and test-only purpose, matching the C++ SDK naming convention.

Update the helper's environment lookup, diagnostics, and tests alongside benchmark/example messages and README commands.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@tvaron3
Tomas Varon (tvaron3) enabled auto-merge (squash) September 28, 2026 21:49
Comment thread sdk/core/azure_core/README.md Outdated
Recognize the Rust test endpoint variable in the shared cSpell configuration to fix Analyze failures.

Move live benchmark and example setup from the Core README to CONTRIBUTING.md, keeping contributor instructions out of the published crate documentation as requested in review.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Note

This error may be related to your runner configuration. You can now configure runners for Copilot code review separately from Copilot cloud agent by creating a copilot-code-review.yml file with your setup steps. Read the docs for details.

Comment thread CONTRIBUTING.md Outdated
Rename the endpoint setting to AZURE_TEST_HTTPBIN_URL in the helper, tests, benchmark/example diagnostics, and contributor commands to follow the existing Azure SDK convention requested in review.

Remove the spelling exception for the superseded Rust-specific prefix.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@tvaron3
Tomas Varon (tvaron3) merged commit 0b4fe5b into main Sep 29, 2026
15 checks passed
@tvaron3
Tomas Varon (tvaron3) deleted the tvaron3-replace-retired-httpbin-dependency branch September 29, 2026 00:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Azure.Core The azure_core crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants