Skip to content

Perf Tests | Default Config File - #4606

Merged
benrr101 merged 6 commits into
mainfrom
dev/russellben/perf-default-config
Oct 16, 2026
Merged

benrr101 merged 6 commits into
mainfrom
dev/russellben/perf-default-config

Conversation

@benrr101

Copy link
Copy Markdown
Contributor

Description

I got annoyed that my changes to the runnerconfig file kept getting blown away when I'd switch branches. We don't have this problem with the manual tests project despite it having a config file. So, I instructed the 🤖 to mirror the pattern in the perf tests project. This moves the runnerconfig.jsonc file to the runnerconfig.default.jsonc, and adds targets to the perf test project to use the default config as the live config (if it doesn't exist already) and copy the live config to the build output. It then adds the live config file as a gitignore, to deter accidentally committing one's DB credentials.

Issues

N/A

Testing

Perf test pipeline should be reran to ensure that the changes play nice.

@benrr101 benrr101 added this to the 8.0.0-preview1 milestone Aug 27, 2026
Copilot AI balanced review requested due to automatic review settings August 27, 2026 19:43
@benrr101
benrr101 requested a review from a team as a code owner August 27, 2026 19:43
@benrr101 benrr101 added the Area\Engineering Use this for issues that are targeted for changes in the 'eng' folder or build systems. label Aug 27, 2026
@github-project-automation github-project-automation Bot moved this to To triage in SqlClient Board Aug 27, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Moves performance-test configuration to a generated, locally editable file.

Changes:

  • Adds a default runner configuration template.
  • Generates and copies the live configuration during builds.
  • Documents and ignores the local configuration file.

Reviewed changes

Copilot reviewed 3 out of 4 changed files in this pull request and generated 1 comment.

File Description
runnerconfig.default.jsonc Provides the default configuration template.
Microsoft.Data.SqlClient.PerformanceTests.csproj Generates and copies the live configuration.
BUILDGUIDE.md Documents the new configuration workflow.
.gitignore Excludes the local runner configuration.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

@github-project-automation github-project-automation Bot moved this from To triage to Waiting for customer in SqlClient Board Aug 27, 2026
Copilot AI review requested due to automatic review settings August 31, 2026 20:52

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

Review details
  • Files reviewed: 10/11 changed files
  • Comments generated: 0 new
  • Review effort level: Balanced

cheenamalhotra
cheenamalhotra previously approved these changes Sep 4, 2026
Preserve build-created runner configs alongside switch A/B comparisons, export redacted configs per pass, and cover config generation and translation with regression tests.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

The updated scripts resolve the earlier clean-checkout ordering issue and include focused cross-shell coverage for config generation, redaction, and translation.

Review details
  • Files reviewed: 11/12 changed files
  • Comments generated: 0 new
  • Review effort level: Balanced

@mdaigle mdaigle moved this from Waiting for customer to In review in SqlClient Board Sep 23, 2026
@benrr101
benrr101 requested review from paulmedynski and a balanced review from Copilot October 5, 2026 21:09

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Note

This error may be related to your runner configuration. You can now configure runners for Copilot code review separately from Copilot cloud agent by creating a copilot-code-review.yml file with your setup steps. Read the docs for details.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot review overview

🟡 Changes recommended

The setup guide instructs users to edit the generated config before any build creates it.

Review effort: Balanced
Findings: 1 High severity · 1 Low severity

Open (2)

Comment thread BUILDGUIDE.md
paulmedynski
paulmedynski previously approved these changes Oct 7, 2026
Copilot AI balanced review requested due to automatic review settings October 7, 2026 16:05

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔵 Needs a closer look

Cross-platform performance orchestration and external pipeline integration were inspected but not executed.

1 open finding
1 resolved since last review

🧠 Review effort: Balanced

@codecov

codecov Bot commented Oct 7, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 65.35%. Comparing base (c7ab087) to head (5697ba8).
⚠️ Report is 5 commits behind head on main.

❗ There is a different number of reports uploaded between BASE (c7ab087) and HEAD (5697ba8). Click for more details.

HEAD has 2 uploads less than BASE
Flag BASE (c7ab087) HEAD (5697ba8)
CI-SqlClient 2 0
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #4606      +/-   ##
==========================================
- Coverage   72.40%   65.35%   -7.05%     
==========================================
  Files         292      286       -6     
  Lines       45471    68600   +23129     
==========================================
+ Hits        32924    44835   +11911     
- Misses      12547    23765   +11218     
Flag Coverage Δ
CI-SqlClient ?
PR-SqlClient-Project 65.35% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

cheenamalhotra
cheenamalhotra previously approved these changes Oct 8, 2026
Copilot AI balanced review requested due to automatic review settings October 13, 2026 21:38

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔵 Needs a closer look

Cross-platform performance orchestration changed substantially, and only static inspection and Bash syntax validation were available.

1 open finding

🧠 Review effort: Balanced

@benrr101
benrr101 merged commit 617759e into main Oct 16, 2026
123 checks passed
@github-project-automation github-project-automation Bot moved this from In review to Done in SqlClient Board Oct 16, 2026
@benrr101
benrr101 deleted the dev/russellben/perf-default-config branch October 16, 2026 21:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Area\Engineering Use this for issues that are targeted for changes in the 'eng' folder or build systems.

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

5 participants