Repository navigation
Conversation
Codecov Report❌ Patch coverage is 📢 Thoughts on this report? Let us know! |
|
Metal bench failed. 1 of 150 measures outside bounds.
Counters per txn
Microbench: all 135 measures within bounds.
Logslb, microbench, pooler, sharding-w2, sharding-w8, verdict.json |
|
| Project | PgDog |
| Branch | having-execution |
| Testbed | Intel v1 |
🚨 1 Alert
| Benchmark | Measure Units | View | Benchmark Result (Result Δ%) | Upper Boundary (Limit %) |
|---|---|---|---|---|
| lb-v3 | cpu-per-txn Measure (units) | 📈 plot 🚷 threshold 🚨 alert (🔔) | 42.40 units(+1.90%)Baseline: 41.61 units | 42.03 units (100.90%) |
Click to view all benchmark results
| Benchmark | Throughput | Benchmark Result operations / second (ops/s) x 1e3 (Result Δ%) | Lower Boundary operations / second (ops/s) x 1e3 (Limit %) | cpu-per-txn | Benchmark Result Measure (units) (Result Δ%) | Upper Boundary Measure (units) (Limit %) |
|---|---|---|---|---|---|---|
| lb-v3 | 📈 view plot 🚷 view threshold | 15.99 ops/s x 1e3(+0.00%)Baseline: 15.99 ops/s x 1e3 | 15.83 ops/s x 1e3 (99.00%) | 📈 view plot 🚷 view threshold 🚨 view alert (🔔) | 42.40 units(+1.90%)Baseline: 41.61 units | 42.03 units (100.90%) |
|
| Project | PgDog |
| Branch | having-execution |
| Testbed | Intel v1 |
Click to view all benchmark results
| Benchmark | Throughput | Benchmark Result operations / second (ops/s) x 1e3 (Result Δ%) | Lower Boundary operations / second (ops/s) x 1e3 (Limit %) | cpu-per-txn | Benchmark Result Measure (units) (Result Δ%) | Upper Boundary Measure (units) (Limit %) |
|---|---|---|---|---|---|---|
| pooler-v3 | 📈 view plot 🚷 view threshold | 16.99 ops/s x 1e3(+0.00%)Baseline: 16.99 ops/s x 1e3 | 16.82 ops/s x 1e3 (99.00%) | 📈 view plot 🚷 view threshold | 40.91 units(+0.90%)Baseline: 40.55 units | 40.95 units (99.90%) |
|
@jkaczman I think that failed bencher report is noise here |
Probably. I'll be replacing Bencher this evening with x86 spot instances from AWS running within the metal bench to supplement the current arm64 Graviton data, which should fix the noise via the extra work our bench does to eliminate variance and provide 95% confidence intervals. I'll also fix that flaky ctx measure. |
|
@murex971 can you rebase off main to get the new x86 bench in here? |
No description provided.