Skip to content

test(live): stabilize close callback synchronization - #1145

Merged
apcha-oai merged 1 commit into
mainfrom
codex/fix-transcript-close-test-flake-20261005
Oct 5, 2026
Merged

apcha-oai merged 1 commit into
mainfrom
codex/fix-transcript-close-test-flake-20261005

Conversation

@apcha-oai

Copy link
Copy Markdown
Contributor

Summary

Keep the transcript close test's callback blocked until the test explicitly releases it. Its previous 10-second timeout could expire while the test thread was delayed, causing a correct close() to return and fail the assertion that it was still waiting. This reproduces the failure that removed #1144 from the merge queue.

Run push() on a worker too: it can wait for the timer-dispatched callback. The test still checks that close() blocks before release and delivers the final transcript before returning, with bounded worker waits and unconditional callback release during cleanup.

Reproduced the original failure by pausing the test thread for 11 seconds after callback entry; the revised test passes the same schedule. It also catches a temporary mutation that makes close() return early, passes 100 consecutive executions, and passes all 37 transcript tests. The delay and mutation are local probes, not committed changes. No production behavior changes.

@apcha-oai
apcha-oai requested a review from a team as a code owner October 5, 2026 17:41
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 5, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-05T17:43:08.433470Z 2eddb49 Manual request
🔒 Security Review ✅ Completed 2026-10-05T17:43:33.916943Z 2eddb49 Manual request
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@apcha-oai

Copy link
Copy Markdown
Contributor Author

@codex review pls

@openai-sdks

openai-sdks Bot commented Oct 5, 2026 •

Copy link
Copy Markdown
Contributor

OkTest Summary

✅ 236/236 SDK tests passed in 14.016s for Java SDK PR #1145.

Test results — 42 files
Test Result Time
tests/chat-completions-complex-body.test.ts ✅ Passed 175ms
tests/chat-completions-create.test.ts ✅ Passed 436ms
tests/chat-completions-stream.test.ts ✅ Passed 311ms
tests/files-content-binary.test.ts ✅ Passed 284ms
tests/files-create-multipart.test.ts ✅ Passed 248ms
tests/files-list-pagination.test.ts ✅ Passed 248ms
tests/initialize-config.test.ts ✅ Passed 100ms
tests/instance-isolation.test.ts ✅ Passed 180ms
tests/models-list.test.ts ✅ Passed 229ms
tests/responses-background-lifecycle.test.ts ✅ Passed 220ms
tests/responses-body-method-errors.test.ts ✅ Passed 534ms
tests/responses-cancel-timeout.test.ts ✅ Passed 270ms
tests/responses-cancel.test.ts ✅ Passed 181ms
tests/responses-compact-retries.test.ts ✅ Passed 379ms
tests/responses-compact.test.ts ✅ Passed 250ms
tests/responses-create-advanced-stream.test.ts ✅ Passed 280ms
tests/responses-create-advanced.test.ts ✅ Passed 1.155s
tests/responses-create-disconnect.test.ts ✅ Passed 1.036s
tests/responses-create-errors.test.ts ✅ Passed 329ms
tests/responses-create-malformed-api-responses.test.ts ✅ Passed 187ms
tests/responses-create-retries.test.ts ✅ Passed 194ms
tests/responses-create-stream-failures.test.ts ✅ Passed 154ms
tests/responses-create-stream-timeout.test.ts ✅ Passed 178ms
tests/responses-create-stream-wire.test.ts ✅ Passed 5.178s
tests/responses-create-stream.test.ts ✅ Passed 246ms
tests/responses-create-terminal-states.test.ts ✅ Passed 295ms
tests/responses-create-timeout.test.ts ✅ Passed 191ms
tests/responses-create.test.ts ✅ Passed 220ms
tests/responses-delete.test.ts ✅ Passed 202ms
tests/responses-input-items-errors.test.ts ✅ Passed 239ms
tests/responses-input-items-list.test.ts ✅ Passed 240ms
tests/responses-input-items-options.test.ts ✅ Passed 419ms
tests/responses-input-tokens-count-timeout.test.ts ✅ Passed 250ms
tests/responses-input-tokens-count.test.ts ✅ Passed 259ms
tests/responses-malformed-inputs.test.ts ✅ Passed 4.209s
tests/responses-not-found-errors.test.ts ✅ Passed 292ms
tests/responses-parse.test.ts ✅ Passed 485ms
tests/responses-retrieve-retries.test.ts ✅ Passed 933ms
tests/responses-retrieve.test.ts ✅ Passed 244ms
tests/responses-stored-method-errors.test.ts ✅ Passed 916ms
tests/retry-behavior.test.ts ✅ Passed 3.405s
tests/sdk-error-shape.test.ts ✅ Passed 454ms

View OkTest run #37350330405

SDK merge (67629ea9f8c7) · head (2eddb49d20bd) · base (c50d94b56e76) · OkTest (505ac0e34283)

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Breezy!

Reviewed commit: 2eddb49d20

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@chatgpt-codex-connector

Copy link
Copy Markdown

🛡️ Codex Security Review · Automatically triggered

Security review completed. No security issues were found in this pull request.

Reviewed commit: 2eddb49d20

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

@github-actions

github-actions Bot commented Oct 5, 2026

Copy link
Copy Markdown
Contributor

Castiron custom code

Evaluated main: c50d94b56e76317888b7018fd51c6704c89865b5.

✅ No new custom-code files detected.

91 mixed files remain; 0 existing customizations changed.

Compared c50d94b56e76 → 2eddb49d20bd. Generated baselines verified.

91 existing customizations unchanged
  • openai-java-core/src/main/kotlin/com/openai/models/audio/AudioResponseFormat.kt
  • openai-java-core/src/main/kotlin/com/openai/models/beta/agents/vaults/credentials/CredentialAuth.kt
  • openai-java-core/src/main/kotlin/com/openai/models/beta/agents/vaults/credentials/CredentialAuthCreateParam.kt
  • openai-java-core/src/main/kotlin/com/openai/models/beta/agents/vaults/credentials/CredentialAuthRotateParam.kt
  • openai-java-core/src/main/kotlin/com/openai/models/beta/responses/BetaResponse.kt
  • openai-java-core/src/main/kotlin/com/openai/models/beta/responses/BetaResponseStreamEvent.kt
  • openai-java-core/src/main/kotlin/com/openai/models/beta/responses/BetaResponsesServerEvent.kt
  • openai-java-core/src/main/kotlin/com/openai/models/chat/completions/ChatCompletionCreateParams.kt
  • openai-java-core/src/main/kotlin/com/openai/models/chat/completions/ChatCompletionMessageFunctionToolCall.kt
  • openai-java-core/src/main/kotlin/com/openai/models/chat/completions/ChatCompletionToolMessageParam.kt
  • openai-java-core/src/main/kotlin/com/openai/models/embeddings/Embedding.kt
  • openai-java-core/src/main/kotlin/com/openai/models/embeddings/EmbeddingCreateParams.kt
  • openai-java-core/src/main/kotlin/com/openai/models/responses/Response.kt
  • openai-java-core/src/main/kotlin/com/openai/models/responses/ResponseCreateParams.kt
  • openai-java-core/src/main/kotlin/com/openai/models/responses/ResponseFunctionToolCall.kt
  • openai-java-core/src/main/kotlin/com/openai/models/responses/ResponseFunctionWebSearch.kt
  • openai-java-core/src/main/kotlin/com/openai/models/responses/ResponseInputItem.kt
  • openai-java-core/src/main/kotlin/com/openai/models/responses/ResponseStreamEvent.kt
  • openai-java-core/src/main/kotlin/com/openai/models/responses/ResponseTextConfig.kt
  • openai-java-core/src/main/kotlin/com/openai/models/responses/ResponsesServerEvent.kt
  • openai-java-core/src/main/kotlin/com/openai/models/videos/Video.kt
  • openai-java-core/src/main/kotlin/com/openai/models/webhooks/UnwrapWebhookEvent.kt
  • openai-java-core/src/main/kotlin/com/openai/models/webhooks/WebhookEndpointWithSecret.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/BetaServiceAsync.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/BetaServiceAsyncImpl.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/ImageServiceAsyncImpl.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/ResponseServiceAsync.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/ResponseServiceAsyncImpl.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/SkillServiceAsyncImpl.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/VideoServiceAsyncImpl.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/WebhookServiceAsync.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/WebhookServiceAsyncImpl.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/audio/TranscriptionServiceAsyncImpl.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/audio/TranslationServiceAsyncImpl.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/audio/VoiceServiceAsyncImpl.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/beta/agents/SessionServiceAsync.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/beta/agents/SessionServiceAsyncImpl.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/chat/ChatCompletionServiceAsync.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/finetuning/checkpoints/PermissionServiceAsyncImpl.kt
  • openai-java-core/src/main/kotlin/com/openai/services/async/skills/VersionServiceAsyncImpl.kt

51 more in the full report.

A changed generated baseline means this report cannot reliably identify which handwritten lines changed.

Inspect the custom-code diff

Download the exact patch produced by this run (requires repository access):

gh run download 37350518845 --repo openai/openai-java \
  --name castiron-custom-code-37350518845-1 --dir /tmp/castiron-custom-code-37350518845-1
git apply --stat /tmp/castiron-custom-code-37350518845-1/custom-code.patch
cat /tmp/castiron-custom-code-37350518845-1/custom-code.patch

Or reproduce it from an SDK checkout containing the vendored reporter:

git fetch --no-tags origin c50d94b56e76317888b7018fd51c6704c89865b5 2eddb49d20bda4056af094dff552bd456ee1c1b2
python3 scripts/castiron/custom_code_report.py report \
  --base c50d94b56e76317888b7018fd51c6704c89865b5 \
  --head 2eddb49d20bda4056af094dff552bd456ee1c1b2 --fetch --require-head-hash --public \
  --out /tmp/castiron-custom-code-2eddb49d20bd
cat /tmp/castiron-custom-code-2eddb49d20bd/custom-code.patch

This is the current full custom patch for mixed files, not an attribution of only the handwritten lines changed by this PR.

Full report and patch

@markstuart-oai markstuart-oai left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed 2eddb49d20bda4056af094dff552bd456ee1c1b2. No actionable findings.

The callback now waits until the test releases it, even if CI pauses the test thread. Running push() on a worker lets the test proceed when the timer is delivering the callback. The test still checks that close() waits and that the final transcript arrives before it returns. Cleanup always releases the callback. These changes fit the existing test structure without changing production code.

Source review only. Hosted build, lint, tests, compatibility, and Castiron checks pass on this commit. The delay probe, repeated runs, and early-return mutation are author-reported; I did not run them locally.

@apcha-oai
apcha-oai added this pull request to the merge queue Oct 5, 2026
Merged via the queue into main with commit 93841aa Oct 5, 2026
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants