Skip to content

gh-153569: Simplify tokenizer state #210957

gh-153569: Simplify tokenizer state

gh-153569: Simplify tokenizer state #210957

Triggered via pull request September 24, 2026 22:48
Status Cancelled
Total duration 14m 13s
Artifacts 2

build.yml

on: pull_request
Change detection  /  Create context from changed files
13s
Change detection / Create context from changed files
Matrix: Address sanitizer
Matrix: build-macos
Matrix: build-san
Matrix: Ubuntu SSL tests
Matrix: build-ubuntu
Matrix: build-windows
Matrix: cifuzz
Docs  /  Doctest
7m 20s
Docs / Doctest
Docs  /  Check EPUB
2m 22s
Docs / Check EPUB
Check if Autoconf files are up to date
25s
Check if Autoconf files are up to date
Check if generated files are up to date
5m 40s
Check if generated files are up to date
C API Docs  /  Check if all C APIs are documented
8s
C API Docs / Check if all C APIs are documented
Ubuntu (installed)  /  build, install and test
6m 9s
Ubuntu (installed) / build, install and test
iOS
13m 44s
iOS
Emscripten  /  build and test
12m 47s
Emscripten / build and test
WASI  /  build and test
4m 23s
WASI / build and test
Hypothesis tests on Ubuntu
7m 51s
Hypothesis tests on Ubuntu
Lazy imports enabled  /  Run Tests with lazy_imports=all
12m 45s
Lazy imports enabled / Run Tests with lazy_imports=all
Cross build Linux
4m 34s
Cross build Linux
Matrix: build-android
Docs  /  ...  /  Check for removed HTML IDs
2m 14s
Docs / Check for removed HTML IDs / Check for removed HTML IDs
All required checks pass
3s
All required checks pass
Fit to window
Zoom out
Zoom in

Annotations

70 errors, 7 warnings, and 11 notices
Docs / Check EPUB
Process completed with exit code 1.
Docs / Docs
Process completed with exit code 2.
CIFuzz / cpython3 (address)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
CIFuzz / cpython3 (address)
Path does not exist: cifuzz-sarif/results.sarif
CIFuzz / cpython3 (address)
The operation was canceled.
CIFuzz / cpython3 (memory)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
CIFuzz / cpython3 (memory)
Path does not exist: cifuzz-sarif/results.sarif
CIFuzz / cpython3 (memory)
The operation was canceled.
CIFuzz / cpython3 (undefined)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
CIFuzz / cpython3 (undefined)
Path does not exist: cifuzz-sarif/results.sarif
CIFuzz / cpython3 (undefined)
The operation was canceled.
Windows (free-threading) / Build and test (x64, tail-call)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Windows (free-threading) / Build and test (x64, tail-call)
The operation was canceled.
Windows / Build and test (x64, switch-case)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Windows / Build and test (x64, switch-case)
The operation was canceled.
Address sanitizer (ubuntu-26.04)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Address sanitizer (ubuntu-26.04)
The operation was canceled.
Windows / Build and test (arm64, switch-case)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Windows / Build and test (arm64, switch-case)
The operation was canceled.
Windows (free-threading) / Build and test (arm64, switch-case)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Windows (free-threading) / Build and test (arm64, switch-case)
The operation was canceled.
Windows / Build and test (Win32, switch-case)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Windows / Build and test (Win32, switch-case)
The operation was canceled.
Sanitizers / UBSan
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Sanitizers / UBSan
The operation was canceled.
Ubuntu (free-threading) / build and test (ubuntu-26.04)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Ubuntu (free-threading) / build and test (ubuntu-26.04)
The operation was canceled.
Sanitizers / TSan (free-threading)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Sanitizers / TSan (free-threading)
The operation was canceled.
Ubuntu / build and test (ubuntu-26.04)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Ubuntu / build and test (ubuntu-26.04)
The operation was canceled.
Lazy imports enabled / Run Tests with lazy_imports=all
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Lazy imports enabled / Run Tests with lazy_imports=all
The operation was canceled.
Windows (free-threading) / Build and test (x64, switch-case)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Windows (free-threading) / Build and test (x64, switch-case)
The operation was canceled.
Ubuntu (bolt) / build and test (ubuntu-26.04)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Ubuntu (bolt) / build and test (ubuntu-26.04)
The operation was canceled.
Android (x86_64)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Android (x86_64)
The operation was canceled.
Emscripten / build and test
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Emscripten / build and test
The operation was canceled.
macOS / build and test (macos-26-intel)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
macOS / build and test (macos-26-intel)
The operation was canceled.
macOS / build and test (macos-26)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
macOS / build and test (macos-26)
The operation was canceled.
macOS (free-threading) / build and test (macos-26)
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
macOS (free-threading) / build and test (macos-26)
The operation was canceled.
iOS
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
iOS
The operation was canceled.
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
All required checks pass
Process completed with exit code 1.
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Tests
Canceling since a higher priority waiting request for Tests-pablogsal-gh-153569-tokenizer-cleanups exists
Cross build Linux: Parser/lexer/string.c#L86
variable ‘previous_end’ set but not used [-Wunused-but-set-variable]
Ubuntu (installed) / build, install and test: Parser/lexer/string.c#L86
variable ‘previous_end’ set but not used [-Wunused-but-set-variable]
Hypothesis tests on Ubuntu
No files were found with the provided path: /home/runner/work/cpython/cpython-builddir/.hypothesis/examples/. No artifacts will be uploaded.
Address sanitizer (ubuntu-26.04): Parser/lexer/string.c#L86
variable ‘previous_end’ set but not used [-Wunused-but-set-variable]
macOS / build and test (macos-26-intel)
`$HOMEBREW_NO_INSTALLED_DEPENDENTS_CHECK` is set: not checking for outdated dependents or dependents with broken linkage!
macOS / build and test (macos-26)
`$HOMEBREW_NO_INSTALLED_DEPENDENTS_CHECK` is set: not checking for outdated dependents or dependents with broken linkage!
macOS (free-threading) / build and test (macos-26)
`$HOMEBREW_NO_INSTALLED_DEPENDENTS_CHECK` is set: not checking for outdated dependents or dependents with broken linkage!
Change detection / Create context from changed files
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
C API Docs / Check if all C APIs are documented
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Docs / Check EPUB
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Docs / Docs
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Docs / Check for removed HTML IDs / Check for removed HTML IDs
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
CIFuzz / cpython3 (address)
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
CIFuzz / cpython3 (memory)
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
CIFuzz / cpython3 (undefined)
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Windows / Build and test (arm64, switch-case)
"The windows-11-arm label will migrate to use Visual Studio 2026 by default beginning September 21, 2026. For more information see https://github.com/actions/runner-images/issues/14602"
Windows (free-threading) / Build and test (arm64, switch-case)
"The windows-11-arm label will migrate to use Visual Studio 2026 by default beginning September 21, 2026. For more information see https://github.com/actions/runner-images/issues/14602"
All required checks pass
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"

Artifacts

Produced during runtime
Name Size Digest
UBSan-logs-default
365 Bytes
sha256:89fd909896c797c34b57bb650b9566120a76a7bc1c6167ba6b3dd5b0e3fa9372
html-ids-head.json.gz
130 KB
sha256:cf95a8e20c94d754fabf0eaa76304d9efbd939ca4706574a3a7ff563169fe44b