← index #18870Issue #18868
Related · high · value 2.767
QUERY · ISSUE

tests: thread/stress_heap.py intermittent failure on macOS

openby andrewleechopened 2026-02-25updated 2026-03-19
tests

The stress_heap.py test was excluded from the macOS CI job with a "is
flaky" comment prior to the analysis period. No direct log observations
are available since it was already excluded, but it's listed in
FLAKY_TESTS restricted to the darwin platform.

PR #18861 now handles this via ignore-on-failure instead of exclusion,
so the test runs and its output is visible but doesn't block CI.

See analysis: https://gist.github.com/andrewleech/5686ed5242e0948d8679c432579e002e

CANDIDATE · ISSUE

tests: cmdline/repl_lock.py and repl_cont.py intermittent failures

openby andrewleechopened 2026-02-25updated 2026-03-19
tests

Two REPL tests fail intermittently on CI:

cmdline/repl_lock.py — fails on QEMU ARM and RISCV64. The expected
output shows >>> micropython.heap_lock() but the actual output drops
the >>> prompt prefix. Observed 3 times in 20 runs with logs. This is
a REPL prompt timing issue under QEMU emulation.

cmdline/repl_cont.py — fails on macOS. Differences in quote escaping
in REPL continuation prompts ("'" vs '\''). Observed once in 20 runs.
The macOS job has historically been the second most failure-prone job
(4.3% failure rate, 25 failures over 14 months) with all failures
attributed to REPL-related issues. The August 2025 spike (11 macOS
failures) correlates with the GitHub Actions macOS 15 runner migration.

PR #18861 now ignores these failures in CI.

See analysis: https://gist.github.com/andrewleech/5686ed5242e0948d8679c432579e002e

Keyboard

j / / n
next pair
k / / p
previous pair
1 / / h
show query pane
2 / / l
show candidate pane
c
copy suggested comment
r
toggle reasoning
g i
go to index
?
show this help
esc
close overlays

press ? or esc to close

copied