Skip to content

fix(whisper): bound version guard to < 4.8 + guard explicit CUDA devices #1052

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
kwit75 merged 2 commits into from
Jun 1, 2026
Merged

fix(whisper): bound version guard to < 4.8 + guard explicit CUDA devices #1052

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
ee9b364
fix(whisper): bound ctranslate2 version guard + protect explicit CUDA…
anandray Jun 1, 2026
1c5a953
ci: retrigger CI (Windows HuggingFace network flake)
anandray Jun 1, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 12 additions & 2 deletions packages/ai/src/ai/common/models/audio/whisper.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -89,7 +89,8 @@ def _check_gpu_compatible(cls) -> bool:
# 1. Version guard: ctranslate2 4.7.x + CUDA 12.8 causes a
# tcache_thread_shutdown() SIGABRT during GPU transcription on H200
# (heap corruption in cuBLAS 12.8.4). Exit non-zero to force CPU.
# Remove this guard once ctranslate2 ships a fix.
# Upper bound at 4.8 so the guard lifts automatically once
# ctranslate2 ships a fix (expected in 4.8+).
# 2. StorageView sanity: verify a CUDA StorageView can be created via
# the documented from_array() API (no direct (shape,dtype,device)
# constructor exists in the Python bindings).
Expand All @@ -102,7 +103,7 @@ def _check_gpu_compatible(cls) -> bool:
'except (ValueError, AttributeError):\n'
' ct2 = (999, 999)\n'
'cuda = torch.version.cuda or ""\n'
'if ct2 >= (4, 7) and cuda.startswith("12.8"):\n'
'if (4, 7) <= ct2 < (4, 8) and cuda.startswith("12.8"):\n'
' sys.exit(1)\n'
't = torch.zeros(1, dtype=torch.float32, device="cuda")\n'
'sv = ctranslate2.StorageView.from_array(t)\n'
Expand Down Expand Up @@ -213,6 +214,15 @@ def load(
device = 'cuda'
else:
device = 'cpu'
elif device != 'cpu' and not WhisperLoader._check_gpu_compatible():
# Explicit cuda / cuda:N requested but probe failed — fall back to CPU
# so the same SIGABRT protection applies regardless of how the caller
# specified the device.
logger.warning(
'ctranslate2 CUDA probe failed for explicit device=%r — Whisper will use CPU instead.',
device,
)
device = 'cpu'

if device == 'cpu':
gpu_index = -1
Expand Down
Loading