Skip to content

fix: hydrate download uses 1-indexed release assets → 0-indexed local paths GitHub release assets: shard-01.bgz7 through shard-04.bgz7 (1-indexed) Local storage + manifest SHA256: shard-00.bgz7 through shard-03.bgz7 (0-indexed) Verified: qwen35-9b-base + qwen35-9b-distilled, all 8 shards SHA256 OK. https://claude.ai/code/session_01Y69Vnw751w75iVSBRws7o7 #77

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
AdaWorldAPI wants to merge 1 commit into
base: main
Choose a base branch
from
+7 −6
Open

fix: hydrate download uses 1-indexed release assets → 0-indexed local paths GitHub release assets: shard-01.bgz7 through shard-04.bgz7 (1-indexed) Local storage + manifest SHA256: shard-00.bgz7 through shard-03.bgz7 (0-indexed) Verified: qwen35-9b-base + qwen35-9b-distilled, all 8 shards SHA256 OK. https://claude.ai/code/session_01Y69Vnw751w75iVSBRws7o7 #77

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 7 additions & 6 deletions crates/bgz-tensor/src/hydrate.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -115,17 +115,18 @@ fn cmd_download(manifest: &manifest::Manifest, model: &str) {
let tag = &entry.release_tag;

for shard in 0..entry.shards {
let filename = format!("shard-{shard:02}.bgz7");
let dest = dir.join(&filename);
let local_filename = format!("shard-{shard:02}.bgz7"); // 0-indexed local
let release_shard = shard + 1; // 1-indexed in GitHub releases
let dest = dir.join(&local_filename);

if dest.exists() && fs::metadata(&dest).map(|m| m.len() > 0).unwrap_or(false) {
println!(" {filename}: already present, skipping");
println!(" {local_filename}: already present, skipping");
continue;
}

let asset_name = format!("{model}--{filename}");
let asset_name = format!("{model}--shard-{release_shard:02}.bgz7");
let url = format!("https://github.com/{repo}/releases/download/{tag}/{asset_name}");
println!(" Downloading {filename} from release {tag}...");
println!(" Downloading {local_filename} (from {asset_name})...");

let status = process::Command::new("curl")
.args(["-fSL", "--retry", "4", "--retry-delay", "2",
Expand All @@ -134,7 +135,7 @@ fn cmd_download(manifest: &manifest::Manifest, model: &str) {
.expect("curl not found");

if !status.success() {
eprintln!(" FAILED to download {filename}");
eprintln!(" FAILED to download {local_filename}");
// Clean up partial file
let _ = fs::remove_file(&dest);
process::exit(1);
Expand Down