Skip to content

Add (disabled) get-all-crates unit to dev desktops#1033

Merged
Mark-Simulacrum merged 1 commit intorust-lang:masterfrom
Mark-Simulacrum:get-all-crates
Apr 4, 2026
Merged

Add (disabled) get-all-crates unit to dev desktops#1033
Mark-Simulacrum merged 1 commit intorust-lang:masterfrom
Mark-Simulacrum:get-all-crates

Conversation

@Mark-Simulacrum
Copy link
Copy Markdown
Member

@Mark-Simulacrum Mark-Simulacrum commented Apr 4, 2026

This is disabled, but has run successfully (ish, see below) on dev-desktop-us-2.

$ sudo du -h -d 1 /home/crates-io-downloader
1.4G    /home/crates-io-downloader/.rustup
267M    /home/crates-io-downloader/.cargo
20K     /home/crates-io-downloader/.config
8.0K    /home/crates-io-downloader/.ansible
4.8G    /home/crates-io-downloader/crates.io-index
6.3G    /home/crates-io-downloader
$ sudo du -h -d 0 /var/cache/all-crates
385G    /var/cache/all-crates

Running the systemd unit repeatedly exited early due to memory limits -- I think if we want to enable the timer to run this unit on a periodic basis, we'll want to work to either update or replace get-all-crates to not use meaningful memory before we enable this on a continuous basis. It runs incrementally, so I don't think there's actually a hard blocker there, but it feels like there's an opportunity for improvement that should be driven to conclusion.

In the meantime us-2 has a copy in /var/cache/all-crates that is probably useful for folks and we can manually run the unit on an as-needed basis on that host (sudo systemctl start get-all-crates).

cc #t-infra > Put all crates on dev desktops

@Mark-Simulacrum Mark-Simulacrum merged commit 4da88c8 into rust-lang:master Apr 4, 2026
4 checks passed
@Mark-Simulacrum Mark-Simulacrum deleted the get-all-crates branch April 4, 2026 23:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant