diff --git a/.github/dependabot.yml b/.github/dependabot.yml new file mode 100644 index 0000000000..9ab4abc649 --- /dev/null +++ b/.github/dependabot.yml @@ -0,0 +1,12 @@ +# https://docs.github.com/en/code-security/dependabot/dependabot-version-updates/configuration-options-for-the-dependabot.yml-file +version: 2 +updates: + - package-ecosystem: "github-actions" + directory: "/" + schedule: + interval: "weekly" + - package-ecosystem: "pip" + directory: "/" + schedule: + interval: "daily" + diff --git a/README.md b/README.md index ebb262967f..0490e32216 100644 --- a/README.md +++ b/README.md @@ -54,8 +54,8 @@ With ggml you can efficiently run [Whisper](examples/whisper) inference on the C Memory requirements: | Model | Disk | Mem | -| --- | --- | --- | -| tiny | 75 MB | ~280 MB | +|--------|--------|---------| +| tiny | 75 MB | ~280 MB | | base | 142 MB | ~430 MB | | small | 466 MB | ~1.0 GB | | medium | 1.5 GB | ~2.6 GB | @@ -95,13 +95,13 @@ python3 ../examples/gpt-2/convert-cerebras-to-ggml.py /path/to/Cerebras-GPT-111M The inference speeds that I get for the different models on my 32GB MacBook M1 Pro are as follows: | Model | Size | Time / Token | -| --- | --- | --- | -| GPT-2 | 117M | 5 ms | -| GPT-2 | 345M | 12 ms | -| GPT-2 | 774M | 23 ms | -| GPT-2 | 1558M | 42 ms | -| --- | --- | --- | -| GPT-J | 6B | 125 ms | +|-------|-------|--------------| +| GPT-2 | 117M | 5 ms | +| GPT-2 | 345M | 12 ms | +| GPT-2 | 774M | 23 ms | +| GPT-2 | 1558M | 42 ms | +| --- | --- | --- | +| GPT-J | 6B | 125 ms | For more information, checkout the corresponding programs in the [examples](examples) folder. diff --git a/requirements.txt b/requirements.txt index 9be8160aa1..6ed5f0db74 100644 --- a/requirements.txt +++ b/requirements.txt @@ -1,7 +1,7 @@ -accelerate==0.19.0 -numpy==1.24.3 -sentencepiece==0.1.98 -torch==2.0.1 -torchaudio==2.0.2 -torchvision==0.15.2 -transformers==4.29.2 \ No newline at end of file +accelerate==0.31.0 +numpy==1.26.4 +sentencepiece==0.2.0 +torch==2.3.1 +torchaudio==2.3.1 +torchvision==0.18.1 +transformers==4.41.2