Skip to content

michaelwaves/llamacon-hackathon

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

60 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

# Llama API
curl "https://api.llama.com/v1/chat/completions" `
-H "Content-Type: application/json" `
-H "Authorization: Bearer <your llama api key>" `
-d '{
  "model": "Llama-4-Maverick-17B-128E-Instruct-FP8",
  "messages": [
    { "role": "user", "content": "Hello Llama! Can you give me a quick intro?" }
  ]
}'

# GPU instances from Nebius:

What you will be getting:

### Hardware:
* 16 vCPU
* 200 GB of RAM
* 1 Nvidia H100 GPU (80 GB of VRAM)
* 1 TB SSD storage

### Installed on the instance:
Ubuntu 22.04
Nvidia driver: v550.144.03 (CUDA v12.4)
Python 3.10
Docker Engine v28.0.1


## How to get your GPU instance

DM me (cyril.k), I will send you the credentials for connection via SSH.

## When you got your credentials
* Open your terminal
* Run `ssh llamahack@<host>` (replace `<host>` with your instance IP)
* You may be be prompted to add `<host>` to the list of known hosts, type `yes`
* Enter your `password` from credentials you received
* You are in, start hacking!

## Important
Do not attempt to update or re-install Nvidia driver on your instance (your VM already has it installed) 

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors