All issues

Search results

cannot open this link: https://pytorch-extension.intel.com/release-whl/stable/cpu/us/

Status: Open.

#289 In intel/llm-on-ray;

· MaoJianwei opened on Jun 24, 2025

NameError: name 'vllm_ChatCompletionRequest' is not defined

Status: Open.

#288 In intel/llm-on-ray;

· mitrasarthak20 opened on May 1, 2025

CPU Tensor parallel inference?

Status: Open.

#286 In intel/llm-on-ray;

· hasaki321 opened on Apr 7, 2025

Inference Mixtral on Gaudi

Status: Open.

#249 In intel/llm-on-ray;

· Deegue opened on Jun 12, 2024

Finetuning on Ray and CPU causes Runtime error

Status: Open.

#242 In intel/llm-on-ray;

· premdass opened on May 31, 2024

A question about finetune dataset processing

Status: Open.

#234 In intel/llm-on-ray;

· KepingYan opened on May 22, 2024

Revise README.md in examples directory

Status: Open.

#224 In intel/llm-on-ray;

· xwu-intel opened on May 15, 2024

Calculate correct input length for every prompt in a single batch

Status: Open.

#222 In intel/llm-on-ray;

· kira-lin opened on May 14, 2024

Output some debug info in CI when Internal Server Error

Status: Open.

#218 In intel/llm-on-ray;

· xwu-intel opened on May 13, 2024

Define simple_protocol.py and define pydantic SimpleRequest and SimpleModelResponse classes to encapsulate current json format

Status: Open.

#217 In intel/llm-on-ray;

· xwu-intel opened on May 13, 2024

Issue about using ipex on cpu

Status: Open.

#197 In intel/llm-on-ray;

· KepingYan opened on Apr 19, 2024

Openai API not allow temperature=0.0 for llama-2-7b-chat-hf

Status: Open.

#139 In intel/llm-on-ray;

· yutianchen666 opened on Mar 12, 2024