Skip to content

feat(vllm_performance): add experiment to test geospatial endpoint with a custom dataset#744

Open
christian-pinto wants to merge 3 commits intomainfrom
cp_vllm_perf_geo_updates
Open

feat(vllm_performance): add experiment to test geospatial endpoint with a custom dataset#744
christian-pinto wants to merge 3 commits intomainfrom
cp_vllm_perf_geo_updates

Conversation

@christian-pinto
Copy link
Copy Markdown
Member

No description provided.

christian-pinto and others added 3 commits March 24, 2026 10:08
…-custom-dataset experiment

Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
…y configuration to test existing vllm geospatial endpoint

Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
…models

Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Comment on lines +138 to +141
if key =="--skip-tokenizer-init":
command.extend([key])
else:
command.extend([key, f"{value!s}"])
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
if key =="--skip-tokenizer-init":
command.extend([key])
else:
command.extend([key, f"{value!s}"])
command.append(key)
if value:
command.append(f"{value!s}")

custom_args={
"--dataset-path": f"{dataset_path.resolve()}",
"--endpoint": "/pooling",
"--skip-tokenizer-init": True,
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
"--skip-tokenizer-init": None,

@DRL-NextGen
Copy link
Copy Markdown
Member

Checks Summary

Last run: 2026-03-25T10:41:12.266Z

Mend Unified Agent vulnerability scan found 1 vulnerabilities:

Severity Identifier Package Details Fix
🔸 Low CVE-2026-4539 pygments-2.19.2-py3-none-any.whl
A security flaw has been discovered in pygments up to 2.19.2. The impacted element is the function A...A security flaw has been discovered in pygments up to 2.19.2. The impacted element is the function AdlLexer of the file pygments/lexers/archetype.py. The manipulation results in inefficient regular expression complexity. The attack is only possible with local access. The exploit has been released to the public and may be used for attacks. The project was informed of the problem early through an issue report but has not responded yet.
Not Available

@AlessandroPomponio AlessandroPomponio changed the title Update the vllm-performance actuator to run experiments with geospatial models feat(vllm_performance): add experiment to test geospatial endpoint with a custom dataset Mar 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants