Feature/add gpu lightgbm estimator#50
Merged
Merged
Conversation
Connect PerfTools LightGBM_model/1.0 as a GPU kernel section package so GENESIS can exercise the second GPU estimation model through the existing instrumented section flow. Add a small NCU raw CSV preparation bridge for LightGBM, wire the shared PerfTools checkout into the estimation runner, and make GENESIS default to the LightGBM GPU section package while still allowing BK_GENESIS_GPU_SECTION_PACKAGE to select the MLP path. Keep padata archives smaller by excluding heavy Nsight Compute binary reports by default. The raw CSV and text import remain available for estimation and portal summaries, with BK_PROFILER_ARCHIVE_NCU_REPORT=true left as an explicit debugging opt-in. Add shell coverage for the LightGBM prediction CSV path, GENESIS package selection, and the new profiler archive behavior. Signed-off-by: Yoshifumi Nakamura <nakamura@riken.jp>
Propagate section package transform failures through the top-level breakdown dispatcher so external predictor failures cannot produce a green estimate job with missing values. Make the MLP and LightGBM predictor wrappers fail explicitly when inference exits non-zero or no prediction CSV is produced, and cover the LightGBM failure path in shell tests. Signed-off-by: Yoshifumi Nakamura <nakamura@riken.jp>
Treat recorded/current weak-scaling breakdowns as identity/logp projections instead of carrying cross-system GPU section packages into the current side. This removes misleading fallback metadata such as gpu_kernel_lightgbm_v10 -> identity from current_system while preserving the future-side GPU estimator result. Signed-off-by: Yoshifumi Nakamura <nakamura@riken.jp>
Document GPU kernel estimator packages as selectable options rather than canonical defaults. Note that GENESIS can choose the section package through BK_GENESIS_GPU_SECTION_PACKAGE during bring-up, and keep qws smoke guidance scoped to the MLP package. Signed-off-by: Yoshifumi Nakamura <nakamura@riken.jp>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.