feat: snapshot stats for table health#18
Merged
Merged
Conversation
added 4 commits
September 30, 2025 10:53
Add comprehensive health analytics system for Apache Iceberg tables with: - Industry-standard health scoring based on Netflix/Salesforce/AWS practices - File health monitoring (small file detection, size distribution analysis) - Operational health tracking (snapshot frequency, compaction monitoring) - Storage efficiency metrics (growth rates, data freshness indicators) - Smart alerting system with severity levels and actionable recommendations - Real-time health indicators integrated into snapshot tab UI The analytics engine provides proactive table health insights to help users identify and address performance issues before they impact query performance.
- Replace simple health notification with comprehensive breakdown panel - Add detailed scoring methodology explanation with industry thresholds - Implement health category cards for File Health, Operational Health, Storage Efficiency, and Compaction Health - Add HealthScoreBadge, HealthCategoryCard, and MaintenanceRecommendationCard components - Include tooltips and explanations for each health metric - Show exact point deductions and status indicators - Display active alerts and maintenance recommendations with priority levels - Based on Netflix, Salesforce, and AWS production best practices Addresses user feedback that health scoring was unclear and needed better breakdown.
- Make health analytics section collapsed by default with clickable header - Add animated chevron icon and hover effects for collapse/expand - Make individual snapshots clickable with hover styling - Add loading spinner when clicking snapshots to simulate async operations - Improve overall interactivity and provide user feedback for better UX Addresses request to reduce initial visual clutter and add loading indicators.
- Add missing 10-point penalty when compaction data is unavailable - Fixes inconsistency where UI showed -10 penalty but calculation didn't apply it - Ensures health score correctly reflects all displayed penalties Resolves issue where tables showed 100/100 health score despite showing compaction penalties in the breakdown.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.