Skip to content

Commit 15ee1bf

Browse files
Merge branch 'main' into cursor/simplify-alert-name-fields-e389
2 parents 5915330 + 5abf27e commit 15ee1bf

80 files changed

Lines changed: 5631 additions & 243 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
---
2+
'@hyperdx/app': patch
3+
---
4+
5+
feat: Row side panel summarizes clicks, navigations and console messages from OpenTelemetry browser SDKs, and navigation rows no longer show an HTTP Request section
Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
---
2+
'@hyperdx/app': patch
3+
---
4+
5+
Saving a search no longer reloads the page: the new saved search is opened with
6+
a client-side navigation, which also fixes the 404 this caused on the static
7+
ClickStack build.

‎.changeset/mcp-describe-table.md‎

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
---
2+
'@hyperdx/api': minor
3+
---
4+
5+
feat(mcp): add `clickstack_describe_table` to list the tables in a database and describe a table that is not a registered source (columns, keys, engine, skipping indices, approximate size, optional row sample)
Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
---
2+
'@hyperdx/api': patch
3+
'@hyperdx/common-utils': patch
4+
---
5+
6+
fix: make clickstack_event_patterns drill-down snippets executable
7+
8+
Each pattern's `whereSnippet` is now a SQL predicate (`whereLanguage: "sql"`) that keeps the template's token order and variable positions and includes the caller's filter and the source table filter, so passing it to `clickstack_search` returns the pattern's events. Before, a template like `Sending <*> rows` produced `Body:"Sending rows"`, which matched nothing, and map fields produced Lucene that failed to parse. `bodyExpression` now also accepts `JSONExtractString(<column>, '<key>', ...)` to mine a field inside JSON bodies, and the tool reports sample coverage and the actual trend bucket interval and boundaries.
9+
10+
`clickstack_event_patterns`, `clickstack_emerging_signals` and dashboard event-pattern tiles now apply the log source's `tableFilterExpression`, so their counts can drop for sources that set one. `minePatterns` now reports each cluster's own template; before, it could report the template of a different same-length cluster that some members did not fit.
Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
---
2+
'@hyperdx/api': patch
3+
---
4+
5+
feat(mcp): `clickstack_table` takes optional `limit` and `having`, and orders grouped results by the first select item, descending, when no `orderBy` is given
Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
---
2+
'@hyperdx/app': patch
3+
---
4+
5+
fix: only use the key-only row details lookup when the table persists both `_block_number` and `_block_offset`. A lone block column (e.g. a server-wide `enable_block_offset_column`) is not unique with a second-precision primary key and could open the wrong row; it is now only added as a tiebreaker to the full-row lookup.
Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,21 @@
1+
---
2+
'@hyperdx/otel-collector': patch
3+
---
4+
5+
feat: session ID columns, `session.id` from `rum.sessionId`, severity text
6+
7+
The `hyperdx_sessions` seed adds materialized `rum.sessionId` and `session.id`
8+
columns with skip indexes, and the `otel_logs` seed adds a materialized
9+
`session.id` column with a skip index, so session queries no longer read the
10+
attribute maps. Only newly created tables get them; existing tables need an
11+
`ALTER TABLE ... ADD COLUMN` to benefit.
12+
13+
Spans, logs and session replay events from older `@hyperdx/browser` SDKs, which
14+
carry the session id only in the `rum.sessionId` resource attribute, now also
15+
get the OpenTelemetry `session.id` attribute. An existing `session.id` is never
16+
overwritten and `rum.sessionId` is kept. If you override pipeline `processors:`
17+
lists in `CUSTOM_OTELCOL_CONFIG_FILE`, add `transform/session_id` to keep this.
18+
19+
Logs that carry a severity number but no severity text, such as those from the
20+
new browser SDK, now get the matching level text (`info`, `error`, ...) instead
21+
of an empty level. Severity text set by the producer is never overwritten.

‎MCP.md‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -122,6 +122,7 @@ with:
122122
| ----------------------------- | -------------------------------------------------------------------------------------------- |
123123
| `clickstack_list_sources` | List all data sources and connections as a lightweight catalog (IDs, names, kinds) |
124124
| `clickstack_describe_source` | Full column schema, attribute keys, sampled low-cardinality values, and a round-trippable `config` block (the exact shape `clickstack_save_source` accepts, incl. correlation IDs) for a single source; for metric sources also returns a per-kind metric-name sample |
125+
| `clickstack_describe_table` | Inspect a ClickHouse table that is not a registered source: columns, keys, engine, skipping indices, approximate size, and an optional row sample. Without a table, lists the tables in a database (paginated) |
125126
| `clickstack_save_source` | Create (omit id) or update (provide id) a data source (log, trace, session, metric, or promql) so shipped telemetry becomes queryable. To clone a source, read its `config` from `clickstack_describe_source`, drop `id`, and pass it here |
126127
| `clickstack_delete_source` | Permanently delete a data source by ID |
127128
| `clickstack_list_metrics` | Paginated catalog of metric names on a metric source with optional kind / namePattern / time-window filters |

‎docker/otel-collector/config.yaml‎

Lines changed: 44 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -117,11 +117,50 @@ processors:
117117
- set(log.severity_text, "info") where log.severity_number == 0
118118
- set(log.severity_number, SEVERITY_NUMBER_INFO) where
119119
log.severity_number == 0
120+
- context: log
121+
error_mode: ignore
122+
conditions:
123+
- severity_text == "" and severity_number > 0
124+
statements:
125+
- set(log.severity_text, "trace") where log.severity_number < 5
126+
- set(log.severity_text, "debug") where log.severity_number >= 5 and
127+
log.severity_number < 9
128+
- set(log.severity_text, "info") where log.severity_number >= 9 and
129+
log.severity_number < 13
130+
- set(log.severity_text, "warn") where log.severity_number >= 13 and
131+
log.severity_number < 17
132+
- set(log.severity_text, "error") where log.severity_number >= 17 and
133+
log.severity_number < 21
134+
- set(log.severity_text, "fatal") where log.severity_number >= 21
120135
- context: log
121136
error_mode: ignore
122137
statements:
123138
# Normalize the severity_text case
124139
- set(log.severity_text, ConvertCase(log.severity_text, "lower"))
140+
# Older @hyperdx/browser SDKs put the session id only in the
141+
# `rum.sessionId` resource attribute. Copy it to the OTel `session.id`
142+
# attribute so newer and older SDK data can be queried by one key. An
143+
# existing `session.id` (e.g. from a JSON body merged by `transform`) is
144+
# never overwritten, and `rum.sessionId` is kept.
145+
transform/session_id:
146+
trace_statements:
147+
- context: span
148+
error_mode: ignore
149+
statements:
150+
- set(span.attributes["session.id"],
151+
resource.attributes["rum.sessionId"]) where
152+
span.attributes["session.id"] == nil and
153+
IsString(resource.attributes["rum.sessionId"]) and
154+
Len(resource.attributes["rum.sessionId"]) > 0
155+
log_statements:
156+
- context: log
157+
error_mode: ignore
158+
statements:
159+
- set(log.attributes["session.id"],
160+
resource.attributes["rum.sessionId"]) where
161+
log.attributes["session.id"] == nil and
162+
IsString(resource.attributes["rum.sessionId"]) and
163+
Len(resource.attributes["rum.sessionId"]) > 0
125164
resourcedetection:
126165
detectors:
127166
- env
@@ -183,10 +222,12 @@ service:
183222
# merge wins. See https://github.com/hyperdxio/hyperdx/pull/2351.
184223
pipelines:
185224
traces:
186-
processors: [memory_limiter, batch]
225+
processors: [memory_limiter, transform/session_id, batch]
187226
metrics:
188227
processors: [memory_limiter, batch]
228+
# transform/session_id runs after transform so a `session.id` parsed from
229+
# a JSON body wins. Replay rows skip transform but still need the copy.
189230
logs/out-default:
190-
processors: [memory_limiter, transform, batch]
231+
processors: [memory_limiter, transform, transform/session_id, batch]
191232
logs/out-rrweb:
192-
processors: [memory_limiter, batch]
233+
processors: [memory_limiter, transform/session_id, batch]

‎docker/otel-collector/custom.config.yaml‎

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -24,13 +24,13 @@ receivers:
2424
# service:
2525
# pipelines:
2626
# traces:
27-
# processors: [memory_limiter/custom, batch]
27+
# processors: [memory_limiter/custom, transform/session_id, batch]
2828
# metrics:
2929
# processors: [memory_limiter/custom, batch]
3030
# logs/out-default:
31-
# processors: [memory_limiter/custom, transform, batch]
31+
# processors: [memory_limiter/custom, transform, transform/session_id, batch]
3232
# logs/out-rrweb:
33-
# processors: [memory_limiter/custom, batch]
33+
# processors: [memory_limiter/custom, transform/session_id, batch]
3434
#
3535
# Example: tune `batch` for lower-latency exports.
3636
# (See packages/otel-collector/README.md for env-var alternatives.)
@@ -44,15 +44,15 @@ receivers:
4444
# service:
4545
# pipelines:
4646
# traces:
47-
# processors: [memory_limiter, batch/lowlatency]
47+
# processors: [memory_limiter, transform/session_id, batch/lowlatency]
4848
# logs/out-default:
49-
# processors: [memory_limiter, transform, batch/lowlatency]
49+
# processors: [memory_limiter, transform, transform/session_id, batch/lowlatency]
5050
exporters:
5151
# fork data to otel-collector-json service (DEV ONLY)
5252
otlphttp/json:
5353
endpoint: http://otel-collector-json:4318
5454
headers:
55-
authorization: "super-secure-ingestion-api-key"
55+
authorization: 'super-secure-ingestion-api-key'
5656
compression: gzip
5757
service:
5858
pipelines:

0 commit comments

Comments
 (0)