Skip to content

Metrics not exporting #198

Description

@ChrisZieba

I can see the metrics being scraped, but I'm not seeing the metrics in prometheus e.g

 TYPE http_client_requests_seconds_max gauge
http_client_requests_seconds_max{client_name="api.spotinst.io",error="none",exception="none",method="POST",outcome="SUCCESS",status="200",uri="/ocean/k8s/cluster/exporter/metricData?accountId=act-XXX&clusterIdentifier=o-cXXX&version=spotinst-kubernetes-exporter/1.0.5"} 0.065184529

Is there anything to debug this? Here are the deployment settings I'm using. I used the default helm chart with the spot token/account/ocean config.

apiVersion: apps/v1
kind: Deployment
metadata:
  name: spot-ocean-metric-exporter
  namespace: kube-system
  labels:
    app.kubernetes.io/name: ocean-metric-exporter
    app.kubernetes.io/instance: spot-ocean-metric-exporter
    app.kubernetes.io/version: "1.0.5"
spec:
  replicas: 1
  selector:
    matchLabels:
      app.kubernetes.io/name: ocean-metric-exporter
      app.kubernetes.io/instance: spot-ocean-metric-exporter
  template:
    metadata:
      labels:
        app.kubernetes.io/name: ocean-metric-exporter
        app.kubernetes.io/instance: spot-ocean-metric-exporter
    spec:
      containers:
      - name: spot-ocean-metric-exporter
        ports:
        - containerPort: 5050
          name: exporter
        env:
        - name: SPOTINST_TOKEN
          valueFrom:
            secretKeyRef:
              name: ocean-metric-exporter
              key: token
        - name: SPOTINST_TOKEN_LEGACY
          valueFrom:
            configMapKeyRef:
              name: ocean-metric-exporter
              key: spotinst.token
              optional: true
        - name: SPOTINST_ACCOUNT
          valueFrom:
            secretKeyRef:
              name: ocean-metric-exporter
              key: account
        - name: SPOTINST_ACCOUNT_LEGACY
          valueFrom:
            configMapKeyRef:
              name: ocean-metric-exporter
              key: spotinst.account
              optional: true
        - name: CLUSTER_IDENTIFIER
          valueFrom:
            configMapKeyRef:
              name: ocean-metric-exporter
              key: spotinst.cluster-identifier
        - name: BASE_SPOTINST_URL
          valueFrom:
            configMapKeyRef:
              name: ocean-metric-exporter
              key: base-url
              optional: true
        - name: PROXY_URL
          valueFrom:
            configMapKeyRef:
              name: ocean-metric-exporter
              key: proxy-url
              optional: true
        - name: USER_ENV_CERTIFICATES
          valueFrom:
            secretKeyRef:
              name: spotinst-kubernetes-cluster-controller-ca-bundle
              key: userEnvCertificates.pem
              optional: true
        image: gcr.io/spotinst-artifacts/spot-ocean-metric-exporter:1.0.5
        imagePullPolicy: IfNotPresent
        command: [ "java", "-Dspring.profiles.active=prod,default", "-jar", "/app/app.jar" ]
        args:
        - --categories=scaling
        - --allow-metrics=
        - --deny-metrics=
        - --allow-labels=
        - --deny-labels=
        resources:
            limits:
              memory: 500Mi
            requests:
              cpu: 100m
              memory: 250Mi
        livenessProbe:
          httpGet:
            path: /health/liveness
            port: exporter
          initialDelaySeconds: 15
          periodSeconds: 10
          failureThreshold: 3
          timeoutSeconds: 1
        readinessProbe:
          httpGet:
            path: /health/readiness
            port: exporter
          initialDelaySeconds: 15
          periodSeconds: 10
          failureThreshold: 3
          successThreshold: 1
          timeoutSeconds: 1
      tolerations:
        - key: node-role.kubernetes.io/master
          operator: Exists
        - key: node-role.kubernetes.io/control-plane
          operator: Exists

The pod startup logs:

2026-01-27T18:52:01.993Z  INFO 1 --- [           main] c.s.k.e.KubernetesExporterApplication    : Starting KubernetesExporterApplication v1.0.5 using Java 17.0.16 with PID 1 (/app/app.jar started by root in /app)
2026-01-27T18:52:02.006Z  INFO 1 --- [           main] c.s.k.e.KubernetesExporterApplication    : The following 2 profiles are active: "prod", "default"
2026-01-27T18:52:03.551Z  INFO 1 --- [           main] o.s.b.w.e.t.TomcatWebServer              : Tomcat initialized with port 5050 (http)
2026-01-27T18:52:03.575Z  INFO 1 --- [           main] o.a.c.c.StandardService                  : Starting service [Tomcat]
2026-01-27T18:52:03.576Z  INFO 1 --- [           main] o.a.c.c.StandardEngine                   : Starting Servlet engine: [Apache Tomcat/10.1.44]
2026-01-27T18:52:03.629Z  INFO 1 --- [           main] o.a.c.c.C.[.[.[/]                        : Initializing Spring embedded WebApplicationContext
2026-01-27T18:52:03.633Z  INFO 1 --- [           main] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 1563 ms
2026-01-27T18:52:04.774Z  INFO 1 --- [           main] o.s.b.a.e.w.EndpointLinksResolver        : Exposing 3 endpoints beneath base path ''
2026-01-27T18:52:04.869Z  INFO 1 --- [           main] o.s.b.w.e.t.TomcatWebServer              : Tomcat started on port 5050 (http) with context path '/'
2026-01-27T18:52:04.903Z  INFO 1 --- [           main] c.s.k.e.KubernetesExporterApplication    : Started KubernetesExporterApplication in 3.629 seconds (process running for 4.629)
2026-01-27T18:52:16.974Z  INFO 1 --- [nio-5050-exec-1] o.a.c.c.C.[.[.[/]                        : Initializing Spring DispatcherServlet 'dispatcherServlet'
2026-01-27T18:52:16.975Z  INFO 1 --- [nio-5050-exec-1] o.s.w.s.DispatcherServlet                : Initializing Servlet 'dispatcherServlet'
2026-01-27T18:52:16.977Z  INFO 1 --- [nio-5050-exec-1] o.s.w.s.DispatcherServlet                : Completed initialization in 1 ms

Metadata

Metadata

Assignees

No one assigned

    Labels

    kind/bugCategorizes an issue or PR as related to a bug.

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions