No predictions issue

[prasadautomationtesting]

I tried to test it out in my local by changing (Refer the answer variable) the value and got empty list.

from lettucedetect.models.inference import HallucinationDetector

detector = HallucinationDetector(
method="transformer", model_path="KRLabsOrg/lettucedect-base-modernbert-en-v1"
)

contexts = ["France is a country in Europe. The capital of France is Paris. The population of France is 67 million.",]
question = "What is the capital of France? What is the population of France?"
answer = "The capital of France is Paris. The population of France is 999 million."

predictions = detector.predict(context=contexts, question=question, answer=answer, output_format="spans")
print("Predictions:", predictions)

output:
Predictions: []

[wgetdddeb]

@prasadautomationtesting

My context was very big and this is how I made it work

from lettucedetect.models.inference import HallucinationDetector
import time 
# For a transformer-based approach:
detector = HallucinationDetector(
    method="transformer", model_path="KRLabsOrg/lettucedect-base-modernbert-en-v1"
)
def detect_hallusinations(context, question, answer):
    s = time.time()
    predictions = detector.predict(context=context, question=question, answer=answer, output_format="tokens")

    count_0, count_1 = 0, 0  

    for pred in predictions:
        if pred["pred"] == 0:
            count_0 += 1
        else:
            count_1 += 1
    print("Predictions:", count_0, count_1)
    if count_1 > count_0:
        print("hallucinated")
    print(time.time() - s)

I also noticed tokens output format takes less time and gives better accuracy (not sure about this)