AIcrowd Submission Received #265525 - r2.t1.7

changed title from AIcrowd Submission Received - r2.t1.7 to AIcrowd Submission Received #265525 - r2.t1.7

Evaluation failed

graph LR;
classDef success fill:#5CB85C,stroke:#fff,color:#fff;
classDef progress fill:#428BCA,stroke:#fff,color:#fff;
classDef pending fill:#F0AD4E,stroke:#fff,color:#fff;
classDef failed fill:#db3b21,stroke:#fff,color:#fff;
build-packages-and-env(Build Packages And<br/>Env)
validation(Validation)
private-test(Private Test)
evaluate-scores(Evaluate Scores)
build-packages-and-env --> validation
validation --- private-test
validation --- evaluate-scores
private-test --- evaluate-scores
class build-packages-and-env,validation success
class private-test failed

System Logs

Private Test: Evaluation timed out

`CRAG Task 1: Retrieval and Summarization`

Prediction Progress Overview

Prediction Progress: 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 [10/10] | 100.00%

Performance Metrics

Num Samples Predicted: 16
Total Prediction Time: 45.49 seconds
Mean Sample Prediction Time: 2.8430 seconds

Logs

[debug-logs]

Important Links

Challenge Page: https://www.aicrowd.com/challenges/meta-kdd-cup-24-crag-retrieval-summarization
Discussion Forum: https://discourse.aicrowd.com/c/meta-kdd-cup-24-crag-retrieval-summarization
Leaderboard: https://www.aicrowd.com/challenges/meta-kdd-cup-24-crag-retrieval-summarization/leaderboards

Admin Logs: logs

added evaluation_initiated label and removed waiting_in_queue label

added failed label and removed evaluation_initiated label

added evaluation_initiated label and removed failed label