AIcrowd Submission Received #265373 - t1.1.6

submission_hash : 3411dd12739826c191c5b97c2a607f935011b637.
If this issue is not updated within a reasonable amount of time, please send email to help@aicrowd.com.

added waiting_in_queue label

changed title from AIcrowd Submission Received - t1.1.6 to AIcrowd Submission Received #265373 - t1.1.6

Evaluation failed

graph LR;
classDef success fill:#5CB85C,stroke:#fff,color:#fff;
classDef progress fill:#428BCA,stroke:#fff,color:#fff;
classDef pending fill:#F0AD4E,stroke:#fff,color:#fff;
classDef failed fill:#db3b21,stroke:#fff,color:#fff;
build-packages-and-env(Build Packages And<br/>Env)
validation(Validation)
private-test(Private Test)
evaluate-scores(Evaluate Scores)
build-packages-and-env --> validation
validation --- private-test
validation --- evaluate-scores
private-test --- evaluate-scores
class build-packages-and-env,validation success
class private-test failed

System Logs

Private Test: Evaluation timed out

CRAG Task 1: Retrieval and Summarization

Prediction Progress Overview

• Prediction Progress: 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 [10/10] | 100.00%

---

Performance Metrics

• Num Samples Predicted: 16
• Total Prediction Time: 44.43 seconds
• Mean Sample Prediction Time: 2.7767 seconds

Logs

[debug-logs]

Important Links

• Challenge Page: https://www.aicrowd.com/challenges/meta-kdd-cup-24-crag-retrieval-summarization
• Discussion Forum: https://discourse.aicrowd.com/c/meta-kdd-cup-24-crag-retrieval-summarization
• Leaderboard: https://www.aicrowd.com/challenges/meta-kdd-cup-24-crag-retrieval-summarization/leaderboards

Admin Logs: logs

added evaluation_initiated label and removed waiting_in_queue label

added failed label and removed evaluation_initiated label