AIcrowd Submission Received #269938 - t4-32awq

submission_hash : fd4142d93144d4ee7d4394e3dd0f1ca5112057f2.
If this issue is not updated within a reasonable amount of time, please send email to help@aicrowd.com.

added waiting_in_queue label

changed title from AIcrowd Submission Received - t4-32awq to AIcrowd Submission Received #269938 - t4-32awq

Evaluation Succeeded!

View the scores for the submission here.

graph LR;
classDef success fill:#5CB85C,stroke:#fff,color:#fff;
classDef progress fill:#428BCA,stroke:#fff,color:#fff;
classDef pending fill:#F0AD4E,stroke:#fff,color:#fff;
classDef failed fill:#db3b21,stroke:#fff,color:#fff;
build-packages-and-env(Build Packages And<br/>Env)
track2-validation(Track2 Validation)
track2-phase-2-private(Track2 Phase 2<br/>Private)
evaluate-scores(Evaluate Scores)
build-packages-and-env --> track2-validation
track2-validation --> track2-phase-2-private
track2-validation --> evaluate-scores
track2-phase-2-private --> evaluate-scores
class build-packages-and-env,track2-validation,track2-phase-2-private,evaluate-scores success

Shopping Knowledge Reasoning

Progress Overview

• Prediction Progress: 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟥 [1888/1896] | 99.58%

---

Scores Summary

Task Type	Score
Multiple-Choice Score	0.727011
Retrieval Score	0.511278

Overall Score: 0.7000

---

Performance Metrics

• Num Samples Predicted: 1888
• Total Prediction Time: 469.63 seconds
• Mean Sample Prediction Time: 0.2487 seconds

Logs

[debug-logs]

Important Links

• Challenge Page: https://www.aicrowd.com/challenges/amazon-kdd-cup-24-shopping-knowledge-reasoning
• Discussion Forum: https://discourse.aicrowd.com/c/amazon-kdd-cup-24-shopping-knowledge-reasoning
• Leaderboard: https://www.aicrowd.com/challenges/amazon-kdd-cup-24-shopping-knowledge-reasoning/leaderboards

added evaluation_initiated label and removed waiting_in_queue label

added failed label and removed evaluation_initiated label

added evaluation_initiated label and removed failed label

added evaluation_successful label and removed evaluation_initiated label