AIcrowd Submission Received #270077 - track2-7244-217

submission_hash : f96e4d5fc8b7aaa137c7e09a5426c1690fde96fa.
If this issue is not updated within a reasonable amount of time, please send email to help@aicrowd.com.

added waiting_in_queue label

changed title from AIcrowd Submission Received - track2-7244-217 to AIcrowd Submission Received #270077 - track2-7244-217

Evaluation Succeeded!

View the scores for the submission here.

graph LR;
classDef success fill:#5CB85C,stroke:#fff,color:#fff;
classDef progress fill:#428BCA,stroke:#fff,color:#fff;
classDef pending fill:#F0AD4E,stroke:#fff,color:#fff;
classDef failed fill:#db3b21,stroke:#fff,color:#fff;
build-packages-and-env(Build Packages And<br/>Env)
track2-validation(Track2 Validation)
track2-phase-2-private(Track2 Phase 2<br/>Private)
evaluate-scores(Evaluate Scores)
build-packages-and-env --> track2-validation
track2-validation --> track2-phase-2-private
track2-validation --> evaluate-scores
track2-phase-2-private --> evaluate-scores
class build-packages-and-env,track2-validation,track2-phase-2-private,evaluate-scores success

Shopping Knowledge Reasoning

Progress Overview

• Prediction Progress: 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟥 [1888/1896] | 99.58%

---

Scores Summary

Task Type	Score
Multiple-Choice Score	0.792181
Retrieval Score	0.620301

Overall Score: 0.7707

---

Performance Metrics

• Num Samples Predicted: 1888
• Total Prediction Time: 764.11 seconds
• Mean Sample Prediction Time: 0.4047 seconds

Logs

[debug-logs]

Important Links

• Challenge Page: https://www.aicrowd.com/challenges/amazon-kdd-cup-24-shopping-knowledge-reasoning
• Discussion Forum: https://discourse.aicrowd.com/c/amazon-kdd-cup-24-shopping-knowledge-reasoning
• Leaderboard: https://www.aicrowd.com/challenges/amazon-kdd-cup-24-shopping-knowledge-reasoning/leaderboards

added evaluation_initiated label and removed waiting_in_queue label

added failed label and removed evaluation_initiated label

added evaluation_initiated label and removed failed label

added evaluation_successful label and removed evaluation_initiated label