AIcrowd Submission Received #255465 - track4-0508

submission_hash : 94c09a0cdc78e0dfcbb0fc9b4b79d045453afce3.
If this issue is not updated within a reasonable amount of time, please send email to help@aicrowd.com.

added waiting_in_queue label

changed title from AIcrowd Submission Received - track4-0508 to AIcrowd Submission Received #255465 - track4-0508

Evaluation Succeeded!

View the scores for the submission here.

graph LR;
classDef success fill:#5CB85C,stroke:#fff,color:#fff;
classDef progress fill:#428BCA,stroke:#fff,color:#fff;
classDef pending fill:#F0AD4E,stroke:#fff,color:#fff;
classDef failed fill:#db3b21,stroke:#fff,color:#fff;
build-packages-and-env(Build Packages And<br/>Env)
track4-validation(Track4 Validation)
track4-phase-1(Track4 Phase 1)
evaluate-scores(Evaluate Scores)
build-packages-and-env --> track4-validation
track4-validation --> track4-phase-1
track4-validation --> evaluate-scores
track4-phase-1 --> evaluate-scores
class build-packages-and-env,track4-validation,track4-phase-1,evaluate-scores success

Multi-lingual Abilities

Progress Overview

• Prediction Progress: 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 [1029/1029] | 100.00%

---

Scores Summary

Task Type	Score
Generation Score	0.419993
Multiple-Choice Score	0.849742
️ Ranking Score	0.818069

Overall Score: 0.7012

---

Performance Metrics

• Num Samples Predicted: 1029
• Total Prediction Time: 1607.39 seconds
• Mean Sample Prediction Time: 1.5621 seconds

Logs

[debug-logs]

Important Links

• Challenge Page: https://www.aicrowd.com/challenges/amazon-kdd-cup-24-multi-lingual-abilities
• Discussion Forum: https://discourse.aicrowd.com/c/amazon-kdd-cup-24-multi-lingual-abilities
• Leaderboard: https://www.aicrowd.com/challenges/amazon-kdd-cup-24-multi-lingual-abilities/leaderboards

added evaluation_initiated label and removed waiting_in_queue label

added failed label and removed evaluation_initiated label

added evaluation_initiated label and removed failed label

added evaluation_successful label and removed evaluation_initiated label