AIcrowd Submission Received #179186 - Settled-C

changed title from AIcrowd Submission Received - Settled-C to AIcrowd Submission Received #179186 - Settled-C

Evaluation Succeeded!

View the scores for the submission here.

Warning: Displaying this diagram might cause performance issues on this page.

graph LR;
classDef success fill:#5CB85C,stroke:#fff,color:#fff;
classDef progress fill:#428BCA,stroke:#fff,color:#fff;
classDef pending fill:#F0AD4E,stroke:#fff,color:#fff;
classDef failed fill:#db3b21,stroke:#fff,color:#fff;
runtime-setup(Runtime Setup)
validate-submission(Validate Submission)
pre-training-phase(Pre Training Phase)
purchase-phase-run-1(Purchase Phase Run 1)
purchase-phase-run-2(Purchase Phase Run 2)
purchase-phase-run-3(Purchase Phase Run 3)
purchase-phase-run-4(Purchase Phase Run 4)
purchase-phase-run-5(Purchase Phase Run 5)
post-purchase-training-phase-run-1(Post Purchase<br/>Training Phase Run 1)
post-purchase-training-phase-run-2(Post Purchase<br/>Training Phase Run 2)
post-purchase-training-phase-run-3(Post Purchase<br/>Training Phase Run 3)
post-purchase-training-phase-run-4(Post Purchase<br/>Training Phase Run 4)
post-purchase-training-phase-run-5(Post Purchase<br/>Training Phase Run 5)
aggregate-scores(Aggregate Scores)
runtime-setup --> validate-submission
validate-submission --> pre-training-phase
pre-training-phase --> purchase-phase-run-1
pre-training-phase --> purchase-phase-run-2
pre-training-phase --> purchase-phase-run-3
pre-training-phase --> purchase-phase-run-4
pre-training-phase --> purchase-phase-run-5
purchase-phase-run-1 --> post-purchase-training-phase-run-1
purchase-phase-run-2 --> post-purchase-training-phase-run-2
purchase-phase-run-3 --> post-purchase-training-phase-run-3
purchase-phase-run-4 --> post-purchase-training-phase-run-4
purchase-phase-run-5 --> post-purchase-training-phase-run-5
post-purchase-training-phase-run-1 --> aggregate-scores
post-purchase-training-phase-run-2 --> aggregate-scores
post-purchase-training-phase-run-3 --> aggregate-scores
post-purchase-training-phase-run-4 --> aggregate-scores
post-purchase-training-phase-run-5 --> aggregate-scores
class runtime-setup,validate-submission,pre-training-phase,purchase-phase-run-1,purchase-phase-run-2,purchase-phase-run-3,purchase-phase-run-4,purchase-phase-run-5,post-purchase-training-phase-run-1,post-purchase-training-phase-run-2,post-purchase-training-phase-run-3,post-purchase-training-phase-run-4,post-purchase-training-phase-run-5,aggregate-scores success

Training phase

	Status	Progress	# Images	Time Elapsed
	`COMPLETE`	`100%`	`1000`	`1s`

Purchase Phase

Run	Status	Progress	Budget	Budget Consumed	Time Elapsed	Time Limit
`#1`	`COMPLETE`	`100%`	`621`	`621`	`529s`	`1020s`
`#2`	`COMPLETE`	`100%`	`621`	`621`	`2453s`	`3060s`
`#3`	`COMPLETE`	`100%`	`1889`	`1889`	`551s`	`1020s`
`#4`	`COMPLETE`	`100%`	`1889`	`1889`	`2670s`	`3060s`
`#5`	`COMPLETE`	`100%`	`1321`	`1321`	`1738s`	`2040s`

Note: Time Limit is for the time elapsed in pre-training and purchase phases.

Post Purchase Training Phase

Run	Status	Training Progress	Epochs	Train F1 Score	Train Loss	Val F1 Score	Val Loss	Prediction Progress	Time Elapsed
`#1`	`COMPLETE`	`100.0%`	`10`	`0.4749`	`0.418`	`0.4358`	`0.3863`	`100.0%`	`277s`
`#2`	`COMPLETE`	`100.0%`	`10`	`0.483`	`0.4236`	`0.356`	`0.3937`	`100.0%`	`236s`
`#3`	`COMPLETE`	`100.0%`	`10`	`0.4118`	`0.3978`	`0.3031`	`0.4118`	`100.0%`	`373s`
`#4`	`COMPLETE`	`100.0%`	`10`	`0.4362`	`0.4179`	`0.3731`	`0.4254`	`100.0%`	`350s`
`#5`	`COMPLETE`	`100.0%`	`10`	`0.4565`	`0.4229`	`0.4436`	`0.4138`	`100.0%`	`314s`

Scores (Test Set)

	F1 Score	Accuracy Score	Hamming Loss
Overall	`0.2326`	`0.553`	`0.1183`
`#1`	`0.1405`	`0.5313`	`0.1251`
`#2`	`0.2134`	`0.514`	`0.1269`
`#3`	`0.2705`	`0.5883`	`0.1119`
`#4`	`0.2544`	`0.5633`	`0.1136`
`#5`	`0.2843`	`0.568`	`0.1139`