diff --git a/README.md b/README.md index b7673b17c26b6d12de6c58932f6b9a967cfc898d..10318e28162c22963e59a3d7ceeb78891b522cd5 100644 --- a/README.md +++ b/README.md @@ -59,7 +59,17 @@ For both the leaderboards, the winning teams will be required to publish their t # Evaluation +As an evaluation metric, we are using the signal-to-distortion ratio (SDR), which is defined as, + + +where Sð‘–ð‘›ð‘ ð‘¡ð‘Ÿ(n) is the waveform of the ground truth and Åœð‘–ð‘›ð‘ ð‘¡ð‘Ÿ(ð‘›) denotes the waveform of the estimate. The higher the SDR score, the better the output of the system is. + +In order to rank systems, we will use the average SDR computed by + + + +for each song. Finally, the overall score is obtained by averaging SDRsong over all songs in the hidden test set. # Baselines @@ -104,8 +114,8 @@ GitLab. ## FAQs -* How do I submit a model? - * More information on submissions can be found at our [submission.md](/docs/submission.md). In short, you should push you code to the AIcrowd's gitlab with a specific git tag and the evaluation will be triggered automatically. +### How do I submit a model? +In short, you should push you code to the AIcrowd's gitlab with a specific git tag and the evaluation will be triggered automatically. More information on submissions can be found at our [submission.md](/docs/submission.md). ### How do I specify my dependencies?