Skip to content
Snippets Groups Projects
Select Git revision
  • master default
  • submission-test-0
  • submission-test-1
  • submission-test-2
  • submission-test-3
  • submission-test-4
  • submission-test-5
7 results
Blame Permalink
hardware-and-system-config.md 1.41 KiB

Hardware and System Configuration

We apply a limit on the hardware available to each participant to run their solutions.

Please note that NVIDIA T4 uses a somewhat outdated architecture and is thus not compatible with certain acceleration toolkits (e.g. Flash Attention), so please be careful about compatibility.

Besides, the following restrictions will also be imposed:

  • Network connection will be disabled.

  • Each submission will be assigned a certain amount of time to run. Submissions that exceed the time limits will be killed and will not be evaluated. The tentative time limit is set as follows [TO BE ADDED AND TESTED WITH AICROWD SUBMISSION SYSTEM].

  • Each team will be able to make up to 1 submission per day, with a maximum of [TO BE ADDED AND TESTED WITH AICROWD SUBMISSION SYSTEM].

Based on the hardware and system configuration, we recommend participants to begin with 7B and 13B models. According to our experiments, models like Llama-2 13B can perform inference smoothly on 4 NVIDIA T4 GPUs, while 13B models will result in OOM.