Using more than 2 GPUs with polybeast (#17) · Issues · nethack / neurips-2021-the-nethack-challenge

Using more than 2 GPUs with polybeast

Hi, First of all, thanks a lot for the instructions and great competition. We wanted to use polybeast on a single machine with more than 2 GPUs with the goal of getting as much throughput as possible. We were wondering what the best way to achieve this (e.g. more learner GPUs etc.) and what do we have to add/change.