Welcome to the staging ground for new communities! Each proposal has a description in the "Descriptions" category and a body of questions and answers in "Incubator Q&A". You can ask questions (and get answers, we hope!) right away, and start new proposals.
What computational resources are needed to train GPT-NeoX? Question
+3
−0
GPT-NeoX is provided as open source software which you can train yourself: https://github.com/EleutherAI/gpt-neox
What are the hardware requirements like for training this model within a reasonable timeframe? Ideally, a few hours, but up to a month is reasonable, I think.
1 comment thread