Welcome to the staging ground for new communities! Each proposal has a description in the "Descriptions" category and a body of questions and answers in "Incubator Q&A". You can ask questions (and get answers, we hope!) right away, and start new proposals.
Are you here to participate in a specific proposal? Click on the proposal tag (with the dark outline) to see only posts about that proposal and not all of the others that are in progress. Tags are at the bottom of each post.
What computational resources are needed to train GPT-NeoX? Question
GPT-NeoX is provided as open source software which you can train yourself: https://github.com/EleutherAI/gpt-neox
What are the hardware requirements like for training this model within a reasonable timeframe? Ideally, a few hours, but up to a month is reasonable, I think.
1 comment thread