Nous has initiated a decentralized pre-training of a 15B parameter language model using Nous DisTrO and hardware from …
source
Nous has initiated a decentralized pre-training of a 15B parameter language model using Nous DisTrO and hardware from …
source