Not startups per say, but rumor has it that OpenAI and xAI are both working on training ASICs! There's also Amazon's Tranium and of course the TPU, which are both decent at training. Google did some incredible work on the networking capabilities of the recent generations of TPUs, probably for this very reason.
interesting observation, didn't think about this trend at all. any top of mind second-gen chip startups working on training?
Not startups per say, but rumor has it that OpenAI and xAI are both working on training ASICs! There's also Amazon's Tranium and of course the TPU, which are both decent at training. Google did some incredible work on the networking capabilities of the recent generations of TPUs, probably for this very reason.