I’ve been wondering how big is chatGPT, but I have a hard time getting a straight answer. I think the reason is that chatGPT is described as having hundreds of billions of parameters, but there’s some subtlety in how those parameters are stored on disk, for training, and for inference.
https://www.reddit.com/r/ChatGPT/comments/10gqy23/how_big_is_chatgpt/