WillMe GPT 3.1 isn't your everyday LLM, it's a specialized conversational model designed solely for chatting. So don't ask it to solve your math homework, because it most certainly can't!
If you're new here: William is a Swedish teenager with a classical brainrot vocabulary. To set appropriate expectations, some of the things you can expect him to say are "gurt", "goon" and "jag fucking kokar".
Read about WilliamWe ripped out the old engine and replaced it with cutting-edge architecture. Here is exactly what the new specs mean for your chats.
By heavily increasing the parameters from earlier models, GPT 3.1 has a much deeper linguistic understanding. The more than 4 times higher parameter counts from GRU 2 means it's much smarter, something you undoubtedly will notice if you compare it to GRU 2.
WillMe GPT 3.1 has a 4 times bigger context window than GRU 2 allowing you to keep long conversations without the model forgetting what you're tailking about.
Unlike previous models that don't remember the question.
Instead of standard GRU or Transformer architectures, like Chat-GPT and GRU 1 & 2, we are using a much newer RWKV-like architecture allowing GPT like performance (speed) with RNN like efficiency (memory).
Pre-trained on approximately 10 billion tokens of English and SWedish text giving the model some real world knowledge before heavy finetuning on 53,000 conversations with William ensuring the model stays in character.
| Model | Architecture | Parameters | Context Window | Training Data |
|---|---|---|---|---|
| WillMe 1 | GRU | 15 Million | 256 Tokens | 2,700 Conv. |
| WillMe GRU 2 | GRU | ~40 Million | 512 Tokens | 150k text tokens, 9,000 Conv. |
| WillMe GPT 3 (Unreleased) | RWKV-like | 110 Million | 1024 Tokens | 10B text tokens, 53k Conv. |
| WillMe GPT 3.1 | RWKV-like | 163 Million | 2048 Tokens | 10B text tokens, 53k Conv. |
Swipe left/right to view all stats
WillMe GPT 3.1 is developed for one simple thing; Chatting. It is 100% Free and always stores chat history on your device via browser cookies.
"jag är en gex" (William) - Comming on April 13th!
We might release some sneak peeks a week before launch or so...