README
๐
basically AI
company
Verified
AI & ML interests
None defined yet.
Recent Activity
Hoglet-33ย
updated a
Space about 7 hours ago
Hoglet-33ย
updated a
collection 1 day ago
Hoglet-33ย
updated a
collection 2 days ago
Hoglet-33ย
published a
model 2 days ago
Hoglet-33ย
updated a
collection 2 days ago
Hoglet-33ย
published a
model 2 days ago
Post
3389
Pebble-25M and Pebble-25M-Chat are out now!
Weโre excited to release Pebble-25M and Pebble-25M-Chat!
Both models use our 3:1 Mamba2/Transformer hybrid architecture and were pretrained on 25B tokens. Pebble-25M-Chat was then further fine-tuned on an additional 250M tokens from smol-smoltalk, following the same approach used for the Pebble-10M models.
We hope you enjoy experimenting with them!
Pebble-50M is coming in a few days.
Models
Pebble-25M: basically-ai/Pebble-25M
Pebble-25M-Chat: basically-ai/Pebble-25M-Chat
Pebble-10M GGUFs
In case you missed it, our friend @ContextReq made GGUF versions of the Pebble-10M models:
ContextReq/Pebble-10M-GGUF
ContextReq/Pebble-10M-Chat-GGUF
Follow us if you donโt want to miss future releases and updates!
@Hoglet-33
basically-ai
basically-experimental
Weโre excited to release Pebble-25M and Pebble-25M-Chat!
Both models use our 3:1 Mamba2/Transformer hybrid architecture and were pretrained on 25B tokens. Pebble-25M-Chat was then further fine-tuned on an additional 250M tokens from smol-smoltalk, following the same approach used for the Pebble-10M models.
We hope you enjoy experimenting with them!
Pebble-50M is coming in a few days.
Models
Pebble-25M: basically-ai/Pebble-25M
Pebble-25M-Chat: basically-ai/Pebble-25M-Chat
Pebble-10M GGUFs
In case you missed it, our friend @ContextReq made GGUF versions of the Pebble-10M models:
ContextReq/Pebble-10M-GGUF
ContextReq/Pebble-10M-Chat-GGUF
Follow us if you donโt want to miss future releases and updates!
@Hoglet-33
- 7 replies
Hoglet-33ย
updated 2
models 2 days ago
Hoglet-33ย
updated a
collection 3 days ago
Missing Transformers library from the metadata
#3 opened 4 days ago
by 
FlameF0X
Holy sh, a small language model that is mamab!
๐ 1
10
#1 opened 5 days ago
by FlameF0X
Fixed the benchmark scores.
#2 opened 4 days ago
by 
Hoglet-33
Hoglet-33ย
updated a
collection 4 days ago
Hoglet-33ย
published 2
models 5 days ago
Post
3277
Pebble 10M and Pebble 10M Chat are now released!
Both models use our Mamba/Transformer 3:1 hybrid architecture and were pretrained on 25 billion tokens.
Pebble 10M Chat was additionally fine-tuned on 250 million tokens of Smol-SmolTalk to improve its conversational capabilities.
You can find them here:
- basically-ai/Pebble-10M
- basically-ai/Pebble-10M-Chat
We hope you enjoy using them. The rest of the Pebble family will be released soon.
Follow for more:
@Hoglet-33
basically-ai
Both models use our Mamba/Transformer 3:1 hybrid architecture and were pretrained on 25 billion tokens.
Pebble 10M Chat was additionally fine-tuned on 250 million tokens of Smol-SmolTalk to improve its conversational capabilities.
You can find them here:
- basically-ai/Pebble-10M
- basically-ai/Pebble-10M-Chat
We hope you enjoy using them. The rest of the Pebble family will be released soon.
Follow for more:
@Hoglet-33
- 32 replies