File size: 818 Bytes
fda8bd5 d323183 4373b70 fda8bd5 a60c85c 3cdefe5 a60c85c d323183 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 | ---
library_name: pytorch
tags:
- multimodel-small
license: mit
datasets:
- CodeDevX/MultiModel-Small-Dataset
language:
- en
pipeline_tag: text-generation
base_model:
- CodeDevX/MultiModel-Small-229M
---
# MultiModel Small 229M
Small multimodal-ready transformer checkpoint trained on the project's educational text dataset.
## Details
- Parameters: approximately 229M
- Text decoder: 12 layers, 768 hidden size, 12 attention heads
- Vocabulary: 50,257 BPE tokens
- Training samples: 1,000
- Checkpoint: global step 350
## Files
- `pytorch_model.bin`: PyTorch state dictionary
- `config.json`: model configuration
- `tokenizer.json` and `tokenizer_config.json`: uploaded at repository root
This checkpoint uses the custom model implementation in the source project and is not directly loadable with `AutoModel`. |