A collection of obfuscated version of a 20B-token sample of the FineWeb Edu dataset.
Daniel Gallagher
DanielGallagherIRE
AI & ML interests
NLP at the Institute for Applied Informatics in Leipzig, Germany.
Recent Activity
liked a model 2 days ago
Boldt/Boldt-1B updated a collection 3 days ago
Obfuscated FineWeb Edu updated a collection 3 days ago
Obfuscated FineWeb EduOrganizations
-
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-10
0.1B • Updated • 4 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-7.5
0.1B • Updated • 1 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-5
0.1B • Updated • 2 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-2.5
0.1B • Updated • 1
Models pretrained on various obfuscated versions of the same dataset to analyse how the obfuscation affects downstream performance.
Encoder models trained on obfuscated versions of the fineweb-edu-1B dataset, as part of the InfAI CORAL project.
-
DanielGallagherIRE/obfuscated-bert-fineweb-1B-original
0.1B • Updated • 3 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-scramble-reverse-head
0.1B • Updated • 3 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-noun-pos
0.1B • Updated • 3 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-noun-propn
0.1B • Updated • 4
A collection of obfuscated version of a 20B-token sample of the FineWeb Edu dataset.
Models pretrained on various obfuscated versions of the same dataset to analyse how the obfuscation affects downstream performance.
-
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-10
0.1B • Updated • 4 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-7.5
0.1B • Updated • 1 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-5
0.1B • Updated • 2 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-30K-MI-2.5
0.1B • Updated • 1
Encoder models trained on obfuscated versions of the fineweb-edu-1B dataset, as part of the InfAI CORAL project.
-
DanielGallagherIRE/obfuscated-bert-fineweb-1B-original
0.1B • Updated • 3 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-scramble-reverse-head
0.1B • Updated • 3 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-noun-pos
0.1B • Updated • 3 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-noun-propn
0.1B • Updated • 4