SmallModel

Interactive Embedding Model Compression

1. Select Teacher Model

2. Select Layers i

Presets:

3. Model Configuration

Hidden Dimension i

Intermediate Size i

Vocab Size i

4. Data & Vocab Coverage i

Distillation Datasets i

Evaluation Tasks (MTEB) i

Vocab Coverage i

5. Size Estimation i

Teacher

-

params

-

MB (FP32)

→

Student
-
params
-
MB (FP32)

Compression

-

x smaller

0 MB -

6. Architecture Preview

Teacher

Student

7. Create Model

Manual Create i

Model Name:

Auto Compress i

Max Size (MB) i

Max Parameters i 20M

Min Layers i