neural-compressor
accelerate
datasets >= 1.8.0
sentencepiece != 0.1.92
protobuf
torch==2.3.0
onnx
onnxruntime==1.13.1
mteb==1.1.1
beir
transformers
optimum