Metadata-Version: 2.1
Name: crfm-helm
Version: 0.2.2
Summary: Benchmark for language models
Home-page: https://github.com/stanford-crfm/helm
Author: Stanford CRFM
Author-email: contact-crfm@stanford.edu
License: Apache License 2.0
Keywords: language models benchmarking
Classifier: Programming Language :: Python :: 3 :: Only
Classifier: Programming Language :: Python :: 3.8
Classifier: License :: OSI Approved :: Apache Software License
Requires-Python: ~=3.8
License-File: LICENSE
Requires-Dist: zstandard (~=0.18.0)
Requires-Dist: tqdm (~=4.64.1)
Requires-Dist: pyhocon (~=0.3.59)
Requires-Dist: dacite (~=1.6.0)
Requires-Dist: aleph-alpha-client (~=2.14.0)
Requires-Dist: bottle (~=0.12.23)
Requires-Dist: gunicorn (~=20.1.0)
Requires-Dist: Mako (~=1.2.3)
Requires-Dist: sqlitedict (~=1.7.0)
Requires-Dist: pymongo (~=4.2.0)
Requires-Dist: retrying (~=1.3.3)
Requires-Dist: websocket-client (~=1.3.2)
Requires-Dist: openai (~=0.27.0)
Requires-Dist: transformers (~=4.26.1)
Requires-Dist: tokenizers (~=0.13.2)
Requires-Dist: icetk (~=0.0.4)
Requires-Dist: protobuf (~=3.20.2)
Requires-Dist: google-api-python-client (~=2.64.0)
Requires-Dist: revChatGPT (~=0.1.1)
Requires-Dist: datasets (~=2.5.2)
Requires-Dist: gdown (~=4.4.0)
Requires-Dist: jsonlines (~=3.1.0)
Requires-Dist: sympy (~=1.11.1)
Requires-Dist: sentencepiece (~=0.1.97)
Requires-Dist: numba (~=0.56.4)
Requires-Dist: cattrs (~=22.2.0)
Requires-Dist: xlrd (~=2.0.1)
Requires-Dist: importlib-resources (~=5.10.0)
Requires-Dist: nltk (~=3.7)
Requires-Dist: scipy (~=1.9.1)
Requires-Dist: uncertainty-calibration (~=0.1.3)
Requires-Dist: rouge-score (~=0.1.2)
Requires-Dist: pyext (~=0.7)
Requires-Dist: pytrec-eval (==0.5)
Requires-Dist: sacrebleu (~=2.2.1)
Requires-Dist: scikit-learn (~=1.1.2)
Requires-Dist: spacy (~=3.2.4)
Requires-Dist: summ-eval (~=0.892)
Requires-Dist: torch (~=1.12.1)
Requires-Dist: torchvision (~=0.13.1)
Requires-Dist: colorcet (~=3.0.1)
Requires-Dist: matplotlib (~=3.6.0)
Requires-Dist: numpy (~=1.23.3)
Requires-Dist: seaborn (~=0.11.0)

Benchmark for language models
