Metadata-Version: 2.4
Name: evalmc
Version: 0.0.3
Summary: Submit ONNX policies and Docker agents to MyoChallenge
Author-email: MyoChallenge Team <caggiano@gmail.com>
License-Expression: Apache-2.0
Project-URL: Homepage, https://github.com/MyoHub/mcEvalProd-CLI
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Python: >=3.9
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: click>=8.0.0
Requires-Dist: docker>=6.0.0
Requires-Dist: requests>=2.25.0
Requires-Dist: boto3>=1.26.0
Dynamic: license-file

# evalmc

MyoChallenge submission CLI — upload ONNX policies or Docker agent images to
[mc26.myosuite.org](https://mc26.myosuite.org).

[![PyPI](https://img.shields.io/pypi/v/evalmc.svg)](https://pypi.org/project/evalmc/)
[![Python](https://img.shields.io/pypi/pyversions/evalmc.svg)](https://pypi.org/project/evalmc/)
[![License](https://img.shields.io/pypi/l/evalmc.svg)](https://pypi.org/project/evalmc/)

```bash
pip install -U evalmc
```

Default API: `https://api.mc.myosuite.org`

---

## Quick start

```bash
evalmc host --set-host https://api.mc.myosuite.org
evalmc login
evalmc status
evalmc submit-onnx model.onnx -t chasetag -p 1
```

`evalmc login` stores the email and auth token from the dashboard.
Credentials live in `~/.myochallenge/`.

---

## Commands

| Command | Purpose |
|---|---|
| `evalmc host` | Show or set the API host |
| `evalmc login` | Save email + auth token |
| `evalmc status` | Confirm host and team |
| `evalmc submit-onnx` | Upload an ONNX policy |
| `evalmc nominate` | Pick a scored artifact for title-cycle finals |
| `evalmc push` | Submit a Docker / ECR agent image |

### ONNX

Recommended for ChaseTag. The graph is `obs → action`; no `policy.py` required.

```bash
evalmc submit-onnx model.onnx -t chasetag -p 1
```

### Title-cycle nomination

Before freeze, choose which scored in-window submission plays in finals.
If you skip this, the platform uses your best score.

```bash
evalmc nominate -t chasetag -p 1 --submission-id 123
```

### Docker

For custom Python around the policy. The image must ship `policy.py` and/or
`model.onnx` under `/policy` (or `/app`).

```bash
evalmc push my-agent:tag -t chasetag -p 1
```

---

Some tracks are invitation-only. Registration and submission are rejected until
the team is on the whitelist. Leaderboards stay public.
