CLI Reference

All commands, options, and behavior.

Commands

Command	Synopsis
`pramana run`	Run evals against a model
`pramana submit`	Submit results to the platform
`pramana models`	List available models
`pramana login`	Authenticate via OAuth
`pramana logout`	Clear stored token
`pramana whoami`	Show login status
`pramana config`	Configure preferences
`pramana delete`	Delete all your data (GDPR)

pramana run

Execute an eval suite against a model and save results locally.

pramana run --tier <tier> --model <model_id> [options]

Option	Default	Description
`--tier`	required	Suite tier: `cheap`, `moderate`, `comprehensive`
`--model`	required	Model ID or alias (e.g., `gpt-5.2`, `opus`)
`--output`	`results.json`	Output file path
`--temperature`	`0.0`	Sampling temperature
`--seed`	`42`	Random seed for reproducibility
`--offline`	`false`	Save locally without submit prompt
`--api-key`	from env	API key (overrides env var)
`--use-subscription`	`false`	Use Claude Code subscription mode

Behavior

Resolves short aliases (opus → claude-opus-4-6)
Auto-detects provider from model name prefix
Selects API or subscription mode based on available credentials
Runs tests sequentially with a progress bar
Appends results to the output file (multiple runs accumulate)

Examples

# Basic run
$ pramana run --tier cheap --model gpt-5.2

# Explicit parameters
$ pramana run --tier comprehensive --model gpt-5.2 --temperature 0.0 --seed 42

# With API key
$ pramana run --tier cheap --model claude-opus-4-6 --api-key sk-ant-...

# Offline mode
$ pramana run --tier cheap --model gpt-4o --offline

pramana submit

Upload locally saved results to the Pramana platform.

pramana submit <results_file> [options]

Option	Default	Description
`results_file`	required	Path to results JSON file
`--api-url`	from config	API endpoint URL

Behavior

Drains all pending run blocks from the file, one at a time
Removes each block from the file after successful submission
Stops on first failure, preserving remaining blocks
Reports duplicate count (server-side deduplication via content hash)

pramana models

List models from all providers.

pramana models [--refresh]

Option	Description
`--refresh`	Force fetch from upstream (bypass 24h cache)

pramana login

Authenticate via browser-based OAuth (GitHub or Google).

pramana login [--api-url URL]

Opens browser, waits for callback, stores token locally.

pramana logout

Clear stored authentication token.

pramana logout

pramana whoami

Display current login status.

pramana whoami

pramana config

Configure auto-detection preferences.

pramana config [--show] [--prefer-api] [--prefer-subscription]

Option	Description
`--show`	Show current configuration
`--prefer-api`	Default to API mode when both modes are available
`--prefer-subscription`	Default to subscription mode

pramana delete

Delete all your data from the platform (GDPR compliance).

pramana delete [--anonymize] [--confirm] [--api-url URL]

Option	Description
`--anonymize`	Keep results as anonymous instead of full deletion
`--confirm`	Skip confirmation prompt
`--api-url`	API endpoint URL

Model aliases

Alias	Resolves to
`opus`	`claude-opus-4-6`
`sonnet`	`claude-sonnet-4-6`
`haiku`	`claude-haiku-4-5`