Skip to main content

cortex pull

info

This CLI command calls the following API endpoint:

This command displays downloaded models, or displays models available for downloading.

There are 3 ways to download models:

  • From Cortex's Built-in models: cortex pull <model_name>
  • HuggingFace repository handle: cortex pull <author/RepoID>
  • HuggingFace direct URL: cortex pull <huggingface URL ending with .gguf>

Each of these will display the model quantizations available, to be selected for download.

For more information, please refer to Pulling Models.

The downloaded model file will be stored in the Cortex Data Folder.

Usage

info

You can use the --verbose flag to display more detailed output of the internal processes. To apply this flag, use the following format: cortex --verbose [subcommand].


cortex pull [options] <model_id>

For example, this returns the following:


> cortex pull llama3.2
Downloaded models:
llama3.2:3b-gguf-q4-km
Available to download:
1. llama3.2:3b-gguf-q2-k
2. llama3.2:3b-gguf-q3-kl
3. llama3.2:3b-gguf-q3-km
4. llama3.2:3b-gguf-q3-ks
5. llama3.2:3b-gguf-q4-ks
6. llama3.2:3b-gguf-q5-km
7. llama3.2:3b-gguf-q5-ks
8. llama3.2:3b-gguf-q6-k
9. llama3.2:3b-gguf-q8-0
Select a model (1-9):

Options

OptionDescriptionRequiredDefault valueExample
model_idThe identifier of the model you want to download.Yes-mistral
-h, --helpDisplay help information for the command.No--h