Sweeps

Best practices to organize hyperparameter searches

When you run many hyperparameter searches, tag your runs so you can group and find related experiments later. Tag runs i …

Can I use Sweeps and SageMaker?

Yes, you can use W&B Sweeps with Amazon SageMaker to run hyperparameter searches on SageMaker training jobs. To authenti …

Can we flag boolean variables as hyperparameters?

To pass hyperparameters as boolean flags, use the macro in the command section of your sweep configuration. The macro au …

Can you use W&B Sweeps with cloud infrastructure such as AWS Batch or ECS?

Yes. To run a W&B Sweep on cloud infrastructure, publish the sweep_id so that any W&B Sweep agent can access it, and imp …

Do I need to provide values for all hyperparameters as part of the W&B Sweep? Can I set defaults?

You don’t need to provide values for every hyperparameter in a W&B Sweep. You can set defaults and let the sweep overrid …

How can I change the directory my sweep logs to locally?

Set the logging directory for run data by configuring the WANDB_DIR environment variable. For example:

How can I resume a sweep using Python code?

To resume a sweep, pass the sweep_id to the wandb.agent() function.

How do I best log models from runs in a sweep?

To log models in a sweep, create a model artifact for the sweep. Each version represents a different run from the sweep. …

How do I enable code logging with Sweeps?

To enable code logging for sweeps, add wandb.log_code() after initializing the W&B Run. This step is necessary even when …

How do I fix `CommError, Run does not exist` during a sweep?

If you see both CommError, Run does not exist and ERROR Error uploading during a sweep, the most likely cause is that yo …

How do I fix `Cuda out of memory` during a sweep?

If you see Cuda out of memory during a sweep, refactor your code to use process-based execution. Rewrite your code as a …

How do I fix an `anaconda 400 error` during a sweep?

An anaconda 400 error during a sweep often means you didn’t log the metric you’re optimizing. You might see: The sweep c …

How do I use custom CLI commands with sweeps?

You can use W&B Sweeps with custom CLI commands if training configuration passes command-line arguments. This lets you r …

How should I run sweeps on SLURM?

To use sweeps with the SLURM scheduling system, run wandb agent —count 1 SWEEP_ID in each scheduled job. This command e …

Is there a way to add extra values to a sweep, or do I need to start a new one?

Once a W&B Sweep starts, you can’t change the sweep configuration. However, you can navigate to any table view, select r …

Optimizing multiple metrics

W&B Sweeps optimize a single objective metric. To optimize multiple metrics in a single run, combine them into a weighte …

What happens if I edit my Python files while a sweep is running?

The behavior depends on which file you edit. While a sweep is running: If the train.py script that the sweep uses change …

What is the `Est. Runs` column?

W&B provides an estimated number of runs generated when creating a W&B Sweep with a discrete search space. This total re …