Enter
if you don't want to change the suggested value.cf23df2207d99a74fbe169e3eba035e633b63d13
.config/wandb-sweep.yaml
file);neuro-flow bake hypertrain
command)..neuro/hypertrain.yml
and config/wandb-sweep.yaml
have links to train.py
(you can look at an example here). If you want to run hypertrain
for another script, you can change the program
property in config/wandb-sweep.yaml
(see below). The script must contain the description of the model and the training loop.config/wandb-sweep.yaml
as arguments of the command line and use them for model training/evaluation. For example, you can use command line parameters such as the argparse Python module.train.py
is a file that contains the model training code. It should log the metrics with W&B - here's an example for our case:config/wandb-sweep.yaml
has the following structure:/../train.py
is a default path to a file with the model training code.train.py
file. Names, values, and ranges are changeable as well.wandb-sweep.yaml
and the path to it can also be modified in .neuro/hypertrain.yml
(look for WANDB_SWEEPS_FILE=...
within the start_sweep
task definition).train.py
script (or whatever name you have chosen for it) on the platform with different sets of hyperparameters in parallel. By default, just 2 jobs run at the same time. You can change this number by modifying the id
list within the worker_...
task definition in .neuro/hypertrain.yml
:neuro-flow ps
.