Hyper-v
Dask and Optuna for Hyper Parameter Optimization
Dask and Optuna for Hyper Parameter Optimization
#Dask #Optuna #Hyper #Parameter #Optimization
“Coiled”
Notebook:
How to use Optuna and Dask together to perform parallel hyper-parameter optimization at scale. This notebook uses a toy example, for a more fully-featured example take a look at…
source
To see the full content, share this page by clicking one of the buttons below |
I had an issue with parallelization and the random sampler for hyperparameter search. When I submit optimize function in parallel, optuna keeps repeating the same hyper-paremeters across all processes. I could not figure out how to reseed the sampler for different processes.
Thank you so much. This is very helpful with my research.