Tips for hyperparam-tuning.
Many hyperparams to tune, mark importance by colors (red > yellow > purple):
How to select set of values to explore ?
- Do NOT use grid search (grid of n * n)
— this was OK in pre-DL era.
- try random values.
reason: difficule to know which …