keep track of what happen, when and with what code. • Save model checkpoint les for all reasonably eective/interesting experiments • Not recommended: modifying code to run dierent variants → hard to keep track of what you ran. • Analyse model behaviour during training →Use Tensor board, Logging etc. • Take notes of what each experiment was meant to test. 14