Records containing the tests for the naive initialization of parameters
Diogo
Diogo-V
AI & ML interests
None yet
Organizations
None yet
Naive Initialization + Noisy Scale
Records containing the tests for the naive initialization of parameters but while using a scale parameter initialized linearly with noise
Space Search with Fallback
Records containing the tests for the random space search with fallback initialization of params but while using a scale parameter initialized linearly
Norm Expr Non Linear Regression
Records containing the tests for the normalized expression non-linear regression initialization of params with scale parameter initialized linearly
Evaluate Schedulers
Tests to evaluate the learning rate schedulers for the layer-wise training of quantization parameters of the model
Global Training: Cosine Annealing
Tests to evaluate doing a global model train after the layer-wise training of quantization parameters of the model
Naive Initialization + Linear Scale
Records containing the tests for the naive initialization of parameters but while using a scale parameter initialized linearly
Space Search
Records containing the tests for the random space search initialization of parameters but while using a scale parameter initialized linearly
Non Linear Regression
Records containing the tests for the non-linear regression initialization of params but while using a scale parameter initialized linearly
Training Parameters
Tests for the layer-wise training of params initialized by various methods but while using a scale param initialized linearly
Global Training: Linear
Tests to evaluate doing a global model train after the layer-wise training of quantization parameters of the model
Naive Initialization
Records containing the tests for the naive initialization of parameters
Naive Initialization + Linear Scale
Records containing the tests for the naive initialization of parameters but while using a scale parameter initialized linearly
Naive Initialization + Noisy Scale
Records containing the tests for the naive initialization of parameters but while using a scale parameter initialized linearly with noise
Space Search
Records containing the tests for the random space search initialization of parameters but while using a scale parameter initialized linearly
Space Search with Fallback
Records containing the tests for the random space search with fallback initialization of params but while using a scale parameter initialized linearly
Non Linear Regression
Records containing the tests for the non-linear regression initialization of params but while using a scale parameter initialized linearly
Norm Expr Non Linear Regression
Records containing the tests for the normalized expression non-linear regression initialization of params with scale parameter initialized linearly
Training Parameters
Tests for the layer-wise training of params initialized by various methods but while using a scale param initialized linearly
Evaluate Schedulers
Tests to evaluate the learning rate schedulers for the layer-wise training of quantization parameters of the model
Global Training: Linear
Tests to evaluate doing a global model train after the layer-wise training of quantization parameters of the model
Global Training: Cosine Annealing
Tests to evaluate doing a global model train after the layer-wise training of quantization parameters of the model