Skip to content
tinyBIG by IFM Lab
tinybig.optimizer
Initializing search
Edit on Github
Home
Get Started
Docs
Tutorials
Examples
Blogs
News
Contact us
tinyBIG by IFM Lab
Edit on Github
Home
Get Started
Get Started
About us
Installation
Quickstart
Docs
Docs
tinybig
tinybig
tinybig.model
tinybig.model
rpn
mlp
kan
pgm
naive_bayes
svm
cnn
rnn
regression_rnn
gcn
gat
transformer
tinybig.module
tinybig.module
model
rpn_layer
rpn_head
function
transformation
fabrication
remainder
interdependence
fusion
tinybig.layer
tinybig.layer
perceptron_layer
grid_interdependence_layer
grid_compression_layer
chain_interdependence_layer
graph_interdependence_layer
graph_bilinear_interdependence_layer
bilinear_interdependence_layer
tinybig.head
tinybig.head
perceptron_head
svm_head
kan_head
pgm_head
naive_bayes_head
grid_interdependence_head
grid_compression_head
chain_interdependence_head
graph_interdependence_head
bilinear_interdependence_head
tinybig.config
tinybig.config
config
model_configs
layer_configs
head_configs
function_configs
function_list_configs
tinybig.expansion
tinybig.expansion
identity_expansion
reciprocal_expansion
linear_expansion
taylor_expansion
fourier_expansion
bspline_expansion
chebyshev_expansion
jacobi_expansion
hermite_expansion
laguerre_expansion
legendre_expansion
gegenbauer_expansion
bessel_expansion
reverse_bessel_expansion
fibonacci_expansion
lucas_expansion
meyer_wavelet_expansion
ricker_wavelet_expansion
shannon_wavelet_expansion
beta_wavelet_expansion
harr_wavelet_expansion
dog_wavelet_expansion
hyperbolic_expansion
arc_hyperbolic_expansion
trigonometric_expansion
arc_trigonometric_expansion
gaussian_rbf_expansion
inverse_quadratic_rbf_expansion
naive_normal_expansion
naive_cauchy_expansion
naive_chi2_expansion
naive_gamma_expansion
naive_exponential_expansion
naive_laplace_expansion
combinatorial_expansion
combinatorial_normal_expansion
nested_expansion
extended_expansion
tinybig.compression
tinybig.compression
identity_compression
reciprocal_compression
linear_compression
metric_compression
max_compression
min_compression
sum_compression
prod_compression
mean_compression
median_compression
geometric_compression
cuboid_patch_based_geometric_compression
cuboid_max_based_geometric_compression
cuboid_min_based_geometric_compression
cuboid_mean_based_geometric_compression
cylinder_patch_based_geometric_compression
cylinder_max_based_geometric_compression
cylinder_min_based_geometric_compression
cylinder_mean_based_geometric_compression
sphere_patch_based_geometric_compression
sphere_max_based_geometric_compression
sphere_min_based_geometric_compression
sphere_mean_based_geometric_compression
feature_selection_compression
incremental_feature_clustering_based_compression
incremental_feature_clustering_based_compression
dimension_reduction_compression
incremental_PCA_based_compression
incremental_random_projection_based_compression
manifold_compression
isomap_manifold_compression
lle_manifold_compression
mds_manifold_compression
spectral_embedding_manifold_compression
tsne_manifold_compression
naive_probabilistic_compression
naive_uniform_probabilistic_compression
naive_normal_probabilistic_compression
naive_cauchy_probabilistic_compression
naive_chi2_probabilistic_compression
naive_exponential_probabilistic_compression
naive_gamma_probabilistic_compression
naive_laplace_probabilistic_compression
combinatorial_compression
combinatorial_probabilistic_compression
nested_compression
extended_compression
tinybig.transformation
tinybig.transformation
tinybig.reconciliation
tinybig.reconciliation
constant_reconciliation
zero_reconciliation
one_reconciliation
constant_eye_reconciliation
identity_reconciliation
masking_reconciliation
duplicated_padding_reconciliation
duplicated_diagonal_padding_reconciliation
lorr_reconciliation
hm_reconciliation
lphm_reconciliation
dual_lphm_reconciliation
hypernet_reconciliation
random_matrix_adaption_reconciliation
random_matrix_hypernet_reconciliation
tinybig.remainder
tinybig.remainder
constant_remainder
zero_remainder
one_remainder
identity_remainder
linear_remainder
tinybig.interdependence
tinybig.interdependence
constant_interdependence
constant_c_interdependence
zero_interdependence
one_interdependence
identity_interdependence
statistical_kernel_based_interdependence
kl_divergence_interdependence
pearson_correlation_interdependence
rv_coefficient_interdependence
mutual_information_interdependence
numerical_kernel_based_interdependence
linear_kernel_interdependence
polynomial_kernel_interdependence
hyperbolic_tangent_kernel_interdependence
exponential_kernel_interdependence
minkowski_distance_interdependence
manhattan_distance_interdependence
euclidean_distance_interdependence
chebyshev_distance_interdependence
canberra_distance_interdependence
cosine_similarity_interdependence
gaussian_rbf_kernel_interdependence
laplacian_kernel_interdependence
anisotropic_rbf_kernel_interdependence
custom_hybrid_kernel_interdependence
parameterized_interdependence
lowrank_parameterized_bilinear_interdependence
hm_parameterized_interdependence
lphm_parameterized_interdependence
dual_lphm_parameterized_interdependence
random_matrix_adaption_parameterized_interdependence
parameterized_bilinear_interdependence
lowrank_parameterized_bilinear_interdependence
hm_parameterized_bilinear_interdependence
lphm_parameterized_bilinear_interdependence
dual_lphm_parameterized_bilinear_interdependence
random_matrix_adaption_parameterized_bilinear_interdependence
graph_interdependence
multihop_graph_interdependence
pagerank_multihop_graph_interdependence
chain_interdependence
multihop_chain_interdependence
inverse_approx_multihop_chain_interdependence
exponential_approx_multihop_chain_interdependence
geometric_interdependence
cuboid_patch_based_geometric_interdependence
cuboid_patch_padding_based_geometric_interdependence
cuboid_patch_aggregation_based_geometric_interdependence
cylinder_patch_based_geometric_interdependence
cylinder_patch_padding_based_geometric_interdependence
cylinder_patch_aggregation_based_geometric_interdependence
sphere_patch_based_geometric_interdependence
sphere_patch_padding_based_geometric_interdependence
sphere_patch_aggregation_based_geometric_interdependence
parameterized_rpn_interdependence
hybrid_interdependence
tinybig.fusion
tinybig.fusion
weighted_summation_fusion
summation_fusion
average_fusion
parameterized_weighted_summation_fusion
metric_fusion
mean_fusion
prod_fusion
max_fusion
min_fusion
median_fusion
sum_fusion
concatenation_fusion
parameterized_concatenation_fusion
lowrank_parameterized_concatenation_fusion
hm_parameterized_concatenation_fusion
lphm_parameterized_concatenation_fusion
dual_lphm_parameterized_concatenation_fusion
random_matrix_adaption_parameterized_concatenation_fusion
tinybig.koala
tinybig.koala
tinybig.koala.algebra
tinybig.koala.algebra
find_close_factors
tinybig.koala.linear_algebra
tinybig.koala.linear_algebra
metric
kernel
matrix
tinybig.koala.statistics
tinybig.koala.statistics
metric
kernel
tinybig.koala.geometry
tinybig.koala.geometry
coordinate
coordinate_3d
coordinate_2d
geometric_space
grid
cuboid
cylinder
sphere
tinybig.koala.topology
tinybig.koala.topology
base_topology
chain
graph
tinybig.koala.manifold
tinybig.koala.manifold
manifold
isomap_manifold
tsne_manifold
spectral_embedding_manifold
mds_manifold
lle_manifold
tinybig.koala.machine_learning
tinybig.koala.machine_learning
incremental_dimension_reduction
incremental_PCA
incremental_random_projection
feature_selection
incremental_feature_clustering
incremental_variance_threshold
tinybig.koala.signal_processing
tinybig.koala.signal_processing
discrete_wavelet
harr_wavelet
beta_wavelet
dog_wavelet
meyer_wavelet
ricker_wavelet
shannon_wavelet
tinybig.koala.physics
tinybig.koala.physics
tinybig.data
tinybig.data
dataset
dataloader
function_dataloader
elementary_function
composite_function
feynman_function
dimensionless_feynman_function
mnist
cifar10
imagenet
text_dataloader
imdb
sst2
agnews
graph_dataloader
cora
citeseer
pubmed
time_series_dataloader
stock
etf
traffic_la
traffic_bay
tabular_dataloader
iris
diabetes
banknote
tinybig.output
tinybig.output
output
rpn_output
tinybig.loss
tinybig.loss
tinybig.metric
tinybig.metric
metric
accuracy
f1
mse
tinybig.optimizer
tinybig.optimizer
tinybig.learner
tinybig.learner
learner
backward_learner
forward_learner
tinybig.visual
tinybig.visual
tinybig.util
tinybig.util
set_random_seed
check_file_existence
check_directory_exists
create_directory_if_not_exists
download_file_from_github
unzip_file
find_class_in_package
parameter_scheduler
async_clear_tensor_memory
tinybig.zootopia
tinybig.zootopia
bat
cat
cheetah
chimpanzee
crow
eagle
elephant
parrot
Tutorials
Tutorials
Beginner's Tutorials
Beginner's Tutorials
Expansion Function
Advanced Tutorials
Advanced Tutorials
Examples
Examples
tinybig for Functions
tinybig for Functions
Elementary Function
Composite Function
Feynman Function
tinybig for Vision
tinybig for Vision
MNIST Classification
MNIST with Dual LPHM
CIFAR10 Classification
tinybig for Language
tinybig for Language
Failure of KAN
IMDB Classification
AGNews Classification
SST2 Classification
tinybig for Tabular
tinybig for Tabular
Iris Species Inference
Diabetes Diagnosis
Banknote Authentication
Blogs
Blogs
Archive
News
News
Research News
Library Updates
Contact us
Contact us
Sponsors
Contributing
Licenses
Table of contents
optimizer
Organization of this Module
tinybig.optimizer
Organization of this Module
Back to top