zero_reconciliation

Bases: constant_reconciliation

The zero parameter reconciliation function.

It performs the zero parameter reconciliation, and returns the zero reconciled parameter matrix of shape (n, D). This class inherits from the constant_reconciliation class defined above.

...

Notes

As a special case of the constant parameter reconciliation function, zero reconciliation projects any input parameters to zero matrix of shape (n, D) as follows: $$ \begin{equation} \psi(\mathbf{w}) = \mathbf{0} \in {R}^{n \times D}, \end{equation} $$ where the output matrix \(\mathbf{0}\) of size \(n \times D\) is filled with zeros.

Source code in tinybig/reconciliation/basic_reconciliation.py

class zero_reconciliation(constant_reconciliation):
    r"""
    The zero parameter reconciliation function.

    It performs the zero parameter reconciliation, and returns the zero reconciled parameter matrix of shape (n, D).
    This class inherits from the constant_reconciliation class defined above.

    ...

    Notes
    ----------
    As a special case of the constant parameter reconciliation function, **zero reconciliation** projects
    any input parameters to zero matrix of shape (n, D) as follows:
    $$
        \begin{equation}
            \psi(\mathbf{w}) = \mathbf{0} \in {R}^{n \times D},
        \end{equation}
    $$
    where the output matrix $\mathbf{0}$ of size $n \times D$ is filled with zeros.
    """
    def __init__(self, name: str = 'zero_reconciliation', *args, **kwargs):
        r"""
        The initialization method of the zero parameter reconciliation function.

        It initializes a zero parameter reconciliation function object.
        This method will call the initialization method of the constant_reconciliation
        class with constant parameter $c=0.0$.

        Parameters
        ----------
        name: str, default = 'zero_reconciliation'
            Name of the parameter reconciliation function.

        Returns
        ----------
        fabrication
            The zero parameter reconciliation function object.
        """
        super().__init__(name=name, c=0.0, *args, **kwargs)

__init__(name='zero_reconciliation', *args, **kwargs)

The initialization method of the zero parameter reconciliation function.

It initializes a zero parameter reconciliation function object. This method will call the initialization method of the constant_reconciliation class with constant parameter \(c=0.0\).

Parameters:

Name	Type	Description	Default
name	str	Name of the parameter reconciliation function.	'zero_reconciliation'

Returns:

Type	Description
fabrication	The zero parameter reconciliation function object.

Source code in tinybig/reconciliation/basic_reconciliation.py

def __init__(self, name: str = 'zero_reconciliation', *args, **kwargs):
    r"""
    The initialization method of the zero parameter reconciliation function.

    It initializes a zero parameter reconciliation function object.
    This method will call the initialization method of the constant_reconciliation
    class with constant parameter $c=0.0$.

    Parameters
    ----------
    name: str, default = 'zero_reconciliation'
        Name of the parameter reconciliation function.

    Returns
    ----------
    fabrication
        The zero parameter reconciliation function object.
    """
    super().__init__(name=name, c=0.0, *args, **kwargs)