Skip to content

naive_bayes

Bases: rpn

A Naive Bayes model implemented using the RPN framework.

Parameters:

Name Type Description Default
dims list[int] | tuple[int]

A list or tuple of integers representing the dimensions of each layer in the Naive Bayes model. Must contain at least two dimensions.

 required
name str

The name of the Naive Bayes model. Default is 'rpn_naive_bayes'.

 'rpn_naive_bayes'
distribution str

The type of distribution to use for data transformation. Supported options are: 'normal', 'exponential', 'cauchy', 'gamma', 'laplace', and 'chi2'. Default is 'normal'.

 'normal'
enable_bias bool

Whether to enable bias in the layers. Default is False.

 False
device str

The device to use for computation ('cpu' or 'cuda'). Default is 'cpu'.

 'cpu'
with_lorr bool

Whether to use LoRR (Low-Rank Representation) for parameter reconciliation. Default is False.

 False
r int

The rank for the LoRR parameter reconciliation. Default is 3.

 3
with_residual bool

Whether to enable residual connections in the layers. Default is False.

 False
channel_num int

The number of channels in each layer. Default is 1.

 1
width int

The number of parallel heads in each layer. Default is 1.

 1
*args optional

Additional positional arguments for the rpn superclass.

 ()
**kwargs optional

Additional keyword arguments for the rpn superclass.

 {}

Raises:

Type Description
ValueError

If dims contains fewer than two dimensions.
Warning

If dims contains more than two dimensions, as regular Naive Bayes models are typically shallow.

Methods:

Name Description
__init__

Initializes the Naive Bayes model and builds its layers.
Source code in tinybig/model/rpn_naive_bayes.py 
 22
 23
 24
 25
 26
 27
 28
 29
 30
 31
 32
 33
 34
 35
 36
 37
 38
 39
 40
 41
 42
 43
 44
 45
 46
 47
 48
 49
 50
 51
 52
 53
 54
 55
 56
 57
 58
 59
 60
 61
 62
 63
 64
 65
 66
 67
 68
 69
 70
 71
 72
 73
 74
 75
 76
 77
 78
 79
 80
 81
 82
 83
 84
 85
 86
 87
 88
 89
 90
 91
 92
 93
 94
 95
 96
 97
 98
 99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
class naive_bayes(rpn):
    """
    A Naive Bayes model implemented using the RPN framework.

    Parameters
    ----------
    dims : list[int] | tuple[int]
        A list or tuple of integers representing the dimensions of each layer in the Naive Bayes model.
        Must contain at least two dimensions.
    name : str, optional
        The name of the Naive Bayes model. Default is 'rpn_naive_bayes'.
    distribution : str, optional
        The type of distribution to use for data transformation. Supported options are:
        'normal', 'exponential', 'cauchy', 'gamma', 'laplace', and 'chi2'. Default is 'normal'.
    enable_bias : bool, optional
        Whether to enable bias in the layers. Default is False.
    device : str, optional
        The device to use for computation ('cpu' or 'cuda'). Default is 'cpu'.
    with_lorr : bool, optional
        Whether to use LoRR (Low-Rank Representation) for parameter reconciliation. Default is False.
    r : int, optional
        The rank for the LoRR parameter reconciliation. Default is 3.
    with_residual : bool, optional
        Whether to enable residual connections in the layers. Default is False.
    channel_num : int, optional
        The number of channels in each layer. Default is 1.
    width : int, optional
        The number of parallel heads in each layer. Default is 1.
    *args : optional
        Additional positional arguments for the `rpn` superclass.
    **kwargs : optional
        Additional keyword arguments for the `rpn` superclass.

    Raises
    ------
    ValueError
        If `dims` contains fewer than two dimensions.
    Warning
        If `dims` contains more than two dimensions, as regular Naive Bayes models are typically shallow.

    Methods
    -------
    __init__(dims, name='rpn_naive_bayes', distribution='normal', ...)
        Initializes the Naive Bayes model and builds its layers.
    """
    def __init__(
        self,
        dims: list[int] | tuple[int],
        name: str = 'rpn_naive_bayes',
        distribution: str = 'normal',
        enable_bias: bool = False,
        device: str = 'cpu',
        # optional parameters
        with_lorr: bool = False,
        r: int = 3,
        with_residual: bool = False,
        channel_num: int = 1,
        width: int = 1,
        *args, **kwargs
    ):
        """
        Initializes the Naive Bayes model.

        Parameters
        ----------
        dims : list[int] | tuple[int]
            A list or tuple of integers representing the dimensions of each layer in the Naive Bayes model.
            Must contain at least two dimensions.
        name : str, optional
            The name of the Naive Bayes model. Default is 'rpn_naive_bayes'.
        distribution : str, optional
            The type of distribution to use for data transformation. Supported options are:
            'normal', 'exponential', 'cauchy', 'gamma', 'laplace', and 'chi2'. Default is 'normal'.
        enable_bias : bool, optional
            Whether to enable bias in the layers. Default is False.
        device : str, optional
            The device to use for computation ('cpu' or 'cuda'). Default is 'cpu'.
        with_lorr : bool, optional
            Whether to use LoRR (Low-Rank Representation) for parameter reconciliation. Default is False.
        r : int, optional
            The rank for the LoRR parameter reconciliation. Default is 3.
        with_residual : bool, optional
            Whether to enable residual connections in the layers. Default is False.
        channel_num : int, optional
            The number of channels in each layer. Default is 1.
        width : int, optional
            The number of parallel heads in each layer. Default is 1.
        *args : optional
            Additional positional arguments for the `rpn` superclass.
        **kwargs : optional
            Additional keyword arguments for the `rpn` superclass.

        Raises
        ------
        ValueError
            If `dims` contains fewer than two dimensions.
        Warning
            If `dims` contains more than two dimensions, as regular Naive Bayes models are typically shallow.
        """
        if len(dims) < 2:
            raise ValueError("At least two dim values is needed for defining the model...")

        if len(dims) > 2:
            warnings.warn("Regular SVMs should have only two layers...")

        layers = []
        for m, n in zip(dims, dims[1:]):
            layers.append(
                naive_bayes_layer(
                    m=m, n=n, device=device,
                    enable_bias=enable_bias,
                    distribution=distribution,
                    with_lorr=with_lorr,
                    with_residual=with_residual,
                    r=r,
                    channel_num=channel_num,
                    width=width,
                )
            )
        super().__init__(name=name, layers=layers, device=device, *args, **kwargs)

__init__(dims, name='rpn_naive_bayes', distribution='normal', enable_bias=False, device='cpu', with_lorr=False, r=3, with_residual=False, channel_num=1, width=1, *args, **kwargs)

Initializes the Naive Bayes model.

Parameters:

Name Type Description Default
dims list[int] | tuple[int]

A list or tuple of integers representing the dimensions of each layer in the Naive Bayes model. Must contain at least two dimensions.

 required
name str

The name of the Naive Bayes model. Default is 'rpn_naive_bayes'.

 'rpn_naive_bayes'
distribution str

The type of distribution to use for data transformation. Supported options are: 'normal', 'exponential', 'cauchy', 'gamma', 'laplace', and 'chi2'. Default is 'normal'.

 'normal'
enable_bias bool

Whether to enable bias in the layers. Default is False.

 False
device str

The device to use for computation ('cpu' or 'cuda'). Default is 'cpu'.

 'cpu'
with_lorr bool

Whether to use LoRR (Low-Rank Representation) for parameter reconciliation. Default is False.

 False
r int

The rank for the LoRR parameter reconciliation. Default is 3.

 3
with_residual bool

Whether to enable residual connections in the layers. Default is False.

 False
channel_num int

The number of channels in each layer. Default is 1.

 1
width int

The number of parallel heads in each layer. Default is 1.

 1
*args optional

Additional positional arguments for the rpn superclass.

 ()
**kwargs optional

Additional keyword arguments for the rpn superclass.

 {}

Raises:

Type Description
ValueError

If dims contains fewer than two dimensions.
Warning

If dims contains more than two dimensions, as regular Naive Bayes models are typically shallow.
Source code in tinybig/model/rpn_naive_bayes.py 
 67
 68
 69
 70
 71
 72
 73
 74
 75
 76
 77
 78
 79
 80
 81
 82
 83
 84
 85
 86
 87
 88
 89
 90
 91
 92
 93
 94
 95
 96
 97
 98
 99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
def __init__(
    self,
    dims: list[int] | tuple[int],
    name: str = 'rpn_naive_bayes',
    distribution: str = 'normal',
    enable_bias: bool = False,
    device: str = 'cpu',
    # optional parameters
    with_lorr: bool = False,
    r: int = 3,
    with_residual: bool = False,
    channel_num: int = 1,
    width: int = 1,
    *args, **kwargs
):
    """
    Initializes the Naive Bayes model.

    Parameters
    ----------
    dims : list[int] | tuple[int]
        A list or tuple of integers representing the dimensions of each layer in the Naive Bayes model.
        Must contain at least two dimensions.
    name : str, optional
        The name of the Naive Bayes model. Default is 'rpn_naive_bayes'.
    distribution : str, optional
        The type of distribution to use for data transformation. Supported options are:
        'normal', 'exponential', 'cauchy', 'gamma', 'laplace', and 'chi2'. Default is 'normal'.
    enable_bias : bool, optional
        Whether to enable bias in the layers. Default is False.
    device : str, optional
        The device to use for computation ('cpu' or 'cuda'). Default is 'cpu'.
    with_lorr : bool, optional
        Whether to use LoRR (Low-Rank Representation) for parameter reconciliation. Default is False.
    r : int, optional
        The rank for the LoRR parameter reconciliation. Default is 3.
    with_residual : bool, optional
        Whether to enable residual connections in the layers. Default is False.
    channel_num : int, optional
        The number of channels in each layer. Default is 1.
    width : int, optional
        The number of parallel heads in each layer. Default is 1.
    *args : optional
        Additional positional arguments for the `rpn` superclass.
    **kwargs : optional
        Additional keyword arguments for the `rpn` superclass.

    Raises
    ------
    ValueError
        If `dims` contains fewer than two dimensions.
    Warning
        If `dims` contains more than two dimensions, as regular Naive Bayes models are typically shallow.
    """
    if len(dims) < 2:
        raise ValueError("At least two dim values is needed for defining the model...")

    if len(dims) > 2:
        warnings.warn("Regular SVMs should have only two layers...")

    layers = []
    for m, n in zip(dims, dims[1:]):
        layers.append(
            naive_bayes_layer(
                m=m, n=n, device=device,
                enable_bias=enable_bias,
                distribution=distribution,
                with_lorr=with_lorr,
                with_residual=with_residual,
                r=r,
                channel_num=channel_num,
                width=width,
            )
        )
    super().__init__(name=name, layers=layers, device=device, *args, **kwargs)