ClassClassificationHead

class liqfit.modeling.ClassClassificationHead

(in_features: int, out_features: int, multi_target: bool, bias: bool = True,
temperature: int = 1.0, eps: float = 1e-5, ignore_index: int = -100)

Parameters:

• in_features (int) Number of input features.

• out_features (int) Number of output features.

• multi_target (bool): Whether the output is multi-target or not (used for loss calculation).

• bias (bool): Whether to use bias in the nn.Linear layer or not.

• temperature (int): Temperature that will be divided by the linear layer output to calibrate the output. (Defaults to 1.0)

• eps (float): Epsilon will be added to the temperature for numerical stability. (Defaults to 1e-5).

• ignore_index (int): Index that will be ignored during loss calculation. (Defaults to -100).

Using ClassClassificationHead

from liqfit.modeling.heads import ClassClassificationHead
import torch

head = ClassClassificationHead(512, 20, multi_target=True)
embeddings = torch.randn((1, 10, 512))
output = head(embeddings)