tilelang.language.dtypes¶
Attributes¶
Classes¶
Functions¶
|
|
|
Convert TileLang dtype to PyTorch dtype. |
|
|
|
Return the number of bytes for this dtype. |
Packed 4-bit FP4 E2M1 (CUTLASS float_e2m1_t). |
|
8-bit FP4 E2M1 unpacked storage (CUTLASS float_e2m1_unpacksmem_t). |
|
|
Whether this is any FP4 E2M1 logical variant (packed or unpacked storage). |
|
Whether value is the packed 4-bit FP4 E2M1 variant. |
|
Whether value is the 8-bit FP4 E2M1 unpacked shared-memory storage variant. |
|
Whether value is any FP4 E2M1 logical variant (packed or unpacked). |
|
Module Contents¶
- class tilelang.language.dtypes.dtype¶
Bases:
Generic[_T]Abstract base class for generic types.
A generic type is typically declared by inheriting from this class parameterized with one or more type variables. For example, a generic mapping type might be defined as:
class Mapping(Generic[KT, VT]): def __getitem__(self, key: KT) -> VT: ... # Etc.
This class can then be used as follows:
def lookup_name(mapping: Mapping[KT, VT], key: KT, default: VT) -> VT: try: return mapping[key] except KeyError: return default
- property bits: int¶
- Return type:
int
- property bytes: int¶
- Return type:
int
- as_torch()¶
- Return type:
torch.dtype
- tilelang.language.dtypes.AnyDType¶
- tilelang.language.dtypes.dtype_name = 'uint16'¶
- tilelang.language.dtypes.int_¶
- tilelang.language.dtypes.__dtype_call__(self, *args, is_size_var=False)¶
- tilelang.language.dtypes.__dtype_as_torch__(self)¶
Convert TileLang dtype to PyTorch dtype.
- Parameters:
self (dtype)
- Return type:
torch.dtype
- tilelang.language.dtypes.__dtype_new__(cls, value)¶
- Parameters:
value (AnyDType)
- Return type:
- tilelang.language.dtypes.__dtype_bytes__(self)¶
Return the number of bytes for this dtype.
- Parameters:
self (dtype)
- Return type:
int
- tilelang.language.dtypes.__dtype_is_float4_e2m1fn__(self)¶
Packed 4-bit FP4 E2M1 (CUTLASS float_e2m1_t).
Use for pure FP4 workloads on tcgen05 mxf4 / mxf4nvf4 (packed SMEM, half the footprint). Global tensors and packed SMEM roundtrips use this dtype. TMA:
CU_TENSOR_MAP_DATA_TYPE_16U4_ALIGN8B.
- tilelang.language.dtypes.__dtype_is_float4_e2m1_unpacked__(self)¶
8-bit FP4 E2M1 unpacked storage (CUTLASS float_e2m1_unpacksmem_t).
Only for tcgen05
kind::f8f6f4and block-scaledkind::mxf8f6f4mixed-precision paths where sub-byte types share 16-byte SMEM/TMEM padding (one byte per FP4 element). Not for mxf4 / mxf4nvf4 packed FP4 kernels. Pair withT.tma_copyfrom packed global FP4; TMA:CU_TENSOR_MAP_DATA_TYPE_16U4_ALIGN16B.
- tilelang.language.dtypes.__dtype_is_float4__(self)¶
Whether this is any FP4 E2M1 logical variant (packed or unpacked storage).
- tilelang.language.dtypes.is_float4_e2m1fn(value)¶
Whether value is the packed 4-bit FP4 E2M1 variant.
- Parameters:
value (AnyDType)
- Return type:
- tilelang.language.dtypes.is_float4_e2m1_unpacked(value)¶
Whether value is the 8-bit FP4 E2M1 unpacked shared-memory storage variant.
- Parameters:
value (AnyDType)
- Return type:
- tilelang.language.dtypes.is_float4(value)¶
Whether value is any FP4 E2M1 logical variant (packed or unpacked).
- Parameters:
value (AnyDType)
- Return type:
- class tilelang.language.dtypes.bool¶
Bases:
dtypeAbstract base class for generic types.
A generic type is typically declared by inheriting from this class parameterized with one or more type variables. For example, a generic mapping type might be defined as:
class Mapping(Generic[KT, VT]): def __getitem__(self, key: KT) -> VT: ... # Etc.
This class can then be used as follows:
def lookup_name(mapping: Mapping[KT, VT], key: KT, default: VT) -> VT: try: return mapping[key] except KeyError: return default
- tilelang.language.dtypes.__all__¶