tilelang.tileop.gemm_blockscaled.gemm_blockscaled_base

Shared accessors for block-scaled GEMM backend implementations.

Classes

GemmBlockScaledMixin

Scale-factor operands and knobs of a block-scaled GEMM implementation.

Module Contents

class tilelang.tileop.gemm_blockscaled.gemm_blockscaled_base.GemmBlockScaledMixin

Scale-factor operands and knobs of a block-scaled GEMM implementation.

Mixed into a dense backend implementation class (GemmTCGEN5, GemmMMA, …) whose gemm_node is a GemmBlockScaled. It owns everything the dense classes must not know about: the SFA/SFB regions, the logical K-axis start and the sf_* annotations. Which scale layouts a backend supports stays with that backend.

gemm_node: object

property SFARegion: tvm.tirx.BufferRegion

Return type:

tvm.tirx.BufferRegion

property SFBRegion: tvm.tirx.BufferRegion

Return type:

tvm.tirx.BufferRegion

property sf_k_start: tvm.ir.PrimExpr

Return type:

tvm.ir.PrimExpr

property sf_a_granularity_k: int

Return type:

int

property sf_b_granularity_k: int

Return type:

int

property sf_layout: str

Scale-factor layout name from the annotations; "rowmajor" by default.

Return type:

str