tilelang.cache.kernel_cache module#

The cache utils with class and database persistence - KernelCache Class

class tilelang.cache.kernel_cache.KernelCache(cache_dir='/home/t-leiwang/.tilelang/cache')#

Bases: object

Caches compiled kernels using a class and database persistence to avoid redundant compilation. Cache files:

kernel.cu: The compiled kernel source code warpped_kernel.cu: The compiled wrapped kernel source code kernel_lib.so: The compiled kernel library params.pkl: The compiled kernel parameters

cached(func: Optional[PrimFunc] = None, out_idx: Optional[List[int]] = None, *args, target: Union[str, Target] = 'auto', target_host: Optional[Union[str, Target]] = None, execution_backend: Literal['dlpack', 'ctypes', 'cython'] = 'cython', verbose: bool = False, pass_configs: Optional[dict] = None) → JITKernel#

Caches and reuses compiled kernels to avoid redundant compilation.

Parameters:

  • func – Function to be compiled or a prepared PrimFunc

  • out_idx – Indices specifying which outputs to return

  • target – Compilation target platform

  • target_host – Host target platform

  • *args – Arguments passed to func

Returns:

The compiled kernel, either freshly compiled or from cache

Return type:

JITKernel

clear_cache()#

Clears the entire kernel cache, including both in-memory and disk cache.