Swiglu Struct Reference

Swiglu Struct Reference#

Composable Kernel: ck_tile::moe::Swiglu Struct Reference
Public Member Functions | Public Attributes | List of all members
ck_tile::moe::Swiglu Struct Reference

#include <moe_flatmm_kernel.hpp>

Public Member Functions

CK_TILE_HOST_DEVICE Swiglu (float alpha_=1.702f, float limit_=7.0f)
 
template<typename T >
CK_TILE_HOST_DEVICE T operator() (T gate, T linear) const
 

Public Attributes

const float alpha
 
const float limit
 

Constructor & Destructor Documentation

◆ Swiglu()

CK_TILE_HOST_DEVICE ck_tile::moe::Swiglu::Swiglu ( float  alpha_ = 1.702f,
float  limit_ = 7.0f 
)
inline

Member Function Documentation

◆ operator()()

template<typename T >
CK_TILE_HOST_DEVICE T ck_tile::moe::Swiglu::operator() ( T  gate,
T  linear 
) const
inline

Member Data Documentation

◆ alpha

const float ck_tile::moe::Swiglu::alpha

◆ limit

const float ck_tile::moe::Swiglu::limit
The documentation for this struct was generated from the following file:
  • /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-composable-kernel/checkouts/develop/include/ck_tile/ops/flatmm/kernel/moe_flatmm_kernel.hpp