|
MayaFlux 1.0.0
Digital-First Multimedia Processing Framework
|
|
inlinenodiscard |
One nn_attention_scores dispatch: scale times the dot product of every query with every key, per head.
q and k are [heads * dim, time], head h owning channels h * dim onwards. scores is [heads, time, time], indexed head, query, key.
| std::invalid_argument | When heads, dim or time is 0. |
Definition at line 214 of file Stages.hpp.
References attention_scores_shader, MayaFlux::Yantra::TensorKernels::detail::make_grid_stage(), and MayaFlux::Yantra::TensorKernels::detail::refuse().
Referenced by MayaFlux::Yantra::HubertPhonemeModel::Impl::run().