Skip to content

Commit

Permalink
fix typo
Browse files Browse the repository at this point in the history
  • Loading branch information
cloudhan committed Jul 2, 2024
1 parent c3c7089 commit f4355d4
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion onnxruntime/contrib_ops/cuda/bert/rotary_embedding_impl.cu
Original file line number Diff line number Diff line change
Expand Up @@ -116,7 +116,7 @@ Status LaunchRotaryEmbeddingKernel(cudaStream_t stream, T* output, const T* inpu
// and num_heads values, we can create a block as `block(num_heads, head_size, 1)`
// instead. This will require kernel changes to support.
ORT_ENFORCE(head_size <= max_threads_per_block, "Rotary embedding dim must be <= max_threads_per_block");
// strides in cannoical bnsh coord, h is always contiguous (dim_stride == 1)
// strides in canonical bnsh coord, h is always contiguous (dim_stride == 1)
ORT_ENFORCE(in_strides.w == 1 && out_strides.w == 1, "head dim must contiguous");

int tpb = (head_size + 31) / 32 * 32;
Expand Down
2 changes: 1 addition & 1 deletion onnxruntime/contrib_ops/rocm/bert/group_query_attention.cu
Original file line number Diff line number Diff line change
Expand Up @@ -517,7 +517,7 @@ Status GroupQueryAttention<T>::ComputeInternal(OpKernelContext* ctx) const {

return Status::OK();
#else
return ORT_MAKE_STATUS(ONNXRUNTIME, EP_FAIL, "GroupQueryAttention requires ck_tiles to be enabled");
return ORT_MAKE_STATUS(ONNXRUNTIME, EP_FAIL, "GroupQueryAttention requires ck_tile to be enabled");
#endif
}

Expand Down

0 comments on commit f4355d4

Please sign in to comment.