The ABI stable implementation incorrectly used getCurrentStream().id()
which returns a StreamId (int64_t) instead of the actual cudaStream_t
pointer. Casting an integer ID to a stream pointer caused segmentation
faults when using custom CUDA streams.
Fixed by using the proper AOTI C API function aoti_torch_get_current_cuda_stream()
which returns the actual CUDA stream pointer.
* errors are with C++11 narrowing warnings (treated as errors in strict builds) when initializing at::cuda::CUDAGuard with a non-constant char cast to c10::DeviceIndex (signed char).
* errors are with C++11 narrowing warnings (treated as errors in strict builds) when initializing at::cuda::CUDAGuard with a non-constant char cast to c10::DeviceIndex (signed char).
* errors are with C++11 narrowing warnings (treated as errors in strict builds) when initializing at::cuda::CUDAGuard with a non-constant char cast to c10::DeviceIndex (signed char).
* errors are with C++11 narrowing warnings (treated as errors in strict builds) when initializing at::cuda::CUDAGuard with a non-constant char cast to c10::DeviceIndex (signed char).
* Update flash_api_stable.cpp
* upstream cutlass v4.2.1 csrc
skarupke