I want to implement 5%3=2 by avx.
normal: int64 x = a % b math: int64 x = a-((double)a/b)*b avx: __m256 tmp1 = _mm256_cvtepi32_ps(data); I need convert a big number from int64 to float, then float overflow. how to solve overflow when convert int64 to float?
https://stackoverflow.com/questions/66540229/how-to-module-int64-by-avx March 09, 2021 at 11:06AM
没有评论:
发表评论