2021年3月8日星期一

how to module int64 by avx

I want to implement 5%3=2 by avx.

normal: int64 x = a % b    math: int64 x = a-((double)a/b)*b    avx:  __m256 tmp1 = _mm256_cvtepi32_ps(data);  I need convert a big number from int64 to float, then float overflow.    

how to solve overflow when convert int64 to float?

https://stackoverflow.com/questions/66540229/how-to-module-int64-by-avx March 09, 2021 at 11:06AM

没有评论:

发表评论