本目录下提供了 Winograd 算法的 GPU CUDA 实现,使用 Thrust device vectors 进行内存管理。主要包括以下文件:
naive_conv.cu文件中包含了使用朴素卷积算法的基准实现,请不要修改;winograd_conv.cu文件中的提供了未经优化的 F(2x2, 3x3) 的 Winograd 卷积算法实现,您需要在此基础上保留winograd_conv的函数签名进行优化;main.cu文件中包含了测试代码和性能评估,请不要修改 (多卡并行例外)。
Makefile 文件中定义了编译规则,您可以尝试使用不同编译器和编译参数来优化性能。默认使用 nvcc -O3 编译。
# 使用 Makefile 编译
make
# 或者直接使用 nvcc 编译
nvcc -O3 main.cu naive_conv.cu winograd_conv.cu -o winogradinputs 文件夹中提供了一组测试样例,进行性能评估和正确性测试。要运行程序,可以使用以下命令:
./winograd inputs/config.txt您将会在命令行中看到输出结果,以下是一个示例输出:
$ ./winograd inputs/config.txt
=== Running Naive Convolution ===
Layer 0: 1.49 ms (1800.00 GFLOPS)
Layer 1: 13.25 ms (2155.21 GFLOPS)
Layer 2: 24.87 ms (2295.65 GFLOPS)
Layer 3: 48.63 ms (2347.90 GFLOPS)
Layer 4: 99.46 ms (2296.10 GFLOPS)
Layer 5: 37.38 ms (2326.91 GFLOPS)
Layer 6: 74.30 ms (2341.25 GFLOPS)
Layer 7: 148.40 ms (2344.36 GFLOPS)
Layer 8: 297.09 ms (2342.00 GFLOPS)
Layer 9: 111.04 ms (2132.24 GFLOPS)
Layer 10: 1.02 ms (2085.59 GFLOPS)
Layer 11: 19.40 ms (2335.41 GFLOPS)
Layer 12: 9.35 ms (2325.11 GFLOPS)
Layer 13: 18.61 ms (2336.54 GFLOPS)
Layer 14: 5.59 ms (2189.67 GFLOPS)
Layer 15: 2.08 ms (2045.98 GFLOPS)
Layer 16: 5.47 ms (2070.24 GFLOPS)
Layer 17: 5.72 ms (1900.61 GFLOPS)
Baseline Total: 923.14 ms (2300.40 GFLOPS)
=== Running Winograd Convolution ===
Layer 0: 1.26 ms (2128.92 GFLOPS)
Layer 1: 11.12 ms (2566.13 GFLOPS)
Layer 2: 22.13 ms (2580.34 GFLOPS)
Layer 3: 44.45 ms (2569.12 GFLOPS)
Layer 4: 89.36 ms (2555.79 GFLOPS)
Layer 5: 33.74 ms (2578.05 GFLOPS)
Layer 6: 67.50 ms (2577.12 GFLOPS)
Layer 7: 134.72 ms (2582.40 GFLOPS)
Layer 8: 271.27 ms (2564.94 GFLOPS)
Layer 9: 91.10 ms (2598.86 GFLOPS)
Layer 10: 1.01 ms (2113.21 GFLOPS)
Layer 11: 17.65 ms (2567.90 GFLOPS)
Layer 12: 8.52 ms (2550.79 GFLOPS)
Layer 13: 16.87 ms (2578.20 GFLOPS)
Layer 14: 4.85 ms (2524.08 GFLOPS)
Layer 15: 1.73 ms (2459.30 GFLOPS)
Layer 16: 4.52 ms (2505.10 GFLOPS)
Layer 17: 4.50 ms (2414.01 GFLOPS)
Custom Total: 826.27 ms (2570.08 GFLOPS)
=== Correctness Check ===
Layer 0: CORRECT (Speedup: 1.18x)
Layer 1: CORRECT (Speedup: 1.19x)
Layer 2: CORRECT (Speedup: 1.12x)
Layer 3: CORRECT (Speedup: 1.09x)
Layer 4: CORRECT (Speedup: 1.11x)
Layer 5: CORRECT (Speedup: 1.11x)
Layer 6: CORRECT (Speedup: 1.10x)
Layer 7: CORRECT (Speedup: 1.10x)
Layer 8: CORRECT (Speedup: 1.10x)
Layer 9: CORRECT (Speedup: 1.22x)
Layer 10: CORRECT (Speedup: 1.01x)
Layer 11: CORRECT (Speedup: 1.10x)
Layer 12: CORRECT (Speedup: 1.10x)
Layer 13: CORRECT (Speedup: 1.10x)
Layer 14: CORRECT (Speedup: 1.15x)
Layer 15: CORRECT (Speedup: 1.20x)
Layer 16: CORRECT (Speedup: 1.21x)
Layer 17: CORRECT (Speedup: 1.27x)
=== Final Results ===
Results are correct!
Naive: 923.14 ms (2300.40 GFLOPS)
Winograd: 826.27 ms (2570.08 GFLOPS)
Overall speedup: 1.12x