Vendor OpenMPI and NCCL via build_dependencies

Switch DDP example to NCCL backend

Add NCCL distributed backend with Vulkan-CUDA interop

fix

fix

fix

Added example

C++ version

fixed comments

fixed

Реализация свёртки методом Winograd для CPU

[CPU] Edit variables for assertions

[CPU] Update naive conv

Merged: master && conv_develop

merge upstream

Document NCCL vs MPI benchmark results and P2P analysis

Tune ddp.py: 500M params, batch=32, 20 steps for dramatic comm-bound comparison

Scale ddp.py to ~810M params for dramatic NCCL vs MPI comparison

Bump ddp.py model to ~240M params for V100 32GB

fix

fix

fix

lager model

fixed bug

fix

fix