What does causal-conv1d do?

[WiiliamC]

I compared training with and without causal-conv1d installed. The speed looks the same. Isn't causal-conv1d supposed to be more efficient?

[Rainbow96r]

Specialized low-level optimization (CUDA kernels)
Avoids unnecessary computations (does not compute future-dependent parts)
More efficient memory access patterns.
So even if the speed appears similar, causal-conv1d ensures correct causal relationships, which is crucial for the quality of generation tasks!