Performance regression in dataflow task scripts

[ChrisCummins]

#142 appears to have caused a large performance regression for the dataflow task GGNN loops.

Performance now: ~2 graphs / sec for training/validation, and ~12 graphs / sec for validation
Performance before: ? (need to repo)

[sarathsankar]

Hi @ChrisCummins,

The number varies, while training earlier it was around 40 graphs/s.
For validation: 211 graphs/s
Since there was halting-issue earlier, I don't have a number for testing.
Hope, below screenshot may help you.

Regards,
Sarath KS

[ChrisCummins]

Excellent, thanks for that @sarathsankar. I'm going to be off-the-grid for a couple of weeks but will take a look as soon as I'm back. This is high priority, release blocking.

Cheers,
Chris

[ChrisCummins]

Superseded by #178.