cli: Add benchmark-per-layer functionality #56
Description
Currently we can do "whole-network" performance measurements, but that is not very helpful for finding performance bottlenecks or spotting issues. It would be useful to implement a plan-runner similar to how upstream does it where we can run each layer independently and benchmark it.