Skip to content

Can decrease k by layer

Compare
Choose a tag to compare
@tatp22 tatp22 released this 17 Jun 21:53
· 76 commits to master since this release

Added the flag where one is able to reduce the value of dim_k by layer, with the k_reduce_by_layer flag. This was alluded to in Figure 1 of the paper, where the normalized cumulative eigenvalue index went up by layer, meaning that we can potentially get away with lower dimensions at higher depths.