Separate optional dep test to enable pyarrow upgrade

[amitschang]

          Might need to separate the optional tools testing so they don't block migration of pyarrow

@dependabot ignore this major version

Originally posted by @amitschang in #104 (comment)