In libarchive/adapters/archive_read.py line 61 the codec is set to _ASCII_ENCODING, which in line 18 is hard-coded into 'ascii':
filepath = filepath.encode(_ASCII_ENCODING)
_ASCII_ENCODING = 'ascii'
Replacing _ASCII_ENCODING with 'utf-8' temporarily solves my problem.