Make tokenize_and_concatenate work with more datasets#473

ArthurConmy wants to merge 5 commits intoTransformerLensOrg:mainTransformerLensOrg/TransformerLens:mainfrom

ArthurConmy:generalize-token-concatArthurConmy/TransformerLens:generalize-token-concatCopy head branch name to clipboard