1. Determine the token merges

2. Add logprob tensors in the merged positions