Python

A simple implementation of byte-pair encoding

By Martin / The Lab, Python / Friday May 7th, 2010 / 2 comments

Byte pair encoding is a simple but (sometimes) effective algorithm for compressing data (especially textual data). Best of all, it is very easy to understand! Therefore, in this experiment I have created a simple Python script that implements byte pair encoding on files.

Pages: 1