The model can be extended by replacing this simple average with distributional information, for example, incorporating realistic character frequency information.