Words suggested while writing commit messages have come from a Markov model since 2017, built from public GitHub commit messages. I am now experimenting with a 5 million parameter transformer model which also runs entirely on device. Test users can switch between the two with the gear button to the right of the word suggestions, and let me know which one you prefer. https://testflight.apple.com/join/VduxyR5a