As a iOS user, each app should remember the last keyboard language I used. Apps can apply even finer granularity, for example in Telegram, each chat can retain its own keyboard language.