This can be mostly mitigated with the right system prompt although I noticed occasionally the prompt will be ignored (~1/20).