Thank you for doing this analysis. It's shocking (if understandable why given the examples it was trained on). What is exciting though is as we're working to train each individual family's AI - understanding roles, jobs, interests etc - it's picked up on things in a much less biased way.
This is really interesting and way more compelling evidence to me of gender bias in the LLM than response bias in the prompt and context.
Thank you for taking the time to approach this scientifically and share the evidence with us. I appreciate knowing the truth of the matter, and it seems my suspicion that the bias was from the prompt was wrong.
Emily / Sophia vs Bob / John https://imgur.com/a/9yt5rpA