I have the Sessionbox extension for Chrome running in Brave, and it's broadly similar. It is not identical and I do not promise it'll meet your needs, especially if you define your needs as "exactly the same way it works in Firefox", but it's worth a try.

But it's doing what I want it to do, have multiple AWS accounts open at once in one browser.