Like James, I gotta agree with Alida.
If you're changing the era, that's one thing, but if you're writing about the Regency, you should, to the degree you can, write
like the Regency. It worked for Georgette Heyer (and unlike most of us, though Ms. Heyer's books evoke Jane Austen, she had the good manners to create her own characters).
On the manlier side, it worked for military historical fiction writer Patrick O'Brian. Notwithstanding my being a Bernard Cornwell fan, compare a Richard Sharpe novel (which are, rather deliberately, written to more modern tastes) to a Jack Aubrey novel, and tell me which one
really evokes its era.
JIM D.