Try a white blouse underneath your casual LBD to freshen it up!
Keep the accessories classic; tortoiseshell bracelets, small gold hoops, plain black patent peep toe pumps (always ok to add a bit of shine to a neutral pallette)
For an Empire waist, add a neutral belt, but preferably not black, it would just blend into the dress
Pintuck accents on the neckline of the blouse are a nice subtle delicate detail
I love this LBD because its cotton for more casual work occasions, and the faint grey polka dots make it fun!