Hola Katie

This is because the word "duro" is an adverb (You work hard) , so it doesn't change for masculine or feminine. 

It may be misleading because some adberbs have the same form as the masculine singular adjective form, like this one. You'd never say "Trabajas dura" to a lady. That's incorrect.

Saludos