Is it illegal to wear my uncle's US Navy uniform?

OK, I've heard about this "Stolen Valor Act" where you would get fined 5 grand and jailed for 6 months for wearing military clothing, and it worried me because I often wear my uncle's naval officer dress blue jacket. It's a good luck thing, more or less. I NEVER claim to be associated with the US military (i was medically denied. I can't get in). Is this in violation to the Stolen Valor Act?