There could be a parasitic draw involving the relay that is keeping it engaged. Lexus specifications for parasitic draw with the key off is approximately 50 milliamps. Anything over this amount indicates a parasitic draw. You could remove the fuses...