What would cause the libraries to not load and connect to a smart card reader

I have an issue where my computer will cease to operate with my CAC reader until I reboot. It happens after the laptop has been running a while. I have looked for any LauchAgents I could restart but I haven't found any. I will not be able to see my certs in the Keychain and the reader will flash the LED once then stop. I am using an SCR 3311.

Can you offer me any tips on something to look into?
