Does an H R Manager have access to occupational health files?

I am an occupational health nurse and the hr manager is insisting fot the keys to the medical records and it looks as if i could loose my job as I have refused him access