If you feel your safety is at risk then you should quit. You could also talk to your manager about your concerns and see what they have to say. They might have run into this issue with other employees as well.

Another thing to consider is to keep working there until you find another job. That way you'll still be able to use that as current employment on a resume. If the interviewer asks why you are switching jobs or taking a pay cut you could say that you are looking for something that works better with your schedule.