@Loh Jane,
You can leave out "of the week" and not lose any meaning, especially if the period of discussion has been signalled already e.g.:
Person A: I only work part of the week.
Person B: Which days do you work?
Person A: I work Mondays, Wednesdays and Fridays.