Indoor-outdoor cats are best for catching mice

Seal up crevices with steel wool to prevent mice in the walls
Place soaked cotton balls with peppermint oil around the house to deter mice