I was just going to make the same suggestion as Katerina.
I had a mouse problem last year in my old rented apartment too.
1. I cleaned everything! All food was in airtight containers so that prevent them from smelling the food.
2. I cleaned and tidied the entire apartment to make sure they weren't hiding under furniture at the moment.
3. I blocked off all suspected mouse holes, cracks in moldings, etc etc. You can use steel wool for the space around plumbing.
4. I wiped peppermint oil across doorways and other entrances that I thought the mice could possibly be using. and Lastly I applied peppermint oil all over the kitchen. The peppermint confuses the mice's senses.