Should we just take away the pacifier now?

My 3 month old sleeps through the night without wanting to eat, but usually will wake once or twice wanting her pacifier. Last night I was up about ten times just because she wanted her pacifier. Obviously she has developed a dependency on it at night. Should we put a stop to it now? I'd rather her wake up for feeds. At least then I am bonding with her. Getting up and down so often is just exhausting though! I never got exhausted when she was waking to eat.