Listen to yourself. If you are not interested or available, speak directly, firmly but politely to set your limits.