Everything has to take up space, so what is outer space taking up?

More space: someone more versed in astronomy can correct me if I'm wrong, but I believe "outer space" just refers to spatially-extended bits of the universe beyond our galaxy. I'm not sure I agree, though, that everything has to take up space. What about numbers or colors or God(s)...?