Well, no. That would be bad.
First, drain the oil tank for your bike. Then, remove the pump itself. Then, get some vacuum caps and remove the hose that went from the injector to the CARB. Pull the hose off the carb and put a vacuum cap where the oil line went in.
If you don't do that, you will be very lean (since it's pulling in as much air as it wants) and either your engine won't run, or your engine may seize anyway.
Also, if you're removing it only because of what some certain members tell you (ie, jerry for example), don't worry about it. It's a holy crusade of some people to say that the injectors are junk.
--Scott