Yes, both outputs are active at the same time. In most cases, both the speaker and headphone will respond to Master volume settings unless clearly marked otherwise.  And it is OK to unplug the speaker when only using headphones, or going into a PA.