You're probably using a desktop environment along with Linux. Whether it's an extra lightweight one or more fully-fledged, you'll need one if you want to run graphical applications. Sure, you could try running everything in the terminal, but that's just silly.