Your iPad will need to be 3G-enabled for compass mode to work away from a Wi-Fi connection. Wi-Fi only iPads do not have built-in GPS.
To check, please see if the box that your iPad came in says 'Wi-Fi only'. If this is the case, then it will only function fully when connected to Wi-Fi.
You could consider buying an external GPS adaptor for your Wi-Fi only iPad.