Yes, although changing this will mean that you will not know who is transferring the call to you.
Login at https://dialpad.com, scroll down and click Your Devices, and then click Advanced Settings.

The Advanced Settings window will open and within the Calls to your departments/office main line section, click the button to select the option for Display the caller's number.

Click Save Changes (at the bottom) and the change will take effect immediately.