From the control panel, navigate to:
Settings > Device > Preferences > Audio Feedback
Adjust the volume.
Notes:
Settings > Device > Accessibility
Adjust Headphone Volume.