Here is the solution:
- Highlight the dimension and right click to Properties.
- Under Text, the first item is Fill Color, which is typically set to None.
- Scroll down and select Background.
This can also be applied in the dimension style for all of your dimensions to have a Background Mask.