Why do computers use binary?
Short answer
Electronic circuits can reliably represent two states such as a higher or lower voltage, making binary convenient.
How it works
Decimal numbers and text are also represented internally as combinations of bits. Binary is a foundation, not the whole picture.