This reveals one of the problems with binary digital computers:

• Limit on size of number and “resolution” due to a fixed number of bits:

• 8 bits, biggest number 11111111 = 255
  
  resolution 1 part in 255
  
  16 bits, biggest number 11111111 11111111 =65,535
  resolution 1 part in 65,535

Previous slide

Next slide

Back to first slide

View graphic version