A flag for the sports club is a rectangle measuring 20 inches by 32 inches. Within the rectangle is a yellow square with a side length of 6 inches. What is the area of the flag that is not part of the yellow square?