Just change the fan temperature trip point to a lower value, like 50C. You can change the trip point with the following command:
echo "50000" > /sys/devices/virtual/thermal/thermal_zone0/trip_point_4_temp
The current trip point is set at 65000, or 65C. Since the fan is running at full speed and is a little loud for my ears.
I decided to unplug the fan and place two wires into the fan connector and power the fan directly from the 40 pin gpio header. So I then use pin 6 to the black fan wire (ground), and pin 1 to the red fan wire (3.3 volts). Now the fan is running quietly, and constantly, and the best part is it still keeps the Coral dev board cool.