This ruling is based on a Midrash that expresses the thought that on the departure of Yom Hakippurim a heavenly voice (Bat Kol) is heard declaiming the verse in Ecclesiastes.