Sing to Him, sing praises to Him; tell of all His wonders. Glory in His holy name; let the hearts of those who seek the LORD rejoice. Seek out the LORD and His strength; seek His face always.

We rejoice because He hasn't hidden Himself from us. If we seek God, we find God.