The pantheon isn't huge, can be done within an hour. Be sure to go downstairs to see the crypt. It's not scary and well-lit. There are crypts of Zola and the only Victor Hugo.
There was no line when I went. Guess this place isn't as famous. Watch out for temporary closure for events!