You are correct; Ernie is not asking a question, but making a statement.
As you may know, most declarative sentences in English follow subject-verb-object (SVO) order, but they can be reversed or altered. Inversion can be used for emphasis as well as in questions, conditionals, comparisons, and so on. As a rhetorical device it is known as anastrophe.
Ernie could say I am thirsty, but as the clip shows, he seems to want to make it well-known that he is thirsty, or that he is very thirsty, so he chooses the more emphatic form— and furthermore introduces the sentence with boy, in Merriam-Webster's words, used to express intensity of feeling. The humor lies in his continuing to bellow about thirst afterwards, when not only is emphasis unnecessary, but the very pronouncement of his former thirst is itself unnecessary.
This kind of inversion is not altogether uncommon; consider examples like the following:
Are you excited to visit your grandmother?
Am I ever!
On no point did we agree.
The English language I understand; English speakers are another matter.
btw, that's an old Jewish / Yiddish joke. I don't have a definite etymology, but I'm pretty sure it was on a 1965 comedy album called You Don't Have to Be Jewish + probably dates to Borscht Belt humor from much earlier.
But I like the Bert & Ernie delivery better. :-)