Basically "Childhood's Hour" is just a fancy way of saying the minute he was born. . .
Perhaps you have read some of Sir Edgar Allen Poe's works or the short biography previously linked. Poe often said things in a way different than most because to face the facts he was different than most. This poem truly expresses the way Poe feels about himself.