Should i take my 9 month old to daycare tomorrow?

Ok so last nite my daycare worker called me and said my baby had a fever of 100.2 (armpic) I go and get him i was scared.. i took him to the hospital and his temp got up to 103.5 (rectal)..so i told them the symptoms (some coughing), and fever.. they did an xray and found some gunk in the lungs so they diagnosed him with very early pneumonia.. they sent him home after giving him a shot and giving me antibiotics.. and today i went to the pediatrician and she said that she can hear that his lungs have some gunk But he has had NO fever in 24 hours.. she said what it may have been was possibly a bit of swine flue that turned into pnemonia or just a cold that turned into pneumonia.. it angered me i did not get a clear answer.. i stayed home with him all day today and he seems fine.. but my daycare worker said i CANT bring him in if he has any swine flu,, and like i said i never got a clear answer.. i have to work tommorow and my mom is trying to get up here tommorow night to help with the baby since she lives a ways away.. so i am wondering if it sounds serious enough to keep him home he has had NO fever in the last 24 hours and he seems fine.