IF the bios sees all four gigs it is a Windows 32 issue and nothing more. What is sees will depend on what is installed into the system that is needs to allocate resources. This can range from 2 to 3.25 gig.
If the Bios does not see all four gigs then either it needs a reset or a possible bad stick, or even a possible seating issue.