Erm, it's not true that fermions are matter and bosons are energy. Both are particles just the same. The fundamental difference is that bosons obey one kind of statistics, and fermions obey another. What this means is that multiple bosons can be in the same place at once, quantum mechnically speaking, while fermions with the same properties can't occupy the same space. For fermions (like electrons) that's the Pauli uncertainty principle you learned about in high school.

Now, there's a nifty little feature of the Universe that when you quantize spins, bosons are the particles with integer spins (0, 1, 2) and fermions are the guys whose spins end in 1/2 (1/2, 1 1/2, etc.).

Another feature (which I think you were thinking of) is that of all the fundamental particles we know, everything which we consider regular matter is a fermion, and every force carrier (like the graviton and the photon) is a fermion. I'm not sure if that's a hard and fast rule, and in quantum mechanics the difference between a force carrier and a "stuff" particle is a bit unclear to begin with. They're all particles, and the only difference is the spin.