Yes, you need the router. This will enable you to build a voip PBX with many many features. This is called CME and is embedded in IOS.
If you do not want to use that anyway, buy non-cisco phones that can do "direct ip calls". Most good brands do.
Hope this helps, please rate post if it does!
