You don't route traffic to the modem, just like you don't route traffic to your phone line. The connection is strictly layer1.
You can assign an IP address to certain modems for remote management purposes, however these modems have a dedicated port for such tasks, they don't use the serial port.