Video surveillance applications exist in airports, banks, offices and even our homes to keep us secure. Video surveillance systems currently are undergoing a transition where more and more traditional analog solutions are being replaced by digital ones. Compared with the traditional analog video surveillance system, a digital video surveillance offers much better flexibility in video content processing and transmission. At the same time, it, also, can easily implement advanced features such as motion detection, facial recognition and object tracking. DSPs can be used to design various video surveillance systems from low-end to high-end, from a portable implementation to plug-in implementation. This paper explains how DSP-based digital media processors can manage a high-resolution, video surveillance system over the Internet protocol with the appropriate architecture and peripherals.