Abstract: - The crime is increasing day by day. So for the security, the demands for surveillance cameras are also increased. Surveillance cameras are more and more being used in public places e.g. streets, intersections, banks, shopping malls, etc. However, the monitoring ability of law enforcement agencies has not kept pace. The outcome is that there is a deficiency in the utilization of surveillance cameras and an unworkable ratio of cameras to human monitors. One critical task in video surveillance is detecting anomalous events such as traffic accidents, crimes or illegal activities Such systems require frequent rule-base updates and signature updates, and are not capable of detecting unknown attacks. So to overcome from this problem we proposed a system which will analyze and detect the suspicious human activity from real-time CCTV footage using neural networks.Keywords: - Anomaly detection, Video Surveillance, CNN, Machine learning, Image processing.