An identifying event in sports video has many efforts of sports applications. In this paper, proposed a system for automatic detection of key events in Broadcast Tennis Video (BTV). The ultimate goal is to detect the events of complete tennis match. The detected tennis events are fault, rally and net approach, there are also other events in BTV, they all are considered as secondary one. To detect the events of tennis by analyzing the player`s position and ball tracking. The experiments done in different tennis tournament, which has the events (fault, rally and net approach), the some of the visual features are extracted from MHI (Motion History Image) and modelled by Support Vector Machines (SVM) and Hidden Markov Model (HMM) for recognizing tennis events. In result HMM gives a higher accuracy rate of 96.66% when compared to SVM rate of 86.42%.