A　fast　and　reliable　motion　detection　algorithm　is　very　important　to　an　intelligent　surveillance　system.　Local　Binary　Pattern　(LBP)　is　one　of　powerful　texture　description　and　comparison　mechanisms,　but　in　contrast　consumes　a　large　portion　of　computational　time　in　a　CPU　based　system.　In　this　paper,　we　propose　a　moving　object　detection　algorithm　based　on　the　improved　LBP　operator　which　is　tolerant　against　pixel　noise.　Combining　the　background　subtraction　algorithm　and　the　frame　difference　algorithm,　the　automatic　refreshing　of　the　background　is　realized.　The　moving　object　detection　system　which　can　achieve　real　time　processing　of　a　1024　x　768/60　Hz　VGA　signal　is　designed　on　a　PFGA　chip　and　all　the　algorithms　are　mapped　to　hardware　logic.　ROC　curves　of　the　experiments　demonstrate　that　in　the　condition　with　shifty　illumination,　the　algorithm　based　on　LBP　operator　has　a　better　performance　than　the　algorithm　based　on　grayscales.