Abstract: To achieve the purpose of pepper automatic classification using machines instead of human eyes, based on color feature of red, green and versicolor pepper, we design and build a hardware system that combines high- resolution programmable TCS230 color sensor with high frequency STM32 microcontroller. Meanwhile we design recognition experiments for more varieties of pepper, compare the results of system identification with eye recognition feelings, and draw the conclusion that the accuracy of system recognition is above 94%.