An infected sebaceous cyst occurs when bacteria enter the blocked gland, leading to inflammation and pus formation. Symptoms include pain, warmth around the cyst, and a foul-smelling discharge. If left untreated, the infection can spread, requiring more invasive medical interventions.