Town were beaten 2-0 in a physical match after two first-half goals from Lewis Perkins.
Blues struggled against a big Charlton team and conceded half way through the first-half when Perkins shot from close range and the same player struck again from inside the 18 yard box just before half-time.
Charlton started the game strongly and had a good chance to take the lead when Perkins was one on one with Town 'keeper Mirko Ranieri but the Charlton striker's shot was well saved.
Town then began finding their feet in the game and David Cawley had two chances from range but neither found their way into the back of the net.
Town almost found themselves with the opener when Josh Carson's corner from the right looked to be swinging into the goal but Charlton 'keeper Jack Binks touched the ball out for a corner.
Despite the spell of Town pressure it was the visitors who got the opener when Tamer Tuna passed the ball to Perkins inside the 18 yard box and the striker stroked the ball into the bottom right corner of the goal on 30 minutes.
Charlton had a good opportunity to double their lead but Tuna's lobbed effort hit the bar and was cleared.
Charlton captain Carl Jenkinson then had a drilled free kick from 20 yards very well saved by Ranieri who moved quickly across to save in the right side of his goal.
The Addicks extended their lead in the 43rd minute when Tosan Popo broke down the right and slid the ball across the face of goal for Perkins to guide into the net.
Town struggled to get back into the game but managed to carve out to half chances one of which from Cawley forced a good save from Binks who tipped the shot over.
Charlton almost had a third goal on the hour but Ranieri made a good one handed save from Jenkinson's well struck free kick.
Cawley was booked seven minutes from time as Town got frustrated and Charlton had the chance to kill the game off when Popo broke down the right and into the box but his shot across goal was just wide of the post.
The game ended with Town's Carson sent-off for a tackle and Freddie Warren booked for Charlton as the Addicks left with the points.
Report: Blair Ferguson