The club was formed by 30 local football enthusiasts on 10 March 1903, under the name of Tor- und Fußballclub Germania 03 Zehlendorf.[3] By 1909, it had however changed its name to FC Hertha Zehlendorf. In 1913, the club moved to a new ground, Siebenendenweg, now called Ernst-Reuter-Sportfeld, away from the Tempelhofer Feld, where it was never entirely happy. The team was for a time part of BFC Hertha 1892 but by September 1914 the club became independent again, under the name of FC Hertha 06 Zehlendorf.
After the end of the First World War, in January 1919, the club merged with local side VfB Zehlendorf 03 to form the current club, FC Hertha 03 Zehlendorf. It was from this union, Hertha derives its foundation date, too.
In 1963, German football was fundamentally changed with the introduction of the Fussball-Bundesliga. Below it, five regional leagues, the Regionalligas, were formed. Hertha did not apply for a spot in the new Bundesliga as only one club from Berlin was admitted and the bigger names in local football, Hertha BSC and Tasmania 1900 far out qualified the little club.[6]
Instead, the club qualified for the new tier-two Regionalliga Berlin, a league it would belong to until its disbanding in 1974. In this league, Hertha continued its existence as an average side, at least for the first couple of seasons. From 1965, the clubs results improved and it developed into an upper table side.
In 1968-69, the team archived its greatest success so far, winning the Regionalliga and thereby qualifying for the promotion round to the Bundesliga. In this competition, the club came fourth out of five teams, when only the winner, Rot-Weiß Oberhausen, qualified for promotion.
From 1988 to 1990, the Oberliga Berlin became the scene of Herthas struggle with Reinickendorfer Füchse for the league championship but both times Reinickendorf won the upper hand. Each time, Hertha only earned the right to compete for the amateur championship again and each time it lost in the first round.[13]
1990-91 was the Oberliga Berlins last season, the German reunion also affected football and the NOFV-Oberliga was established instead. Hertha became part of the NOFV-Oberliga Mitte, a league dominated by 1. FC Union Berlin in its short three year existence and Zehlendorf managed only average performances. Nevertheless, it did qualify for the new tier-three Regionalliga Nordost in 1994. In a league full of former East German football powerhouses, the team struggled for four seasons before being relegated in 1998.
The club managed to only survive two seasons in the NOFV-Oberliga Nord (IV) before another relegation, now to the tier-five Verbandsliga Berlin. It has since spent its time in this league, earning places in the upper half of the table but not being able to win another league championship.