7e Hussards was formed on December 21st 2010. Back then the already existing regiments were pretty much the 84e the 92nd and the 1er Gren.
If we consider the 1er Grenadiers as a still active regiment, then it'd be them, but if not I'd say the 7e is at least one of the oldest regiments around, if not the oldest.