Gildon played a large role on the Steelers special teams unit during his first two years before being inserted into the starting lineup in 1996, after All-Pro pass-rusher Greg Lloyd went down in the season opener with a torn knee ligament. Gildon turned in 7.0 sacks in 1996 and had landed a permanent spot on the outside.
1997 saw Gildon lineup opposite Lloyd after returning and recorded 5.0 sacks, 53 tackles, 12 passes defensed, and 1 defensive touchdown. Gildon was most remembered in 1997 for recovering a Drew Bledsoefumble late into the Steelers 1997 Divisional Playoff match-up against the New England Patriots; the Steelers would win this game 7-6 thanks to Gildon securing the ball, preventing a possible Patriots field goal or touchdown.