It depends on which bits of the fig tree you want to prune: If you are just talking about taking off all the whippy sucker-like growths that spring up around the base of the trunk, no, it's not too late yet. If I'm honest, too, if you feel the rest of the tree needs shaping or cutting back because it's too big, I'd go for it - the leaves on ours aren't really showing yet, so I'm assuming they aren't on yours, either, and I doubt a bit of pruning would hurt the tree.
Welcome to GoY!